KR100871222B1 - A method and apparatus for automatic image management - Google Patents

Abstract

TECHNICAL FIELD The present invention relates to a photographing apparatus, and more particularly, to an image automatic management method and apparatus. According to the present invention, when a predetermined number of still images are continuously photographed at a predetermined time interval and temporarily stored, and when a new still image is stored while all of the predetermined number of still images are stored, the oldest still image is stored. Discarding the image and temporarily storing the new still image, wherein the predetermined number of the most recent still images is temporarily stored in real time.

Magic Moment application, pause, resume, stop

Description

A METHOD AND APPARATUS FOR AUTOMATIC IMAGE MANAGEMENT}

The present invention relates to photography, and more particularly, to a system and method for automatically managing images by a mobile communication terminal having a camera function.

The mobile communication terminal may be, for example, a functional phone with a camera, a smart phone, a portable device, a software desktop application, or the like. International Patent Application Publication No. WO / 2005/055585 discloses a camera for recording an image sequence. The patent describes a camera which has a function of taking a picture immediately after activating the shutter release button and including a buffer in which a plurality of pictures are stored. The plurality of photographs include photographs taken previously as well as photographs taken after the traditional method. This allows the user to review the photos taken at the moment the shutter release button is activated within the plurality of photos, select one or more more desirable photos, and store them in the camera's nonvolatile memory.

The patent discloses a method of taking a picture using a camera, which method is substantially continuous, taking and storing a first plurality of pictures during the preview of the camera, independent of the activation of the activating means; Taking a picture (user-clicked image) and storing it in a storage means (main memory); Taking a second plurality of pictures (after user clicks) in response to activation of the activation means; Displaying on the display means a picture taken upon activation of said activation means and stored in said storage means; At the request of the user, displaying the first and second plurality of pictures on the display means; Providing the user with the ability to select one photo, stored in the storage means, in the first plurality of photos (preview image) or the second plurality of photos (post view image); And if the user selects one picture stored in the storage means from the first or second plurality of pictures, storing the selected picture in the storage means.

The user can experience the operation of the camera as follows: When the viewfinder is activated, he / she turns the camera on, for example by activating a button that activates the camera's function, and the camera is at full resolution. A predetermined number of photos, i.e., preview images, having at < RTI ID = 0.0 > This is preferably circular buffer memory so that each time the buffer memory is full, the oldest picture in the memory is replaced with the latest picture. By replacing the photo in the buffer memory with a new photo, excessive storage of the storage means can be avoided. Each time the user activates the activation means, for example every time the shutter release button is pressed, a picture corresponding to the user click image is selected and stored in the first storage means. This picture can be shown to the user through the display of the camera, either automatically or at the user's request.

Thus, one of the advantages of this invention is that the user may experience a temporal reversal with respect to the active moment of the active means, and that not only the pictures after the active moment of the active means, but also the previous pictures are stored in the camera and are visible to the user Can be.

The camera can continue to store 25 pictures after the activation of the active means, for example 25 or more, and the circular buffer stores 25 pictures before and 25 active pictures before the activation of the active means, The photographs of the photographed circular buffer correspond to the first plurality of photographs, and the photographs taken after the activation correspond to the second plurality of photographs. The number of first and second plurality of pictures need not be the same. The counter value of the buffer register will contain information about where the indexes will be and which picture corresponds to between the pictures taken before and after the activation of the activation means in the circular buffer. However, a mobile terminal equipped with the camera has the following problems.

1. After a user starts up the camera to perform a picture or video shooting, the user often forgets to take a picture or video and turns off the camera (inadvertently or spontaneously).

2. Mobile terminals have many applications that use cameras, but TAKE PICTURE 'is the only explicit means of storing still images. The user can simultaneously record the last nth still image sequence while using other applications such as Video Telephony (VT), Video Recording, IMS Video Sharing, etc. You may want

3. Mobile terminals have many applications that use cameras, and users often switch between these applications, and when the user switches from one camera application to another, they can continue to record the last n consecutive pictures. none.

4. The user cannot pause and resume continuous still picture recording for a certain time interval while recording the still picture sequence.

If a user suddenly starts capturing still images with the camera, then suddenly a VT call occurs, the user wants to see them later, although the current n recent still images available in the buffer are very important. In the end, VT is forced to run immediately, hoping that it will not be overwritten.

5. The picture available in the current buffer is very important to him, and often there is a desire to review the last n snap pictures available in the buffer and also to store the pictures selected by it.

6. The user does not want the n snapshots currently available in the buffer to be duplicated and often wants to review them later. It is the user's intention to keep the camera application running without stopping the camera or blocking the viewfinder. In addition, the user may want to start a new set of recordings of the last n still picture sequences without interrupting the camera's viewfinder.

7. You may want to start previewing with the camera and after a while, say a few minutes, you want to take a picture as needed. Unfortunately, if the battery does not have enough power at that moment, the captured moment Even if it is displayed on the viewfinder, a low battery power can cause the photography application to hang, preventing the user from taking a picture.

8. After the user starts previewing with the camera, he can select a multi-shot option to take the next m snapshots. However, conventionally, the user may miss the exact moment of starting the multi-shot, and thus may not be able to get the exact snapshot he wants.

9. The user initialized the camera with an application such as IMS VideoSharing, Video Telphony, Video Recording, and at the same time the user took n snapshots currently available in the buffer. When you want to save for any time you want, you cannot get the last n still pictures.

In mobile terminals, there are many applications that use a camera, but only take picture is the only means of taking a picture explicitly.

In order to solve the above problems, the present invention proposes a new application, a magic moment application, in which the camera device is used by any application such as photographing, video recording / video telphony, and video sharing. When in use, a method and system are provided that allow a user to capture a specific number of still pictures, i.e., the last consecutive n still pictures, with a specific time interval between two still pictures.

In addition, the present invention provides a method and system for driving a magic moment application in the background when an application using a camera is in operation and providing continuous still images whenever required.

And the present invention provides a method and system that can keep capturing still images, even if the user switches from one camera application to another, except for a short duration as needed to automatically switch off / on the camera. do.

The present invention also provides a method and system that can provide a means for dynamically pausing and restarting a continuous recording of a picture to efficiently use the memory and the duration of the last n snapshots. It also allows the user to stay in the past for a longer time.

In addition, the present invention can capture some moments in the form of the last n still images during all the environments in which the camera is active, and the user can continuously capture the last n consecutive times from that moment at any moment during the entire period in which the camera is active. A method and system for obtaining a still image are provided. The present invention further allows a user to store the latest n snapshots at a particular point in time and store another set of the latest n snapshots based on the next point in time without interruption of the camera as long as the camera is on. It provides a method and system that may be possible at several points in time.

The present invention also provides a method and system that allows a user to dynamically change the time interval between snapshots and the number of snapshots to be stored, depending on the situation.

The present invention also provides a method and system that allows a user to not miss any important event while the camera is active. When the camera is active, it means that the user can see everything the camera is showing on the display screen.

In order to achieve the above object, the present invention provides a photographing apparatus for continuously capturing and temporarily storing a predetermined number of still images at a predetermined time interval, and in a state where all of the predetermined number of still images are stored. When storing the still image, at the time of storage, the predetermined number of the most recent still images are temporarily stored in real time, including the step of discarding the oldest still image and temporarily storing the new still image.

The present invention stops the continuous storage of the still picture when there is a pause request, and resumes the continuous storage of the still picture when there is a restart request.

When the freeze shooting request is made, the present invention normally stores the predetermined number of still images currently temporarily stored, and after the normal storage, continuously photographs the predetermined number of new still images at the predetermined time interval to be temporarily stored. Save it.

According to the present invention, the automatic image management apparatus in the photographing apparatus continuously photographs and temporarily stores a predetermined number of still images at a predetermined time interval, and creates a new still image in a state where all of the predetermined number of still images are stored. In the case of storing, the control unit discards the oldest still image at the time of storing and temporarily stores the new still image, and temporarily stores the predetermined number of the most recent still images in real time, and a predetermined number under the control of the control unit. And a buffer for temporarily storing still images.

The present invention provides a magic moment application that automatically manages the image and has a mechanism to buffer the last frame captured by the camera.

The magic moment application according to the present invention may photograph a subject at predetermined time intervals, temporarily store the subject as a continuous predetermined number of still images, and store a predetermined number of still images currently temporarily stored according to a final storage request. The Magic Moment application provides the latest n consecutive camera frames at any time as still pictures with a time interval of t between two neighboring still pictures. The format of the still picture, the number n of frames and the time interval t between the two pictures can be set by the user. The time interval t is a time interval between the photographing time points (or capture time points) of two neighboring still pictures that are consecutively photographed, and are not camera capture or preview speeds.

The present invention relates to a method and system for automatic image management of a photographing apparatus, wherein n frames are dynamically recorded and stored as still images in a buffer, the still images having a time interval t between any adjacent still images; And at some point when the device receives a new frame, the oldest frame stored in the buffer is discarded and replaced by the received new frame.

The photographing apparatus dynamically pauses recording of the frames and dynamically resumes recording of the photographing frames. The imaging device then freezes the last n frames at any particular point in time for review and storage, and starts recording the new last n still picture sequences without interruption of the camera / viewfinder. The photographing apparatus maintains the buffer in which the last n consecutive still images are stored when the user switches to another camera application. The method further includes encoding the still pictures according to a user's setting value. The number n of frames and the shooting time interval t between the two images can be set. In order to view the contents, the imaging device at the moment makes the total number of frames n + 1, in the buffer, in addition to the frames included by the user, the last n stops Provide images. The size of the buffer can be changed dynamically. The contents of the buffer can be freeze taken and stored by the user at any moment, and a new buffer having a new set of n still images can be created. At some point thereafter, the user can view the current contents of the buffer along with the contents of the previously freeze taken buffer during the last freeze shooting operation. The user can select every frame or subset of frames shown while the buffer contents are being viewed. Capture frames are compressed by the imaging device prior to being stored in the reservoir. The user can set the start and stop of the option to automatically manage the image according to the magic moment application for a certain period when any other image application is active. The user can select a plurality of picture formats for storing the frames. By capturing m frames, the user can obtain the last n frames previously stored in the buffer before the multishot and the next m frames generated by the multishot, and the user can select the desired frame. The multishot option of the imaging device, which provides n + m frames, may be activated. When the photographing function of the device ends, the photographing device provides the last n still images stored in the buffer together with the previously stored still images.

The invention also describes an automatic image management system in a photographing apparatus, the system comprising: (a) means for storing n frames; (b) means for controlling activation and deactivation of the image management and capture of the frames; (c) means for providing a user input: and (d) an image processing portion for processing the captured images.

The control means captures the frames provided by the camera processor after a regular time interval t. The picture encoder encodes the capture frame into a still picture format set by the user. The photographing apparatus comprises means for dynamically pausing, pausing and restarting recording of frames. The photographing apparatus comprises means for freezing photographing and selecting the last n frames at any particular time instant for later review and storage. The imaging device comprises means for compressing the capture frames. It also captures m frames, allowing the user to get the most recent n frames stored in the buffer prior to multishot and m frames by multishot, and provide n + m frames for the user to select Capture means.

Although the user has initialized the camera application to perform shooting operations, video recording, and the like, often the user forgets to take a photo or video recording and closes the camera (by chance or spontaneously). However, at any moment of time during all of the environments in which the camera is on, the user can obtain the latest n still images continuously because the Magic Moment application continuously records the last n still images. And if you are recording a particular event and later think that recording of that event is less important, or you find that the recorded video occupies more memory and runs out of memory, the Magic Moment application instead of the entire video. You can use it to replace successive snapshots, and save video while saving successive snapshots of the same event. These stored snapshots may be sent to other parties instead of video.

 There are many cases where a user is performing video telphony, IMS video sharing, and the like, and wants to store a still image sequence of the same. The Magic Moment application allows a certain number of still images to be spaced between two neighboring still images when the camera device is in use by any application, such as taking pictures, video recording / video telphony, video sharing, etc. By capturing, it is possible to provide the user with the last n still images. The Magic Moment application can also keep capturing the last n still images continuously even when other camera applications on the imaging device are switched. By providing the option of pausing and resuming successive image captures, the memory usage can be made efficient. If the user has started capturing still images continuously with the camera device, suddenly a VT call occurs. However, the user thinks that the current n recent still pictures in the buffer are very important and wants to review them later, so that they want to immediately conduct a VT call without overwriting them. In such a situation, the user can simply stop the Magic Moment application and continue to capture still pictures continuously after the call ends, or review the pictures available in the buffer before the VT call.

The Magic Moment application allows the user to freeze / select the last n snapshots at any particular moment in time for free review and store them in volatile memory, or without breaking persistence, i.e. the camera is on. As long as it is in the (on) state, it can be stored permanently in nonvolatile memory such as flash, ROM, etc. without blocking the viewfinder / viewfinder and continuing to create a new set of the latest n snapshots. do. That is to say, for example, every time a user is watching a football match and thinks it is important while watching, freeze-up recent n snapshots for later review and store them in volatile memory, or break the persistence of the camera's viewfinder. Permanently store in non-volatile memory such as flash, ROM, etc.

Occasionally, a user may want to review the last n snapshots available in the buffer because the still images available in the current buffer are very important and also want to save for the images he has selected (not intended for photography). Note). The user suddenly witnessed the event of interest and immediately shot it with the camera. Fortunately, the event is in the viewfinder, but unfortunately the event that the user wants to capture has disappeared before the shooting operation commences. . Some time after the user starts previewing with the camera, say a few minutes later, I want to shoot with the idea that this is the moment, but unfortunately, if the battery suddenly drops at that moment, the shooting application closes and captures the Even if the moment is in the viewfinder, you will not be able to take pictures due to low battery. However, since the Magic Moment application provides the latest n still images, it is possible to obtain snapshots of those moments.

Although the user starts previewing and takes a picture with the camera, for some reason, such as improper focusing, subject movement, camera shake, etc., the user may not be able to get a good or high quality picture or be unsatisfied with the picture. This is impossible to turn back in time, so the user misses an important and precious moment. However, since the Magic Moment application provides the latest n still images in addition to snapshots taken by the user, the user can obtain images of the missed event. The magic moment application can also be considered multi-shot in past, which allows to obtain the best picture from multiple.

After the user starts previewing with the camera, the camera can shoot when the obstacle is in front of the camera sensor. Since only this user will not get a suitable image, in some cases later snapshots of those moments may be needed. However, it is not possible to revert back in time, so the user misses an important and precious moment. However, since the Magic Moment application provides the latest n still images in addition to the snapshots taken by the user, the user can get images of the missed event and select the best one among the multiple photos. It is possible.

The user may begin to preview with the intention of taking a picture and then forget to shoot or miss the moment of shooting. In some cases, however, snapshots of the moment may be required later. It is not possible to turn back in time, so the user misses important and valuable moments. However, since the Magic Moment application provides the latest n still images at any point in time, it is possible to preview images with the camera at any time and then get the missed images while not actually shooting. It is possible to obtain the latest n still images at any time at various times as long as the camera is on or if the camera is on.

After the user starts previewing with the camera, the user can select the multishot option to take the next m snapshots. The user may miss the exact moment to start multishot capturing, which may result in not getting the exact picture he wants. The Magic Moment application will automatically be disabled during multishot and will work after multishot. Because of this, the user will get the last n snapshots before the multishot and the m snapshots after the multishot. It is possible for the user to get the pictures of the missed event and then select the best picture from the n + m snapshots.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. It is to be understood that the disclosed embodiments are merely illustrative of the invention and can be embodied in various forms. The following detailed description and drawings are not intended to be limiting, and numerous specific details are based on the claims, and also to teach those skilled in the art how and how to make and use the present invention. It is provided for a thorough understanding of the. In some cases, however, known or existing details may not be described in detail in order not to unnecessarily obscure the present invention.

Although the user has started the camera application to perform photo shooting operations, video recording, and the like, it is often the case that the camera is closed (by chance or spontaneously) forgotten to take a photo or video recording. However, since the present invention continuously records the most recent n still images according to the Magic Moments application at a moment in time during all the environments in which the camera is on, the user has Continuous still images can be obtained.

Mobile terminals have many applications that use cameras, but only take pictures using shutters or the like have been an explicit means of storing still images.

And when a user has recorded a particular event as a video, he may find that later recording of that event is less important, or that the recorded video occupies a lot of memory, and that the memory is insufficient. As such, the user often wants to be able to take some snapshots from the event, which is sufficient for the entire video. In this case, conventionally, the user has to edit the video into small clips or extract an image, which is a cumbersome activity.

There are also many cases where a user is interested in recording a long event as a video, and at the same time wants to continuously capture still images of the same event. And the user can send at least some still pictures (video is long and difficult to transmit over the network) to his friends via a messaging service, for example EMS / MMS. There are many cases where a user is performing video telphony, IMS video sharing, etc., and wants to store successive still images of the same.

Magic Moment application according to the present invention is to meet the needs of the above users, when the camera device is in use by applications such as photography, video recording / video telphony, video sharing, etc. Provide a specific number of consecutive still pictures, captured at specific time intervals between the pictures.

When a mobile terminal is equipped with a camera, many camera applications are also provided, and the user often changes camera applications, when the last n consecutive still images are desired to be recorded even when switching from one camera application to another. There is. The Magic Moment application does not have a buffer (which consists of the last n consecutive still images), except for the short duration required for the camera to switch off / on automatically even if the user switches from one camera application to another. By keeping it as it is, it manages to continue capturing a still image.

The user has started the camera with the intention of taking a picture and switches to a video recording application in the hope that future video recording should be done, but keeps the last n snapshots stored in the buffer, i.e. still images, and records the video. You may want to keep the same buffer state for a while.

The Magic Moment application provides a means of pause and resume for continuous recording of photos for dynamic and efficient use of memory and time intervals of the last n snapshots. This allows the user to stay in the past using less memory.

After the user has started the camera application and thinks that the snapshots available in the current buffer are some time more meaningful / important than the frames to be taken in the future, or after recording the last n meaningful frames, You may think that you are not interested in saving. This is because there is a possibility that frames to be photographed later may be stored overlapping with existing frames in the buffer, or may occupy space in the buffer unnecessarily. In this situation, giving the user the ability to pause and resume helps to avoid storing unwanted camera frames in the buffer. This advantage is that the user can stay in the past in time for a longer duration. Substantially duplicated snapshots, i.e. still images, are not stored in the buffer, whereby the existing memory is efficiently used by the user himself.

Because mobile terminals have many applications that use cameras, users often switch from one camera application to another. For example, the user has started capturing still images continuously with the camera, and suddenly a VT call occurs. However, the user thinks that the n still pictures currently stored in the buffer are very important and wants to review them later, so that the VT communication is performed immediately without overwriting the still pictures. In such a situation, the user can simply stop the Magic Moment application and continue to capture still pictures continuously after the call ends, or review the available pictures that were stored in the buffer before the VT call.

The Magic Moment application freezes / selects the user to freeze / select the latest n snapshots corresponding to any particular moment and store them in volatile memory, without breaking persistence. That is, as long as the camera is on, it is stored permanently in non-volatile memory such as flash, ROM, etc. without blocking the viewfinder or stopping the viewfinder, and the last n still Mars, It allows you to continue a new set of snapshots.

For example, whenever you are watching a football game and think it's important while watching it, freeze shots for later review and store the last n snapshots currently stored in the buffer in volatile memory, It is stored permanently in non-volatile memory such as flash, ROM, etc. (which is available in the buffer until that point) without breaking, and then continues to generate a new set of the latest n still images of n pictures.

Occasionally, a user may wish to review snapshots of the last n still images stored in the buffer, as well as the still images stored and available in the current buffer, and also want to save them for the selected images. Note that this is not the intention of photography.

In addition, the user suddenly witnessed an event of interest and was immediately photographed with a camera, and fortunately the event was on the viewfinder, but unfortunately the event the user wanted to capture may disappear before starting the shooting operation. This is when the user sees the event in the viewfinder but the moment disappears before the button is pressed to take a picture.

Some time after the user starts previewing with the camera, say a few minutes later, I want to shoot at this very moment, but unfortunately, if the battery suddenly drops at that moment, the shooting application closes and captures Even if the moment is on the viewfinder, due to battery depletion, the picture taking fails. The Magic Moment application provides a mechanism to buffer the last frame captured by the camera at the time the shooting application terminates. This means that the frame required to be captured is on the viewfinder, but before the user starts shooting, the application accidentally terminates, or the camera application terminates automatically, for example, due to low battery, or a key to start shooting. Instead of activating it, to prevent users from accidentally pressing the key to exit the camera application, or to quit spontaneously, by adding to the last n frames, it was captured by the camera the moment the camera application ended. Causes the last frame to be buffered. Thus, the user can easily use not only the last n still images, but also the last image captured by the camera at the time when the application accidentally terminates.

Although the user starts previewing and takes a picture with the camera, for some reason, such as improper focusing, subject movement, camera shake, etc., the user may not be able to get a good or high quality picture or be unsatisfied with the picture. This is impossible to turn back in time, so the user misses an important and precious moment. However, since the Magic Moment application provides the latest n still images in addition to the snapshots taken by the user, the user can get images of the missed event, followed by n + 1 (last n still images + user). It is possible to select the best picture from the snapshots of the image). The magic moment application can also be considered multi-shot in past, which allows to obtain the best picture from multiple.

After the user starts previewing with the camera, the camera can shoot when the obstacle is in front of the camera sensor. The obstacle may be in the form of a person / object appearing in front of the camera by chance, or the photographer's finger may be in front of the camera.

Since this user will not obtain a suitable image, it may be conceivable that in some cases later snapshots of those moments should have been taken at least as a memorial mark. However, it is not possible to revert back in time, so the user misses an important and precious moment. However, since the Magic Moment application provides n still images in addition to snapshots taken by the user, the user can get images of missed events, followed by n + 1 (last n still images + It is possible to select the best picture from the snapshots of the picture) normally taken by the user.

The user may begin to preview with the intention of taking a picture and then forget to shoot or miss the moment of shooting. In some cases, however, you might think later that snapshots of those moments should have been taken at least as a souvenir. It is not possible to turn back in time, so the user misses important and valuable moments. However, since the Magic Moment application provides the latest n still images at any point in time, it is possible to preview images with the camera at any time and then get the missed images while not actually shooting. As long as the camera is on and when the camera is on, it is possible to obtain the latest n still images based on several viewpoints.

After the user starts previewing with the camera, the user can select the multishot option to take the next m snapshots. The user may miss the exact moment to start multishot capturing, which may result in not getting the exact picture he wants. The magic moment application is automatically disabled during multishot and will be enabled after multishot. Because of this, the user will get the last n still pictures created before the multishot (before the multishot) and the m snapshots after the multishot. This allows the user to select the best picture from n + m snapshots (m multishot snapshots + the last n still images before multishot).

The number n of still images temporarily stored in the buffer by the magic moment application and the time interval t at which the n still images are taken or captured are settable / programmable by the user.

The Magic Moment application does not change or change the camera frame per second set by the program using the camera, ie the shutter speed associated with normal shooting. The shutter speeds operate independently at time intervals set by the user, and the imaging device captures frames from the camera during this time interval and encodes the frames in a format specified by the user. This places a limitation on the shooting time interval of snapshots by the Magic Moment application, which must be equal to or greater than the camera capture duration.

It is possible to obtain the latest n still images in any application using the camera.

The user can get the latest n still images until the user closes the camera or the application using the camera and can view them even when the camera is on or after closing the camera application.

Each time the user shoots, the Magic Moment application provides the latest n still images, i.e., the last n snapshots, along with the snapshot taken by the user. The user can save any / all snapshots as desired.

In all cases, the user can save or delete any or all snapshots provided by the Magic Moment application.

There is an option to enable / disable the Magic Moment application.

The Magic Moment application is an application that makes it easy to use the latest n camera frames as still images (snapshots). The user can select image formats such as JPEG, JPEG2000, MrSID, PNG, SPIFF, SVG, TGA, TIFF, GIF, DNG, CPC as their own choice. This concept can be extended to any picture format if codec support is available. During recording time, the obtained camera frames are compressed and stored in a buffer.

The following is required for the implementation of the present invention.

A mobile terminal or any portable device or personal computer having a camera function;

Software / hardware that encodes camera frames in a format specified by the user.

Controls to control the application and meet real-time control

Display device

1 shows an image pickup device configuration, such as, for example, a portable device having a camera function, according to one embodiment of the present invention. Referring to FIG. 1, a photographing apparatus according to an exemplary embodiment may include a magic moment controller 10, a camera processor 20, a camera sensor 30, a display unit 40, an image encoder 50, and an image processor. 60, a buffer 70, a user interface 80, and a memory unit (not shown).

The magic moment control unit 10 stores the recent n snapshots in the buffer 70, where the buffer 70 uses a volatile memory such as RAM. This buffer 70 is different from the buffer used for photography / multishot applications. The buffer 70 is maintained in a cyclic manner such as a first-in first-out (FIFO).

Whenever any application that uses the camera, such as Video Telephony / Video Sharing / Video Recording / Take Picture, is running (camera on), the Magic Moment Control ( 10) checks the enabled / disabled state of the Magic Moment application. If the magic moment application is in the operable state, according to the time interval t set by the user, the magic moment control unit 10 captures the frame provided by the camera processing unit 20 after the regular time interval t.

The magic moment control unit 10 supported by the image encoder 50 encodes a frame captured in the still picture format set by the user through the image encoder 50, and displays the encoded frame as a magic moment circular buffer (as shown). circular buffer (70). This encoding is not essential and can be set adaptively based on performance or memory utilization. If better performance is required, encoding can be skipped; if better memory utilization is required, encoding is required. This may vary depending on the time interval t set by the user.

Initially, the magic moment controller 10 stores the first n encoded frames in the buffer 70 and then replaces the received frame with discarding the oldest frame at any point in time whenever it receives the encoded frame. Therefore, the Magic Moment application always stores the most recent n frames at any point in time and the latest n frames are updated after a user-set time interval t. And if the user wants to see the last n frames, the magic moment control unit 10 displays the n frames available in the circular buffer 70 on the display unit 40 in the required format at any point in time.

The user is provided with a user input setting, i.e., the user interface 80, i.e., a suitable means for dynamically changing the number n of snapshots that are still images buffered and the time interval t between the time points at which the two snapshots are taken. Based on this information, the Magic Moment application dynamically readjusts the buffer 70 size and duration. There may be limitations on these settings depending on hardware / memory resources or the resolution of the captured image. Therefore, there is a mechanism for checking whether the number of snapshots and the time interval between two snapshots are ideal. For example, consider a camera XYZ with a performance of 5 frames per second (FPS). If the user sets the number of recent snapshots of the Magic Moment application to 15, the time interval t is 400 milliseconds. The user can increase or decrease the time interval t step by step, for example, by 100 milliseconds, by pressing a key. It is not allowed to change the time interval t to 100 milliseconds by entering the hotkey three times in order to reduce the time interval t, which is allowed within 200 milliseconds at once with a 5 FPS camera. One frame can be obtained, so the minimum time interval t possible with such camera XYZ is 200 milliseconds. The same applies to the number of snapshots, which depends on the capacity of the volatile memory including the buffer 70.

When the user shoots using the camera application, the magic moment control unit 10 temporarily deactivates the magic moment application for such a time, and activates after taking a picture. The user is provided with a suitable means for displaying the current snapshot taken by the user and the last n frames captured by the Magic Moment application prior to the current snapshot, for example the user interface 80 and the display 40. . The user can select all available snapshots stored in the buffer 70 or a subset of snapshots, in addition to the current snapshot taken by the user. Similarly, when the user shoots using the multi-shot function of the camera application, the magic moment control unit 10 temporarily deactivates the magic moment application during that time and activates after the multi-shot has elapsed. This makes it possible to provide m snapshots taken by the user during the multishot and the last n frames captured by the Magic Moment application before the multishot begins. Due to the deactivation of the Magic Moment application during the shooting scenarios for single shots and multi-shots (serial capture), the performance and original functions of the shooting scenarios are not affected and the user can shoot as well as the actual snapshots taken by the user. Get the last n snapshots just before. A suitable means for viewing m snapshots taken by the user via multishot and the last n frames captured by the Magic Moment application prior to multishot activation is provided to the user. The user can select all snapshots or a subset of snapshots available in the buffer 70, in addition to the multishot snapshots taken by the user. According to the image format set by the user, the magic moment control unit 10 provides the last n snapshots in the required format whenever the user wants. In the mobile platform, the user switches from one camera application to another camera application, and the magic moment control unit 10 processes to preserve the buffer contents without damaging the contents of the buffer 70 during such switching. Suitable means are provided to the user to pause and resume (key press) recording a picture sequence consisting of the last n pictures captured by the Magic Moment application. So whenever the Magic Moment application is stopped by the user, the Magic Moment application sets a sleep state until restarted by the user. The contents of the buffer 70 are not updated during the sleep state. At any point in time, a suitable means of viewing the contents of the buffer 70, such as a particular key, is provided to the user via the user interface 80. If the user wants to view the contents of the buffer 70, that is, the last n snapshots, the buffer 70 is stored in the buffer 70 together with the snapshots normally stored by the user using the Select / Freeze option. The last n snapshots stored temporarily are displayed. The user can select all snapshots or a subset of snapshots shown to him. Suitable means are provided to the user to freeze shoot / select (key press) the contents of the circular buffer 70 at various moments without disturbing the camera viewfinder at any point in time. Each time the user takes a freeze shot, according to the Magic Moment application, the Magic Moment Control Unit 10 will preserve the contents of the buffer 70 by creating a new circular buffer 70 used for capturing additional frames in a FIPO manner. In addition, whenever the user freezes, the contents of the buffer 70 can be stored in the flash memory without disturbing the camera viewfinder, and made available to the user for later review whenever required. In the description of the present invention, for the sake of understanding, the expression temporary storage is defined as a still image stored in the buffer 70, and the expression normal storage means that the still image stored in the buffer 70 is stored differently according to freeze shooting. It is defined as being stored in a medium, for example, a flash memory.

The user's input for the Magic Moment application is the number n of recent snapshots and the time interval t (the interval between two snapshots). The number n of recent snapshots can have any value but is limited by the resolution of the photo and the capacity of available volatile memory. The unit of time interval t may be milliseconds and is limited according to the camera FPS.

An operation process according to an embodiment of the present invention of the photographing apparatus configured as described above will be described with reference to FIGS. 2A and 2B. In step 101, the magic moment controller 10 drives the camera application and proceeds to step 103. In step 103, the magic moment controller 10 checks whether the camera is in an on state and proceeds to step 107 if the camera is in an on state. If not, the magic moment controller 10 deactivates the magic moment application in step 107 and proceeds to step 103. In step 107, if the magic moment application is active, the magic moment controller 10 proceeds to step 109 to check the number of buffer frames n, the time interval t, and the image format, and initializes the process. In step 111, the magic moment controller 10 updates and checks the number of snapshots n and the time interval t according to a user input, and proceeds to step 113. In step 113, when the time interval t elapses, the magic moment control unit 10 determines whether to capture a still image and store it in the buffer 70 according to the magic moment application. That is, in step 115, the magic moment controller 10 checks whether the pause is activated. If the pause is activated, go to step 117 to set the standby state. Thereafter, the process detects the restart input from the user and proceeds to step 111. Meanwhile, if the pause is not activated, the magic moment controller 10 checks whether the camera mode is the single shot mode or the multi-shot mode in step 119. That is, if one of the two modes is activated, the standby state is maintained without storing the camera frame in the buffer 70. However, if the current mode is not the single shot mode or the multi-shot mode, the magic moment controller 10 proceeds to step 121 and encodes the camera frame in the set image format, stores it in the buffer 70, and proceeds to A. Then, in step 123, the magic moment control unit 10 checks whether there is freeze shooting, and in step 125, stops storing to the buffer 70 and copies n snapshots of the current buffer 70 to the flash memory, After creating a new buffer, proceed to step 127. On the other hand, if there is no freeze shooting, the magic moment control unit 10 checks whether the number of frames stored in the current buffer is less than n in step 127 and proceeds to step 129 in step 129 to store the encoded frame in a circular buffer and proceeds to B. Proceed to step 111 above. If the number of frames stored in the current buffer is not less than n, the magic moment controller 10 proceeds to step 131 and discards the oldest frame among the frames stored in the buffer 70 and replaces it with the most recently encoded frame. Thereafter, in step 133, when the camera is turned off, the magic moment controller 10 proceeds to step 135 to end the magic moment application. Hereinafter, some embodiments of the present invention will be described with reference to FIGS. 3 to 6.

Assume that the user sets the time interval between two neighboring snapshots, t, stored in the time interval buffer 70 to 1 second, and sets the number n of recent snapshots to be stored according to the magic moment application to 2. Referring to Fig. 3, with this setting, if the user presses a key for a single shot in 4 seconds in step 201, the user can add a snapshot taken in 2 seconds, in 3 seconds, in addition to a snapshot taken in 4 seconds. Snapshots taken are readily available. In the Magic Moment application, the user does not need to shoot, and can review the contents of the buffer 70 at any moment (via a hotkey), in this scenario if the user has a buffer 70 at 15 seconds as in step 203. If one intends to view the contents of (view), images taken in 15 seconds and 14 seconds can be obtained.

Assume that the user sets the time interval (the time interval between two snapshots) t to 1 second and the number n of the latest snapshots to be captured is set to 2. Referring to Fig. 4, with this setting, the user requests selection / freeze shooting at the beginning of step 4 in step 205, and the user is interested in reviewing the contents of the buffer 70 at a later time with the magic moment control unit 10. Can be indicated. This operation preserves the contents of the buffer 70, i.e., images taken in 3 and 4 seconds for later review. As shown in FIG. 4, the user requests a single shot of the picture in 15 seconds in step 207. FIG. Then, as well as the third snapshot and the fourth snapshot, the thirteenth, fourteenth and fifteenth snapshots can be easily used. The main advantage here is that overwriting of the buffer contents is avoided whenever the user is interested in the contents of the buffer 70 at a particular moment.

The Magic Moment application provides a pause and restart feature, with the aid of which the user can keep the buffer 70 intact by not overwriting it whenever the camera sees something less important. Thus, the magic moment application allows the user to efficiently use the buffer 70.

The imaging device has many camera applications that use the camera, and users often switch between these camera applications to take a picture. For example, assuming that the user has set the number n of the recent still images to 10 and the time interval t to 1 second, the operation when switching camera applications will be described with reference to FIG. Referring to FIG. 5, after the user starts the camera preview application with the intention of storing the latest n frames in step 211, a user may receive a VT call to join in step 213. However, the user thinks that the contents of the buffer 70 prior to the VT call (last n frames) are important to him, thereby overwriting the contents of the buffer 70 with what the camera sees during the VT call. May also be desired, and may also want to leave the buffer 70 for a short interval of transition from the camera preview application to the VT application. In such a case, the user may stop the magic moment application in step 215 and perform the VT call in step 217. At this time, since the magic moment application is stopped, it is guaranteed that the camera viewfinder is not stored in the buffer 70 at the VT call time, and when the VT call is terminated in step 219, the user may enter into step 221. Likewise, you will want to switch back to the camera preview application. Then, the user can restart the Magic Moment application in step 223, and the contents of the buffer 70 at 1 second, 1 second, 2 seconds, 3 seconds, 4 seconds, 16 seconds, 17 seconds, 18 seconds, 19 seconds, 20 seconds. , Still images recorded in 21 seconds. This allows the buffer 70 to be used in an efficient manner, thereby allowing the user to stay in time for a longer duration.

It is assumed that the user has set the time interval (time interval between two snapshots) t to 1 second and the number n of the recent snapshots is set to 2, which will be described with reference to FIG. The user starts the camera application in step 231 with the intention of shooting to activate the camera preview application. Now after a few seconds the user receives the VT call. However, at this point, the user is interested in the contents of the buffer 70 in step 233, 5 seconds, and applies the freeze shooting option. That is, a request is made to preserve the contents of the buffer 70 for later review. In step 235, the VT call is started, and in step 237, the VT call is activated. During the VT call, the user is interested in the contents of the buffer 70 at 9 seconds (as shown in the figure) in step 239 and requests freeze shooting. Accordingly, the photographing apparatus preserves the contents of the buffer 70 for later review. Thereafter, at step 241 the user is not interested in storing the still picture sequence by the magic moment application during the VT call from 10 seconds (as shown), so the user stops the magic moment application at step 241. After the VT call is activated in step 243, the camera preview application is restarted in step 245, and the user wants to view the contents of the buffer 70 in 20 seconds as in step 249 by restarting the Magic Moment application in step 247. . At this time, the user obtains snapshots recorded in 4 seconds, 5 seconds, 8 seconds, 9 seconds, 19 seconds and 20 seconds.

The scenarios described above describe how the freeze shooting, pause / resume and view options provided by the Magic Moment application can be used. Using the freeze shooting option, the user can get snapshots recorded at the desired time, keeping in mind that the user quickly switched from one camera application to another, but still recorded snapshots were retained later in time. .

A key set that realizes freeze shooting, pause, restart, and view options is suitably given to the user, which is included in the user interface 80. Dynamically, the time interval t (time interval between two snapshots) and the number n of snapshots can be incremented or decremented by a keypress.

When you want to see the contents of the buffer 70, using the selection / freeze shooting option, the latest n snapshots are shown to the user, along with the snapshots stored according to the normal shooting. The user can select all snapshots or portions of snapshots shown to him by navigating the contents.

If the user closes the camera application accidentally or spontaneously, the user sees the latest n snapshots in addition to the snapshots captured by the camera, and also the snapshots he preserved using the Select / Freeze shooting option. Shown. The user can select all snapshots or portions of snapshots shown to him by navigating the contents.

Regarding Magic Moment applications, battery degradation should be interpreted in the following manner. In a mobile terminal having a photographing apparatus according to the present invention, a higher battery power is required for driving a multimedia application related to a camera. Therefore, if a sufficient battery is not available, the application normally closes automatically. This does not mean that the mobile terminal may not be used for other purposes such as call list view, alarm setting and the like. The user is provided with a mechanism to store the contents of the buffer 70 as in the scenario described above.

Since the Magic Moment application runs in the background, the short duration of when the camera needs to switch off and on automatically by keeping the last stored buffer 70 of the last n pictures intact. Except, the Magic Moment application is activated throughout the other camera application is active.

In the Magic Moment application, it is possible to continuously / quickly freeze shooting / viewing options, and the numbering of snapshots is processed according to the time of freezing shooting / selection. The number of freeze shooting operations depends on the available memory in the system.

There is an option to get the latest n pictures as a slide show. The recent n snapshots are optimal for slideshows if they are sequential and will have a good effect so that the user feels a continuous effect.

Suitable means of mechanism for inactivating / operating the magic moment application are provided via the user interface. The user can set the start and stop times to enable these options.

The magic moment application can be summarized as follows. This new application allows the user to have a certain number of still images and a certain time interval between two still images when the camera device is in use by any application such as taking a picture, video recording / video telphony, video sharing, etc. It is possible to capture a series of recent n still images. The Magic Moment application runs backwards when an application using such a camera is running and provides continuous still images whenever required. The Magic Moment application also continues to capture images even if the user switches from one camera application to another, except for a short duration when the camera needs to be switched off / on automatically. The Magic Moment application provides an efficient use of the memory and the duration of the last n snapshots and a means to dynamically pause and resume the continuous recording of the photos. It also allows the user to stay in the past for longer durations with less memory. The idea behind the Magic Moment application is to capture some moments in the form of the most recent n still images during all environments in which the camera is active, and the user is able to capture the last n consecutive stills at any moment during the entire period of time the camera is active. Images can be obtained. It allows the user to freeze at any moment of the last n snapshots and proceed to the next set of the latest n snapshots, without interruption of the camera viewfinder. It allows the user to dynamically change the duration and number of snapshots between snapshots according to the situation / user's wishes.

It will be apparent to those skilled in the art that other control methods may be derived from the combination of various methods and apparatuses of the present invention taught by the description and the appended drawings, and therefore they should also be considered within the scope of the present invention. Moreover, such combinations and variations are thus omitted above. It should be noted that the host for storing the magic moment application includes, but is not limited to, a microchip, microprocessor, portable communication device, computer, rendering device or multi-function device.

Although the present invention has been described in its entirety with reference to the accompanying drawings, with reference to the preferred embodiments, it is noted that various changes and modifications are possible and will be apparent to those skilled in the art. Such changes and modifications are to be understood as included within the scope of the invention as defined by the appended claims unless they depart therefrom.

1 is a view showing the configuration of a photographing apparatus according to an embodiment of the present invention;

2 is a view showing a process of the operation of the photographing apparatus according to an embodiment of the present invention;

3 to 6 illustrate an operation scenario according to an embodiment of the present invention.

Claims (24)

In the automatic image management method in the photographing apparatus, Taking a predetermined number of still images continuously at predetermined time intervals and temporarily storing them; When temporarily storing a new still image in a state where all of the predetermined number of still images are temporarily stored, at the time of storing, discarding the oldest still image and temporarily storing the new still image; Stopping the continuous temporary storage of the still image when the new camera application is activated while the current camera application is active, and restarting the continuous temporary storage of the still image when the new camera application is terminated; When the current camera application is terminated, normally storing still images temporarily stored until the termination time point, And maintaining a temporary storage state of the still images temporarily stored until the new camera application is activated until the new camera application is terminated. The automatic image management method according to claim 1, further comprising the step of stopping the continuous storage of the still image when there is a pause request. The automatic image management method according to claim 2, further comprising restarting the continuous storage of the still image when a restart request is made. The automatic image management method according to claim 1, further comprising: normally storing the predetermined number of still images currently temporarily stored when a photographing request is requested. The automatic image management method according to claim 4, further comprising, after the normal storage, continuously capturing and temporarily storing the predetermined number of new still images at the predetermined time interval. The automatic image management method according to claim 1, wherein the temporary stored still images are maintained as they are even when switching between camera applications. The method of claim 1, further comprising encoding the still pictures according to a predetermined picture format by a user. The automatic image management method of claim 1, further comprising: setting the predetermined number and the predetermined time interval according to a user input. The automatic image management method of claim 1, further comprising displaying still images that are temporarily stored before the time when the display request occurs. The automatic image management method according to claim 1, wherein the total capacity of the temporarily stored still image is dynamically changed according to a user setting. The automatic image of claim 5, further comprising displaying all still images temporarily stored before the time at which the display request occurs, and all still images normally stored according to the shooting request. How to manage. The method of claim 11, further comprising selecting some or all of the temporarily stored still images displayed in response to the display request according to a user input. 5. The automatic image management method according to claim 4, wherein the temporarily stored predetermined number of still images is compressed and stored normally. delete The automatic image management method according to claim 1, further comprising setting a stored image format of the still image according to a user input. The method of claim 1, further comprising: capturing a plurality of still images according to the multi-capture setting when there is a multi-capture request; Providing a user with a plurality of still images photographed according to the multi-photographing setting and the predetermined number of still images temporarily stored before a time point at which the multi-photographing request occurs. The automatic image management method according to claim 1, further comprising: normally storing the predetermined number of still images previously stored temporarily at the time when the photographing request occurs, when the photographing termination request is made. In the automatic image management apparatus in the photographing apparatus, When a predetermined number of still images are continuously taken at predetermined time intervals and temporarily stored, and a new still image is stored while all of the predetermined number of still images are stored, the oldest still image is discarded at the storing time. And temporarily storing the new still image to temporarily store the predetermined number of the most recent still images in real time, and when the new camera application is activated while the current camera application in which the temporary storage is made is activated. Stops the continuous temporary storage, restarts the continuous temporary storage of the still image when the new camera application terminates, and restores the temporary storage state of the still images temporarily stored until the new camera application is activated. A control unit which maintains until the end of the new camera application and normally stores the still images temporarily stored until the end of the current camera application; And a buffer for temporarily storing a predetermined number of still images under the control of the controller. 19. The automatic image management apparatus according to claim 18, further comprising an image processing unit for processing a still image temporarily stored in the buffer. 19. The automatic picture management apparatus according to claim 18, further comprising a picture encoder for encoding a still picture stored in the buffer into a still picture format set by a user. 19. The automatic image management apparatus according to claim 18, wherein the controller stops the continuous storage of the still image when there is a pause request, and restarts the continuous storage of the still image when there is a restart request. . 19. The automatic image management apparatus according to claim 18, wherein the controller normally stores the predetermined number of still images currently temporarily stored in a memory unit when a photographing request is requested. The automatic image management apparatus according to claim 22, comprising means for compressing the temporarily stored still images. 19. The method of claim 18, wherein if there is a controller multi-shooting request, a plurality of still images are taken according to the multi-shooting setting, a plurality of still images taken according to the multi-shooting setting, and before the time point at which the multi-shooting request occurs. And provide the user with the stored predetermined number of still images.

Images