KR20220132785A - Method for storing mood information during the taking pictures and playing thereof - Google Patents

Abstract

Disclosed are a method of storing mood information when taking pictures and a playing method thereof. A method for storing mood information when taking pictures according to the present invention includes the steps of: taking a plurality of pictures according to an input of a user while a dedicated application is running: collecting sound signals through a microphone while the dedicated application is running; generating mood information indicating the mood of a specific date and place when/where the plurality of pictures were taken by analyzing the collected sound signals; and when taking the pictures is completed, storing the plurality of pictures, information about the date and place, and the mood information in a memory.

Description

{Method for storing mood information during the taking pictures and playing thereof}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to photographing and reproduction, and more particularly, to a method and system for storing the surrounding atmosphere when photographing and simultaneously reproducing the atmosphere when photographing.

As the use of smartphones becomes more popular and the role of digital cameras shifts to smartphones, users can take pictures anytime and anywhere to leave memories, but users who want more than just taking pictures that leave specific places and people as they are. Demand is also increasing.

In order to satisfy this demand, a technique for identifying and using information about sound sources being reproduced when taking pictures has been introduced. Specifically, if music is playing when taking a picture with a smartphone, it is a technology to identify and store the corresponding sound source information according to whether the music is played on the smartphone or from the outside.

However, according to the prior art, music must be played at the time the camera shutter is pressed, and it is insufficient to revive the memory of a specific place or specific date.

The present invention is to solve the problems of the prior art as described above, and when a user takes a number of photos at a place visited by the user and later enjoys the photos again, taking a photo that can play back a sound source that can feel the atmosphere of shooting An object of the present invention is to provide a method for storing atmosphere information of a city and a method for reproducing the same.

In order to achieve the above object, according to an embodiment of the present invention, there is provided a method for storing atmosphere information when taking a picture, comprising: taking, by an electronic device, a plurality of pictures according to a user input while a dedicated application is running: collecting a sound signal through a microphone while the dedicated application is running; generating atmosphere information indicating an atmosphere of a specific date and place where the plurality of photos were taken by analyzing the collected sound signals; and storing, in a memory, information on the plurality of pictures taken, the shooting date and place, and the atmosphere information upon completion of the shooting.

The generating of the atmosphere information may include: analyzing the collected sound signals to determine whether to play music; acquiring information about one or more sound sources corresponding to the reproduced music when music is played on a specific date and place where the plurality of photos were taken; selecting representative music from the one or more sound source information; and including information on the selected representative music in the atmosphere information.

The selecting of the representative music may include selecting, as the representative music, music played the most number of times or for the longest time among a plurality of songs played while the plurality of pictures are taken.

The generating of the atmosphere information may include: analyzing the collected sound signals to determine whether to play music; determining a type of noise by analyzing the collected sound signals when music is not played on a specific date and place where the plurality of photos were taken; and including the noise type in the atmosphere information.

The method of storing the atmosphere information at the time of taking the photo may further include: collecting environmental information of a specific date and place where the plurality of photos were taken and adding the collected environment information to the atmosphere information.

According to an embodiment of the present invention, there is provided a method for reproducing an atmosphere when taking a picture, the method comprising: receiving, by an electronic device, a reproduction request for a plurality of pictures taken on a specific date and place from a user; reading the plurality of photos requested to be reproduced and atmosphere information corresponding thereto from a memory; determining sound source information expressing an atmosphere of a date and a place where the plurality of photos were taken by using the atmosphere information; and reproducing the atmosphere together using the sound source information while playing the plurality of photos.

The reproducing of the atmosphere may include: reading information on representative music included in the atmosphere information; determining a reproduction start position of the representative music by using the number of the photographed pictures, a reproduction time of each picture, and sound source information on the representative music; and reproducing the representative music according to the reproduction start position while sequentially reproducing the plurality of photos.

Reproducing the atmosphere may include: reading a noise type included in the atmosphere information; and reproducing the sound source corresponding to the read noise type while reproducing the plurality of photos.

The step of reproducing the atmosphere may include: reading environmental information of a photographing date and place included in the atmosphere information; and reproducing an effect corresponding to the read environment information while reproducing the plurality of photos.

According to the present invention, when a user takes a number of photos at a place visited by the user and later re-views the photos, the user remembers and appreciates the atmosphere at the time of the photo shoot by playing a sound source that allows the user to feel the atmosphere of the shooting place when shooting. can do.

Further, according to the present invention, atmosphere information related to a place where a user took a picture is stored, so that an atmosphere at the time of taking a picture can be more accurately reproduced.

1 is a diagram for explaining a network configuration of a photographing system supporting atmosphere information according to an embodiment of the present invention.
2 is a flowchart illustrating a method of storing atmosphere information when taking a picture according to an embodiment of the present invention.
3 is a flowchart illustrating a method of reproducing atmosphere information when taking a picture according to an embodiment of the present invention.
FIG. 4 is a diagram for explaining a method of determining a reproduction position of music when atmosphere information is reproduced.

Terms used in this specification will be briefly described, and the present invention will be described in detail.

The terms used in the present invention have been selected as currently widely used general terms as possible while considering the functions in the present invention, but these may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, and the like. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, rather than the name of a simple term.

In the entire specification, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, terms such as "... means", "... unit", and "module" described in the specification mean a unit that processes at least one function or operation, which is implemented in hardware or software, or is implemented in hardware and software. It can be implemented by combining

Hereinafter, with reference to the accompanying drawings, the embodiments of the present invention will be described in detail so that those skilled in the art can easily carry out the embodiments of the present invention. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Hereinafter, with reference to the accompanying drawings, a method for storing and reproducing atmosphere information during photographing according to various embodiments of the present invention and a photographing system therefor will be described in detail.

1 is a diagram for explaining a network configuration of a photographing system supporting atmosphere information according to an embodiment of the present invention.

Referring to FIG. 1 , the photographing system includes a user terminal 100 that installs a dedicated application for photographing and storing atmosphere information, and a sound source server 200 that provides information about a sound source being reproduced during photographing. can

The user terminal 100 is an electronic device having a photo taking function, and may be implemented as a portable device such as a smart phone, but is not limited thereto, and various types of display functions such as PC, tablet PC, PMP, PDA, etc. It can be implemented as a device. When the user terminal 100 is implemented as a portable device, it may be implemented so that a program can be executed using a finger or a stylus pen because it has a built-in touch screen.

The user terminal 100 is an electronic device including a processor, a memory, a camera, a microphone, and an input/output device.

The camera can take video. Video refers to any type of content that can be captured through a camera. Specifically, the image may be various contents such as a picture, a moving picture, a panoramic picture, a wide shot, and the like. Also, the image may be an animated GIF file in GIF format.

The memory may store images captured by the camera and various contents and programs. Specifically, the memory includes a dedicated application for providing atmospheric information at the time of shooting proposed by the present invention, pictures taken, atmospheric information indicating the atmosphere of the space in which the user terminal 100 is located at the time of shooting, a shooting date and a shooting location. metadata, etc. can be stored.

The processor may perform overall functions of the user terminal 100 . Specifically, the processor executes a dedicated application according to an input received from the user, controls the camera to take a picture when a shooting command is input, and a sound generated at a place where the user terminal 100 is located while the picture is taken You can control the microphone to collect the signal.

The user terminal 100 executes a dedicated application according to a user's manipulation, and takes a picture when a shooting command is input from the user. The user goes to a desired place, executes a dedicated application of the user terminal 100, and takes several pictures at the same place while the dedicated application is running. In addition, the user terminal 100 collects an external sound signal through a microphone while taking a plurality of pictures through a dedicated application. The acoustic signal may be continuously or periodically collected while running a dedicated application at a specific location on a specific day.

Whether the picture is taken at the same place can be determined using global positioning system (GPS) coordinate information obtained by the user terminal 100, and the pictures taken at the same place using a dedicated application are grouped together. It will be stored together with metadata including the shooting date and shooting location, and mood information expressing the atmosphere at the time of shooting.

To generate the atmosphere information, the user terminal 100 collects a sound signal through a microphone while taking a picture using a dedicated application in the same place. The dedicated application analyzes the collected sound signal to determine whether music is being played while taking a photo.

If music is being played, it acquires sound source information about which song it is. The user terminal 100 may transmit the collected sound signal to the sound source server 200 to request sound source information corresponding to which kind of music. The sound source server 200 will inquire whether the received sound signal corresponds to a pre-stored song and provide sound source information on the matching song to the user terminal 100 .

At this time, if a plurality of music is played, the plurality of sound source information will be obtained from the sound source server 200 . The dedicated application may identify the time or number of times each music was played, select the longest or most played music as representative music, and generate the information as mood information.

On the other hand, when no music is played while taking a picture and only ambient noise is detected, the dedicated application compares the pre-stored ASMR (autonomous sensory meridian response) sound source to determine the matching noise type. According to an embodiment, it is possible to request a noise type inquiry from the external server 200 and receive and use noise type information in response thereto. The type of noise indicates what noise is included in the acoustic signal. For example, it is to extract one or more noise types from various noise types, such as noise caused by surrounding crowds, waves, vehicle sounds, children's laughter, and animal sounds while taking a photo. Information on the type of noise may be included in the atmosphere information.

Upon completion of shooting, that is, when the completion of shooting at the current location is requested or termination of the dedicated application is requested according to a user input, the dedicated application stores a plurality of photos, information about the shooting date and place, and atmosphere information in the memory.

Atmosphere information stored in a link with the photographed photos may represent the atmosphere of the corresponding place at the time of photographing, and may be reproduced together when the photograph is reproduced so that the user can feel the atmosphere during photographing.

2 is a flowchart illustrating a method of storing atmosphere information when taking a picture according to an embodiment of the present invention.

Referring to FIG. 2 , in step S21, a dedicated application is executed according to a user's request.

In step S22, a picture is taken according to a user input while the dedicated application is running.

In step S23, a sound signal is collected through a microphone while the dedicated application is running. This is to determine the music or noise that can give the most representative feeling by collecting sound source information in the background while a plurality of pictures are taken in the same place on the same day.

In step S24, it is determined whether or not photographing has been completed. When the user inputs a command to complete shooting or an end command of a dedicated application, it may be determined that shooting is complete.

In addition, when the user terminal 100 leaves the existing location and arrives at another location, it may also be determined that the photographing has been completed. For example, when a user who took a picture while moving within Park B of City A leaves Park B and moves to Café C 10 km away, it may be determined that the shooting has been completed. Even if the dedicated application is still running in the background, if it is determined that the location has changed as a result of analyzing the GPS coordinates, a new session is executed to control the start of photo taking, and a new photo group is created using the newly taken photos and sound signals are collected Restarts creating atmosphere information through

If the photographing has not yet been completed, the process may proceed to step S22 to take an additional photograph according to a user input. Accordingly, the user will take a plurality of pictures in the same place, and creates atmosphere information while the plurality of pictures are taken.

When taking a plurality of pictures is completed, the flow advances to step S25.

In step S25, the sound signal collected during the photo taking is analyzed to generate atmosphere information indicating the atmosphere of a specific date and place where a plurality of photos were taken.

In order to generate the atmosphere information, the user terminal 100 analyzes the collected sound signal to determine whether to play the music. It can be determined whether music is being reproduced through frequency analysis of the sound signal.

When music is played on a specific date and place where a plurality of photos were taken, one or more sound source information corresponding to the played music is acquired. Acquisition of sound source information may be performed through information pre-stored in the sound source server 200 or the user terminal 100 .

The dedicated application determines whether music is played in the background during execution, and when the music is played, it records for several seconds and delivers it to the sound source server 200 , and obtains information about the sound source from the sound source server 200 .

When a plurality of sound source information is obtained, one of the reproduced songs is selected as representative music, and information about the representative music is included in the atmosphere information. Among a plurality of pieces of music reproduced while a plurality of photos are taken, music played the most number of times or for the longest time may be selected as representative music.

In another embodiment, it may be implemented to show the music sensed while taking a picture to the user and select representative music according to the user's selection. By including the most impressive music among the music listened to at the location in the mood information, the user can enjoy the selected music together when reproducing the photos later.

In an embodiment, information on an external link that provides sound source information for representative music may be inquired and added to the atmosphere information. For example, by finding a YouTube video for representative music and adding the link to the mood information, link information can be provided to the user when the photo is reproduced.

When it is determined that music is not played on a specific date and place where a plurality of pictures were taken, the type of noise is determined by analyzing the collected sound signal. By including this type of noise in the atmosphere information, the atmosphere can be reproduced by playing an ASMR sound source similar to the noise generated at the location where the photos were taken later when viewing the photos.

In one embodiment, when music is not being played, metadata for a place corresponding to GPS coordinates (eg, beach, cafe, performance hall, playground, restaurant, baseball field, etc.) is acquired, and the ASMR sound source related to this metadata is information about the atmosphere can be generated as atmosphere information. For example, if the filming location is a beach, ASMR sound source information about the sound of waves is added as atmosphere information.

In an embodiment, environmental information on a specific date and place where a plurality of photos were taken may be collected and added to the atmosphere information. Environment information is also used to reproduce the atmosphere when playing the photo.

In step S26, information on a plurality of photographed pictures, photographing date and place, and atmosphere information are stored in the memory.

3 is a flowchart illustrating a method of reproducing atmosphere information when taking a picture according to an embodiment of the present invention, and FIG. 4 is a diagram illustrating a method of determining a reproduction position when reproducing atmosphere information.

Referring to FIG. 3 , in step S31, a reproduction request for a plurality of photos taken on a specific date and place is received from the user. The photos taken by the dedicated application are classified and stored in groups according to the shooting date and place, and a user interface that allows the user to select a photo group to be played back when requesting a gallery will be provided.

In step S32, a plurality of photos requested to be reproduced and atmosphere information corresponding thereto are read from the memory.

In step S33, sound source information expressing the atmosphere of the date and place at which the corresponding photos were taken is determined using the read atmosphere information.

In step S34, an atmosphere is reproduced together using sound source information while a plurality of photos are reproduced. The reproduction of the atmosphere may be performed by reproduction of the representative music that was being played at the time the corresponding photos were taken or the ASMR sound source corresponding to the noise generated at the recording location.

Specifically, information on the representative music may be read from the atmosphere information linked to the photo group and the representative music may be reproduced. In this case, it is necessary to first determine where to play the representative music. When the photos are played back in the form of a slide show, the playback start position may be determined so that the climax of the representative music is located in the middle of the photo playback.

The reproduction start position of the representative music may be determined using the number of pictures taken, the reproduction time of each picture, and sound source information on the representative music.

Referring to FIG. 4 , it can be seen that it takes 30 seconds to reproduce a group of photos when there are 6 photos taken at a specific date and place and each photo is reproduced at an interval of 5 seconds.

In this case, if a portion corresponding to 30 seconds including 15 seconds before and after the climax point 41 of the representative music is reproduced, it is possible to control the climax of the representative music to be reproduced at the middle point of the slide reproduction. Accordingly, a point 40 corresponding to 15 seconds ahead from the climax 41 of the representative music may be determined as the music reproduction start position.

The dedicated application reproduces the atmosphere in the corresponding place at the time of taking the photo by sequentially playing the plurality of photos selected by the user and playing the representative music from the playback start position determined as described above. In this case, the volume at the reproduction start position and the reproduction end position may be smoothly processed by naturally fading in and out.

When the noise type is included in the atmosphere information, the atmosphere is reproduced by reading the noise type and playing a sound source corresponding to the noise type while playing a plurality of photos. In the case of photos taken in places where music is not playing, the ASMR sound source built into the dedicated application (eg waves, car sounds, crowd shouts, street noises in downtown areas, etc.) is played instead of music.

On the other hand, when the environment information is included in the atmosphere information, an effect corresponding to the environment information is determined, and the atmosphere is reproduced by playing the effects while playing a plurality of photos. The environmental information may include information indicating the environment of the corresponding place, such as weather, temperature, humidity, fine dust, etc., and the effect may include visual and/or auditory effects that can save the feeling of the corresponding environment. Effects can be played on the background screen when playing back photos or in transitions played between photos in a slide show.

For example, if the mood information indicates that the photos were taken on a rainy day, it is possible to control an effect including an animation background and sound effects of rain and thunder to be played between one photo fades out and the next one fades in. have.

In one embodiment, when a plurality of photos are reproduced, if there is sound source information in the atmosphere information, a sound source icon may be provided on the screen, and the user may control to reproduce the corresponding representative music or noise by clicking the sound source icon.

In one embodiment, when a photo and representative music are played together, a music icon may be provided on the screen of the dedicated application, and when the user clicks on the icon, it can be automatically connected to a specific application having a music playback function (eg, YouTube). have. Through this automatically connected external specific application, the user can obtain detailed information about the corresponding music, such as the title, composer, and singer, or enjoy the entire music again.

The method according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto. belong to the scope of the right.

100: user terminal
200: sound source server
40: representative music playback start position
41: climax point

Claims (7)

electronic device,
Steps of taking a plurality of photos according to a user input while the dedicated application is running:
collecting a sound signal through a microphone while the dedicated application is running;
generating atmosphere information indicating an atmosphere of a specific date and place where the plurality of photos were taken by analyzing the collected sound signals; and
When photographing is completed, storing the plurality of photographed photos, information on the photographing date and place, and the atmosphere information in a memory; a method for storing atmosphere information during photographing, comprising: a. According to claim 1,
The generating of the atmosphere information comprises:
determining whether to play music by analyzing the collected sound signals;
acquiring information about one or more sound sources corresponding to the reproduced music when music is played on a specific date and place where the plurality of photos were taken;
selecting representative music from the one or more sound source information; and
Including the information about the selected representative music in the atmosphere information; characterized in that it comprises a method of storing atmosphere information at the time of photographing. 3. The method of claim 2,
The step of selecting the representative music is,
Selecting, as representative music, music played the most number of times or for the longest time among a plurality of music played while the plurality of photos are taken; Way. electronic device,
Receiving a reproduction request for a plurality of photos taken at a specific date and place from a user;
reading the plurality of photos requested to be reproduced and atmosphere information corresponding thereto from a memory;
determining sound source information expressing an atmosphere of a date and a place where the plurality of photos were taken by using the atmosphere information; and
Reproducing the atmosphere together using the sound source information while playing the plurality of photos; Method for reproducing the atmosphere when taking a photo, characterized in that it comprises a. 5. The method of claim 4,
The step of regenerating the atmosphere,
reading information on representative music included in the atmosphere information;
determining a reproduction start position of the representative music by using the number of the photographed pictures, a reproduction time of each picture, and sound source information on the representative music; and
and reproducing the representative music according to the reproduction start position while sequentially reproducing the plurality of pictures. 5. The method of claim 4,
The step of regenerating the atmosphere,
reading a noise type included in the atmosphere information; and
Reproducing the sound source corresponding to the read noise type while playing the plurality of photos together; A method for reproducing an atmosphere when taking a photo, comprising: a. 5. The method of claim 4,
The step of regenerating the atmosphere,
reading environment information of a photographing date and place included in the atmosphere information; and
and reproducing an effect corresponding to the read environment information while reproducing the plurality of photos.

Images