KR20240030870A - Electronic device for shooting video, operating method thereof, and storage medium - Google Patents

Abstract

According to one embodiment, the electronic device 101 may include at least one microphone 250, at least one speaker 255, a display 160, and at least one processor 120. The at least one processor may be set to output a reference sound through the at least one speaker in response to receiving a user request for video shooting. The at least one processor may be set to obtain an acoustic signal corresponding to the reference sound through the at least one microphone. The at least one processor may be configured to analyze the acquired acoustic signal. The at least one processor may be set to display information about a normal or abnormal recording state on at least a portion of the display based on an analysis result of the acquired acoustic signal.

Description

Electronic device for shooting moving pictures, operating method thereof, and storage medium {ELECTRONIC DEVICE FOR SHOOTING VIDEO, OPERATING METHOD THEREOF, AND STORAGE MEDIUM}

An embodiment disclosed in this document relates to an electronic device for capturing video, an operating method thereof, and a storage medium.

As the variety of services and additional functions provided through electronic devices such as smart phones gradually increases, various applications that can run on electronic devices are being developed. Additionally, the hardware and/or software aspects of electronic devices are continuously being developed.

For example, there is a camera application that captures images (e.g., videos) using a camera mounted on an electronic device, and the number of users who capture images using camera applications is increasing. When a user takes video (e.g., recording or recording) using a camera of an electronic device in various environments, not only video but also sound (or sound) is recorded, and the user can check the recording status by playing the captured video.

According to one embodiment, the electronic device 101 may include at least one microphone 250, at least one speaker 255, a display 160, and at least one processor 120. The at least one processor may be set to output a reference sound through the at least one speaker in response to receiving a user request for video shooting. The at least one processor may be set to obtain an acoustic signal corresponding to the reference sound through the at least one microphone. The at least one processor may be configured to analyze the acquired acoustic signal. The at least one processor may be set to display information about a normal or abnormal recording state on at least a portion of the display based on an analysis result of the acquired acoustic signal.

According to one embodiment, a method for capturing a video in an electronic device may include outputting a reference sound through at least one speaker in response to receiving a user request for capturing a video. According to one embodiment, the method may include acquiring an acoustic signal corresponding to the reference sound through at least one microphone. According to one embodiment, the method may include analyzing the acquired acoustic signal. According to one embodiment, the method may include displaying information about a normal or abnormal recording state based on an analysis result of the acquired acoustic signal.

According to one embodiment, in a non-volatile storage medium storing instructions, the instructions, when executed by at least one processor 120 of the electronic device 101, cause the electronic device to perform at least one operation. As set, the at least one operation includes outputting a reference sound through at least one speaker in response to receiving a user request for video shooting, and outputting an acoustic signal corresponding to the reference sound through at least one microphone. It may include an operation of acquiring, an operation of analyzing the acquired sound signal, and an operation of displaying information about a normal or abnormal recording state based on the analysis result of the acquired sound signal.

1 is a block diagram of an electronic device in a network environment according to an embodiment.
FIG. 2 is a diagram illustrating an example of an electronic device according to an embodiment.
Figure 3 is a diagram illustrating an abnormal recording situation according to an embodiment.
Figure 4 is an internal block diagram of an electronic device according to an embodiment.
Figure 5 is a flowchart of an operation of an electronic device for filming a video according to an embodiment.
Figure 6 is a flowchart of an operation of an electronic device when video recording starts according to an embodiment.
Figure 7 is an example diagram illustrating a method of identifying a recording situation using a reference sound through a microphone according to an embodiment.
Figure 8 is an example screen showing an abnormal recording situation according to an embodiment.
FIG. 9 is a flowchart of an operation of an electronic device for identifying an abnormal recording situation during video recording according to an embodiment.
Figure 10 is an example screen showing an abnormal microphone location according to an embodiment.
In relation to the description of the drawings, identical or similar reference numerals may be used for identical or similar components.

1 is a block diagram of an electronic device 101 in a network environment 100, according to one embodiment. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is, for example, connected to the plurality of antennas by the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes: a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2 is a diagram illustrating an example of an electronic device according to an embodiment.

Referring to FIG. 2, in the electronic device 101 according to one embodiment, the display module 160 is disposed so that the display panel is exposed on the first side (e.g., front) 210 of the housing, and the camera module 180 The cameras included in the housing (e.g., the front camera 180a and the rear camera 180b) may be configured to be respectively disposed on a portion of the first side and a portion of the second side (e.g., rear) 220 of the housing. there is. For example, the side on which the display is placed (or the side on which the display module 160 is visible from the outside of the electronic device 101) may be defined as the front of the electronic device 101. And, the opposite side of the front side can be defined as the back side of the electronic device 101. Additionally, the surface surrounding the space between the front and back can be defined as the side of the electronic device 101.

According to one embodiment, the electronic device 101 may be configured to place at least one microphone 250a, 250b on the third side (e.g., top side) or fourth side (e.g., bottom side) of the housing. there is. According to one embodiment, the electronic device 101 may include at least one speaker 255a and 255b. As shown in FIG. 2 , at least one speaker 255a or 255b may be disposed on the third side (eg, top side) or fourth side (eg, bottom side) of the housing of the electronic device 201. For example, at least one speaker (255a, 255b) may be placed adjacent to at least one microphone (250a, 250b).

According to one embodiment, in the embodiment shown in FIG. 2, at least one speaker (255a, 255b) is disposed on the side, but the present invention is not limited thereto, and at least one speaker (255a, 255b) or a speaker (not shown) is connected to another speaker (255a, 255b). It may be formed as a separate structure and placed on both edges of the combined or assembled structure or the electronic device 101. In this way, at least one speaker 255a or 255b may be designed to be included in the structure of the electronic device 101 depending on its appearance and use state.

Figure 2 illustrates the case where two microphones and two speakers are placed at the top or bottom, respectively, but the location or number of microphones and speakers may not be limited to this.

Figure 3 is a diagram illustrating an abnormal recording situation according to an embodiment.

FIG. 3 illustrates a situation (or state) in which a user performs video shooting using the electronic device 101. As shown in FIG. 3, when the user holds the electronic device 101 with his hand so that the camera of the electronic device 101 is pointed at the subject for video shooting, and the user presses the start shooting button, the electronic device ( 101) can store images output from cameras included in the camera module (eg, the front camera 180a and the rear camera 180b).

For example, when shooting a video (e.g., recording or recording) using the camera of the electronic device 101, not only the video but also sound (or sound) is recorded, and the user can check the recording status by playing the captured video. there is. However, if the microphone is obscured depending on where the user holds the electronic device when shooting a video, recording is made without taking this situation into account, which may lead to difficulties in acquiring sound.

According to one embodiment, the electronic device 101 may provide information about the recording situation to the user while shooting a video. Accordingly, the user can shoot a video while checking whether the recording situation is normal while shooting the video, thereby increasing user convenience.

For example, when a user takes a picture while holding a part of the electronic device 101 with his hand, at least one microphone (250a. 250b) disposed on the electronic device 101 according to the position 310 that the user holds. may be partially obscured. In this case, even though the image of the subject is recorded normally, surrounding sounds, including sounds uttered by the subject, may not be recorded normally. Additionally, normal recording may be difficult even if at least one microphone (250a. 250b) is partially blocked by foreign substances. In this way, if sound is not obtained through at least one microphone (250a, 250b) during video shooting, the surrounding situation during shooting may not be accurately recorded. In this case, the user can confirm that the recording is abnormal only after finishing video recording.

Therefore, if the user can confirm that normal or abnormal recording is in progress while shooting a video, the user's convenience can be increased.

In the following detailed description, the same reference numbers in the drawings may be assigned or omitted for configurations that can be easily understood through prior embodiments, and the detailed description may also be omitted. The electronic device 101 according to an embodiment disclosed in this document may be implemented by selectively combining the components of different embodiments, and the components of one embodiment may be replaced by the components of another embodiment. For example, note that the present invention is not limited to specific drawings or embodiments.

Figure 4 is an internal block diagram of an electronic device according to an embodiment.

Referring to FIG. 4, the electronic device 101 includes at least one processor 120, memory 130, display 160, camera module 180, microphone unit 250, and/or speaker unit 255. It can be included. The electronic device 101 of FIG. 4 may be the electronic device 101 of FIG. 1 . Here, not all components shown in FIG. 4 are essential components of the electronic device 101, and the electronic device 101 may be implemented with more or fewer components than those shown in FIG. 4 . In describing the electronic device 101 of FIG. 4, detailed descriptions may be omitted for configurations that are similar to the embodiment of FIG. 1 or can be easily understood through the embodiment of FIG. 1.

Referring to FIG. 4, the processor 120 according to one embodiment may be electrically connected to the memory 130, the display 160, the camera module 180, the microphone unit 250, and the speaker unit 255.

According to one embodiment, the speaker unit 255 may receive an electrical signal from the processor 120, generate sound, and output it to the outside.

According to one embodiment, the microphone unit 250 may include a plurality of microphones 250a, 250b,..., 250n. For example, the microphone unit 250 or the electronic device 101 may detect the direction of sound or external sound through a plurality of microphones 250a, 250b,..., 250n. The electronic device 101 or the processor 120 may suppress or remove noise based on the external sound detected by the microphone unit 250. For example, the processor 120 may attenuate sounds other than multimedia sounds or received speech sounds output by the speaker unit 255 based on external sounds detected by the microphone unit 250. In voice call mode, at least one of the plurality of microphones 250a, 250b,..., 250n may collect the user's voice. The electronic device 101 or processor 120 uses sounds collected through a plurality of microphones 250a, 250b,..., 250n to enhance the user's voice and suppress external sounds to improve call quality in voice call mode. It can be improved.

In one embodiment, at least one of the plurality of microphones 250a, 250b,..., 250n is activated in the image capture mode, and can receive at least one subject and sound generated around the subject during image capture. For example, in the image capture mode, one of the plurality of microphones 250a, 250b,..., 250n is activated and can receive at least one subject and sound generated around the subject during image capture. In the video recording mode, two or more of the plurality of microphones 250a, 250b,..., 250n are activated, so that at least one subject and sound generated around the subject can be received during video recording.

According to one embodiment, the processor 120 may control the camera module 180 to be driven when a camera application (eg, program or function) for image capture is executed. Processor 120 may create, for example, an execution icon (e.g., object, graphic element, menu, button, or shortcut image) representing a camera application displayed on the home screen (not shown) of display module 160 (not shown). When an input by, a designated button input, or an input by a designated gesture is received, it is identified that there is a request for video shooting, and the camera application can be executed.

The processor 120 of the electronic device 101 according to one embodiment activates at least one camera to capture an image according to the execution of a camera application, and activates at least one camera (e.g., the front camera 180a of FIG. The camera module 180 including the rear camera 180b can be controlled. The processor 120 may control the display module 160 to display a preview screen when capturing an image. For example, the processor 120 may use a microphone of the microphone unit 250 (e.g., the microphone of FIG. 2 ( 250a. 250b)) can be activated.

The processor 120 according to an embodiment may acquire an acoustic signal corresponding to sound input through a plurality of microphones 250a, 250b,..., 250n activated during image capture. For example, the processor 120 may analyze the acquired acoustic signal and, based on the analysis result, identify a microphone in a normal or abnormal state among the plurality of microphones 250a, 250b,..., 250n.

According to one embodiment, the memory 130 stores an operating system related to the operation of the electronic device 101, and/or a program or at least one application that supports at least one user function executed through the electronic device 101. You can. In one embodiment, the memory 130 may store a program that identifies an abnormal recording state using acoustic signals collected through a plurality of microphones 250a, 250b,..., 250n. In one embodiment, memory 130 may store reference sounds used to identify abnormal recording conditions. For example, the reference sound is a sound output through the speaker unit 255 when shooting an image, and the plurality of microphones 250a, 250b,..., 250n are used in response to the reference sound output through the speaker unit 255. An acoustic signal corresponding to the reference sound may be input. In one embodiment, the reference sound may be a recording start sound provided when video recording begins or a sound in an inaudible frequency band. For example, the sound in the non-audible frequency band may include a specific frequency band that is set as a sound that cannot be perceived by the user, such as a sound above the audible frequency band or at an extremely low frequency band (e.g., a pilot tone). According to one embodiment, there may be a plurality of reference sounds for independent identification of a plurality of microphones 250a, 250b,..., 250n. For example, the first reference sound (e.g., 19 kHz) is output through a speaker (e.g., 255a in FIG. 2) disposed on the upper side of the electronic device 101, and the first reference sound (e.g., 19 kHz) is output through a speaker disposed on the lower side (e.g., It can be set to output a second reference sound (e.g., 20 kHz) through 255b) of FIG. 2.

In one embodiment, the memory 130 may temporarily store sound signals collected by a plurality of microphones 250a, 250b,..., 250n at the start of filming, under the control of the processor 120. Here, the temporarily stored sound signal is a signal corresponding to the start sound output through the speaker unit 250 that is input at the same time as the start of filming, and can be used to detect whether there is an abnormal recording (or microphone error).

In one embodiment, the memory 130 may temporarily store sound signals collected periodically or continuously through a plurality of microphones 250a, 250b,..., 250n activated during filming in a buffer in a certain unit.

In one embodiment, the memory 130 may store a threshold value (or threshold level) related to an acoustic signal for determining abnormal recording. For example, the threshold may be used for size comparison with an acoustic signal collected in response to the start of filming. For example, the threshold can be used to compare the size of an acoustic signal acquired through a plurality of microphones 250a, 250b,..., 250n. The processor 120 may identify a normal or abnormal recording state based on a result of comparing the size of the acquired sound signal and the threshold.

In one embodiment, the memory 130 may store characteristics of a default signal corresponding to a sound that serves as a standard for identifying a normal or abnormal recording state. For example, the memory 130 may store characteristics (or patterns) of an audio signal corresponding to a recording start sound provided when video recording begins. In one embodiment, when the shooting start sound is not set, for example, when the electronic device 101 is set to silent, the memory 130 stores the characteristics (or pattern) of the sound signal corresponding to the reference sound in the inaudible frequency band. can be saved. The pattern of the acoustic signal may mean a change in signal size for each frequency.

For example, the memory 130 may store a pattern of an acoustic signal (or default signal) to identify a normal or abnormal recording state, and a plurality of microphones 250a, 250b,..., 250n may be used at the start of or during filming. ) can also be used to compare with the pattern of the acoustic signal obtained through. For example, the pattern of the sound signal corresponding to the shooting start sound provided when shooting a video starts and the pattern of the sound signal corresponding to the reference sound in the inaudible frequency band may be different from each other. For example, a pattern (or reference pattern) of an acoustic signal that serves as a standard for identifying a normal or abnormal recording state at the start of shooting, and a pattern (or reference pattern) of an acoustic signal that serves as a standard for identifying a normal or abnormal recording state during shooting ( or reference pattern) may also be different.

In one embodiment, the processor 120 may analyze acoustic signals acquired (or received) through a plurality of microphones 250a, 250b,..., 250n. For example, the processor 120 may compare the magnitude of the acquired sound signal with a threshold through analysis of the acquired sound signal. The processor 120 may identify a normal or abnormal recording state based on a comparison result between the size of the sound signal and a threshold.

In one embodiment, the processor 120 may convert the sound signal into a frequency band, and compare the pattern of the sound signal converted into the frequency band with a reference pattern stored in the memory 130. The processor 120 may identify a normal or abnormal recording state based on a comparison result between the pattern of the sound signal and the reference pattern.

The processor 120 according to one embodiment may display information about normal or abnormal recording conditions on the display 160 while capturing an image. For example, the processor 120 may display an object indicating a microphone in a normal or abnormal state on at least part of the display 160. The processor 120 may display an object (eg, a graphic element, function, or indicator) indicating the microphone in a normal or abnormal state on a portion of the preview screen when capturing an image.

As described above, according to one embodiment, information related to recording in a normal or abnormal state is displayed on the video capture screen at the start of video capture or during video capture, so that the user can check in real time whether the recording is being captured normally. there is. Additionally, when recording is not in progress normally, the user can recognize the abnormal recording situation and change the holding state of the electronic device 101 or check whether there is a foreign substance in the microphone. Additionally, by displaying an object indicating the microphone, the user can determine the location of the microphone in an abnormal state, thereby improving convenience when shooting video.

According to one embodiment, the electronic device 101 may include at least one microphone 250, at least one speaker 255, a display 160, and at least one processor 120. The at least one processor may be set to output a reference sound through the at least one speaker in response to receiving a user request for video shooting. The at least one processor may be set to obtain an acoustic signal corresponding to the reference sound through the at least one microphone. The at least one processor may be configured to analyze the acquired acoustic signal. The at least one processor may be set to display information about a normal or abnormal recording state on at least a portion of the display based on an analysis result of the acquired acoustic signal.

According to one embodiment, the reference sound may be a recording start sound provided when video recording starts or a sound in an inaudible frequency band.

According to one embodiment, the at least one processor identifies whether the electronic device is set to silent, and when the electronic device is set to silent, sounds in the non-audible frequency band are transmitted through the at least one speaker. It can be set to output.

According to one embodiment, the at least one processor, when the electronic device is not set to silent, generates the recording start sound through the at least one speaker in response to receiving a user request for video recording. It can be set to output.

According to one embodiment, the at least one processor compares the size and threshold of the acquired sound signal through analysis of the acquired sound signal, and identifies the normal or abnormal recording state based on the comparison result. It can be set to do so.

According to one embodiment, the at least one processor, when the size of the acquired sound signal is smaller than a threshold through analysis of the acquired sound signal, displays information about the abnormal recording state on at least a portion of the display. It can be set to display in .

According to one embodiment, the at least one processor identifies whether there is an acoustic signal below a threshold among the acoustic signals acquired through the at least one microphone, and in response to the acoustic signal below the threshold, It may be set to identify a microphone that has acquired an acoustic signal below a threshold and display information about the abnormal recording state guiding the location of the identified microphone on at least part of the display.

According to one embodiment, the at least one processor acquires an acoustic signal through the at least one microphone while shooting the video, and based on an analysis result of the acoustic signal acquired through the at least one microphone, It may be configured to display information about normal or abnormal recording conditions on at least part of the display.

According to one embodiment, the at least one processor compares the size between sound signals acquired through the at least one microphone while shooting the video, and based on the result of the size comparison between the sound signals, sets a specified value. Identify whether a difference greater than or equal to the specified value occurs, output sound in the non-audible frequency band through the at least one speaker, and output sound in the non-audible frequency band through the at least one microphone in response to the difference greater than the specified value. It may be configured to acquire a corresponding sound signal and display information about the normal or abnormal recording state on at least part of the display based on an analysis result of the acquired sound signal.

According to one embodiment, the at least one processor displays a message notifying an abnormal recording state on at least part of the display in response to an acoustic signal below a threshold among the acoustic signals obtained through the at least one microphone. It can be set to display.

According to one embodiment, the at least one processor compares the size between sound signals acquired through the at least one microphone during the video shooting, and based on the result of the size comparison between the sound signals, sets a specified value. Identify whether a difference greater than or equal to the specified value occurs, output sound in the non-audible frequency band through the at least one speaker, and output sound in the non-audible frequency band through the at least one microphone in response to the difference greater than the specified value. It may be configured to acquire a corresponding sound signal and display information about the normal or abnormal recording state on at least part of the display based on an analysis result of the acquired sound signal.

Figure 5 is a flowchart of an operation of an electronic device for filming a video according to an embodiment. Referring to FIG. 5, the operating method may include operations 505 to 520. Each operation of the operation method of FIG. 5 is performed by an electronic device (e.g., the electronic device 101 of FIGS. 1 to 4), at least one processor of the electronic device (e.g., the processor 120 of FIG. 1 or the processor of FIG. 2). It may be performed by at least one of 120)). In one embodiment, at least one of operations 505 to 520 may be omitted, the order of some operations may be changed, or another operation may be added.

In operation 505, the electronic device 101 transmits a reference sound through at least one speaker (e.g., 255a, 255b in FIG. 2, speaker unit 255 in FIG. 4) in response to receiving a user request for video shooting. Can be printed. In one embodiment, the reference sound may be a recording start sound provided when video recording begins or a sound in an inaudible frequency band.

In operation 510, the electronic device 101 may acquire an acoustic signal corresponding to the reference sound through at least one microphone (e.g., 250a and 250b in FIG. 2 and the microphone unit 250 in FIG. 4). In one embodiment, the electronic device 101 can identify whether the electronic device 101 is set to silent. When the electronic device 101 is set to silent, the electronic device 101 may output sound in the non-audible frequency band through the at least one speaker. On the other hand, when the electronic device 101 is not set to silent, the electronic device 101 may output the shooting start sound through the at least one speaker.

In operation 515, the electronic device 101 may analyze the acquired acoustic signal. According to one embodiment, the electronic device 101 may compare the size and threshold of the acquired sound signal through analysis of the acquired sound signal. The electronic device 101 may identify the normal or abnormal recording state based on the comparison result.

In operation 520, the electronic device 101 may display information about a normal or abnormal recording state based on the analysis result of the acquired acoustic signal.

According to one embodiment, the electronic device 101 may display information about the abnormal recording state when the size of the acquired sound signal is smaller than a threshold through analysis of the acquired sound signal.

According to one embodiment, the electronic device 101 may identify whether there is an acoustic signal below a threshold among the acoustic signals acquired through the at least one microphone. The electronic device 101 may identify the microphone that acquired the sound signal below the threshold in response to the sound signal below the threshold. The electronic device 101 may display information about the abnormal recording state that guides the location of the identified microphone.

According to one embodiment, the electronic device 101 may acquire an audio signal through the at least one microphone while shooting the video. The electronic device 101 may display information about the normal or abnormal recording state based on an analysis result of the acoustic signal acquired through the at least one microphone.

According to one embodiment, the electronic device 101 may compare the size of sound signals acquired through the at least one microphone while shooting the video. The electronic device 101 may identify whether a difference greater than a specified value occurs based on a size comparison result between the sound signals. For example, the electronic device 101 may display information about the normal or abnormal recording state based on a result of size comparison between the sound signals. In one embodiment, the electronic device 101 may output sound in the non-audible frequency band through the at least one speaker in response to a difference greater than or equal to the specified value. The electronic device 101 may acquire an acoustic signal corresponding to the sound in the non-audible frequency band through the at least one microphone. The electronic device 101 may display information about the normal or abnormal recording state based on the analysis result of the acquired acoustic signal.

Figure 6 is a flowchart of an operation of an electronic device when video recording starts according to an embodiment. Referring to FIG. 6, the operation method may include operations 605 to 645. Each operation of the operation method of FIG. 6 is performed by an electronic device (e.g., the electronic device 101 of FIGS. 1 to 4), at least one processor of the electronic device (e.g., the processor 120 of FIG. 1 or the processor of FIG. 2). It may be performed by at least one of 120)). In one embodiment, at least one of operations 605 to 645 may be omitted, the order of some operations may be changed, or another operation may be added.

In operation 605, the electronic device 101 may execute an application. The electronic device 101 may display an execution screen of an application. According to one embodiment, the application may be a camera application. According to one embodiment, the execution screen of the application may include a preview area that displays images acquired by a camera (eg, the camera module 180 of FIG. 1 or FIG. 4) in real time. For example, the execution screen of the application is a video capture screen, which is an execution screen displayed on the display 160 and captures video (e.g., video being recorded or video output as low-resolution continuous image frames before video recording). This may be displayed. According to one embodiment, the execution screen of the application may include an area that displays detailed information corresponding to the preview. For example, detailed information corresponding to the preview may include shooting information, and the execution screen contains objects related to settings to be used when shooting video (e.g., options, menus, graphic elements, functions, or shortcut icons). can be displayed.

The electronic device 101 can record the captured video when the record button displayed on the video capture screen is selected, and in operation 610, the electronic device ( 101) can activate the microphone. Here, the recorded video may be a video of continuous image frames.

In operation 615, the electronic device 101 can identify whether the shooting start sound is set. For example, the shooting start sound may be a sound that guides the start of shooting when the record button is selected after executing the application.

In response to the case where the shooting start sound is set, in operation 625, the electronic device 101 may output a reference sound corresponding to the shooting start sound through the speaker. For example, the electronic device 101 may output a reference sound corresponding to the shooting start sound through each speaker as soon as the shooting starts.

In response to a case where the shooting start sound is not set, in operation 620, the electronic device 101 may output a reference sound through a speaker. For example, if the shooting start sound is not set, this may correspond to a case where the electronic device 101 is set to silent. For example, the electronic device 101 may output a reference sound in an inaudible frequency band as soon as shooting begins. If the electronic device 101 includes one speaker, the reference sound may be output. For example, when two or more speakers are placed in different positions of the electronic device 101, the reference sound output through each speaker can be set differently in consideration of the placement positions. To explain this in detail, reference may be made to FIG. 7 .

Figure 7 is an example diagram illustrating a method of identifying a recording situation using a reference sound through a microphone according to an embodiment. Referring to FIG. 7 , a case in which different reference sounds 710 and 720 are output from the speakers 255a and 255b while displayed on the video capture screen 730 is illustrated. The reference sounds 710 and 720 output from the speakers 255a and 255b may be input through the microphones 250a and 250b. The microphones 250a and 250b may acquire sound signals corresponding to the reference sounds 710 and 720.

In operation 630, the electronic device 101 may identify an acoustic signal corresponding to the reference sound received through the microphone.

According to one embodiment, when the shooting start sound is output as a reference sound, the electronic device 101 may obtain an acoustic signal corresponding to the shooting start sound through the microphone. For example, the electronic device 101 may analyze the acquired sound signal and compare the size and threshold of the acquired sound signal.

According to one embodiment, when the electronic device 101 is set to silent and a sound in the inaudible frequency band is output as a reference sound, the electronic device 101 outputs an acoustic signal corresponding to the sound in the inaudible frequency band. can be obtained through the microphone.

In operation 635, the electronic device 101 may identify whether the size of the sound signal from the activated microphone is greater than or equal to a threshold. When the size of the sound signal from the activated microphone is greater than or equal to the threshold, the electronic device 101 may capture a video in operation 645. In this way, if an acoustic signal above the threshold is acquired through each microphone, it can be considered that recording is proceeding normally.

On the other hand, if the size of the sound signal from the activated microphone is not greater than the threshold, the electronic device 101 may warn of an abnormal recording situation in operation 640. For example, when there are two activated microphones, the electronic device 101 may warn of an abnormal recording situation if the size of the sound signals from the two microphones is not greater than a threshold. For example, the electronic device 101 may warn of an abnormal recording situation even if the size of the sound signal from any one of the activated microphones is not greater than the threshold. For example, if the size of the sound signal from any of the activated microphones is less than the threshold, the sound signal with a size less than the threshold may be considered to be related to abnormal recording. For example, among the plurality of microphones 250a, 250b,..., 250n, it may be considered that a recording error occurs due to a microphone that acquires an acoustic signal with a size smaller than the threshold. Accordingly, when an abnormal recording situation occurs, the electronic device 101 can warn the user of the abnormal recording condition.

According to one embodiment, the electronic device 101 may control the display 160 to display information indicating an abnormal recording situation on the video capture screen, as shown in FIG. 8. Figure 8 is an example screen showing an abnormal recording situation according to an embodiment.

Referring to FIG. 8 , the electronic device 101 may display objects (e.g., graphic elements, functions, or indicators) 820 and 830 indicating a microphone in a normal or abnormal state on the image capture screen. Additionally, the electronic device 101 may display information 810 indicating an abnormal recording situation. For example, by displaying the object 830 indicating a microphone in an abnormal state, the user can intuitively check which microphone is causing the problem.

According to one embodiment, the electronic device 101 may notify the user of an abnormal recording situation through a warning sound or vibration in addition to a warning screen. For example, while holding the electronic device 101, vibration may be generated at a location corresponding to a microphone that has received an acoustic signal corresponding to an abnormal state. In this way, the electronic device can notify the user using an object (or graphic element) indicating the normal or abnormal state and the size of the sound signal received through the activated microphone in relation to the recording state at the start of or during video capture.

If the size of the sound signal from the activated microphone in operation 635 is greater than or equal to the threshold, the electronic device 101 may perform video recording in operation 645, while warning of an abnormal recording situation in operation 640. You can shoot video in . According to one embodiment, the electronic device 101 may continue filming a video while outputting a notification indicating an abnormal state even if a warning situation occurs when video recording starts or during filming. For example, while displaying a preview screen when shooting a video, the electronic device 101 may output the notification on at least part of the preview screen. The electronic device 101 may not display the notification on the preview screen when the abnormal recording situation is resolved as the user holds the electronic device 101 again so as not to block the microphone.

Meanwhile, in the above description, a method of checking the microphone status as soon as shooting begins is explained, and in the following description, a method of periodically or continuously checking the microphone status even during shooting and notifying the user of this will be explained. do.

FIG. 9 is a flowchart of an operation of an electronic device for identifying an abnormal recording situation during video recording according to an embodiment. Referring to FIG. 9, the operation method may include operations 905 to 950. Each operation of the operation method of FIG. 9 is performed by an electronic device (e.g., the electronic device 101 of FIGS. 1 to 4), at least one processor of the electronic device (e.g., the processor 120 of FIG. 1 or the processor of FIG. 2). It may be performed by at least one of 120)). In one embodiment, at least one of operations 905 to 950 may be omitted, the order of some operations may be changed, or another operation may be added.

In operation 905, the electronic device 101 may be shooting a video. During video recording, at least one microphone may be activated to receive sound signals.

In operation 910, the electronic device 101 may identify an acoustic signal received through a microphone. For example, the electronic device 101 may receive an acoustic signal through at least one microphone activated during filming.

In operation 915, the electronic device 101 may identify whether the size of the acoustic signal from the microphone is less than or equal to a threshold. For example, the electronic device 101 may identify whether the size of sound signals from all activated microphones is below a threshold. If the size of the sound signals from all activated microphones is not less than the threshold, the electronic device 101 may identify the difference in sound signals between the activated microphones in operation 920. Alternatively, the electronic device 101 may identify the difference in sound signals between microphones in the activated state in operation 920 even when the size of the sound signal in any one of the microphones in the activated state is not below the threshold.

In one embodiment, if the size of the sound signal from the microphone is identified as being less than or equal to the threshold in operation 915, the electronic device 101 may perform the operation in operation 930. For example, the electronic device 101 may identify that the size of sound signals from all activated microphones is below a threshold. For example, if the size of the acoustic signals from all activated microphones is below the threshold, it may correspond to a situation in which the surroundings are very quiet. When shooting a video, if the sound generated by the user, the subject, or around the subject is very small, the size of the sound signal acquired through the activated microphone may also be very small. Accordingly, when the size of the sound signals from all activated microphones is below the threshold, the electronic device 101 may output the designated reference sound through the speaker in operation 930. For example, it is necessary to determine whether there is a problem with the microphone during video recording even when the surroundings are very quiet. Accordingly, the designated reference sound output through at least one speaker can be used to identify the microphone status. For example, the reference sound may include sound in an inaudible frequency band.

By performing an operation of identifying sound signal differences between activated microphones in operation 920, the electronic device 101 may identify whether there is a sound signal difference greater than a specified value in at least one microphone in operation 925. Depending on the sensitivity of the microphone or due to various factors such as the distance to the subject or the sound generated by the subject's surroundings, for example, at least one of the activated microphones may be compared to the other microphones. When doing so, differences between acoustic signals may occur. Therefore, unless a sound signal difference exceeding a specified value corresponding to a microphone abnormality occurs, for example, the electronic device 101 can continuously perform video recording by ignoring the sound signal difference less than a specified value.

Accordingly, if it is determined in operation 925 that a difference in the sound signal exceeding the specified value in at least one microphone is not identified, video recording can be continuously performed, and the electronic device 101 determines whether video recording ends in operation 950. can be identified. On the other hand, in response to identifying a difference in sound signals greater than a specified value from at least one microphone, in operation 930, the electronic device 101 may output a reference sound from the speaker. For example, when the difference in sound signals between activated microphones is greater than a specified value, it is necessary to determine whether this difference is due to sound from the surroundings or a problem with the microphone.

For example, when acoustic signals are acquired using a plurality of activated microphones, if the difference in the acoustic signals between one microphone and the remaining microphones is greater than a certain threshold (e.g., about 20 dB), whether the microphone is defective In order to determine , a reference sound in an inaudible frequency band may be output through at least one speaker.

In operation 935, the electronic device 101 may identify an abnormal recording situation based on an acoustic signal corresponding to the reference sound received through the microphone. For example, the electronic device 101 may compare a pattern of an acoustic signal corresponding to a reference sound in an inaudible frequency band with a stored reference pattern and identify a normal or abnormal recording situation based on the comparison result.

In operation 940, the electronic device 101 may identify whether there is an abnormal recording situation. For example, the electronic device 101 may identify whether the result of comparing the pattern of the sound signal corresponding to the reference sound in the non-audible frequency band and the stored reference pattern matches entirely or at least a certain percentage. If, as a result of identifying the abnormal recording situation in operation 940, it is not an abnormal recording situation, the electronic device 101 proceeds to operation 950 and can identify whether video recording is ended. For example, if the user presses a button to stop video recording, video recording may end. The electronic device 101 may return to operation 905 to continuously perform video capture unless video capture at the user's request ends in operation 950, and may repeatedly perform the above-described operation.

Meanwhile, if the abnormal recording situation is identified as a result of identification in operation 940, the electronic device 101 may warn of the abnormal recording situation in operation 945. For example, the electronic device 101 may display a screen informing information about an abnormal recording situation as shown in FIG. 10 . Figure 10 is an example screen showing an abnormal microphone location according to an embodiment.

Referring to FIG. 10 , the electronic device 101 may display objects (e.g., graphic elements, functions, or indicators) 1020 and 1030 indicating a microphone in a normal or abnormal state on the video capture screen. For example, the object 103 can be set in a variety of ways, such as displaying it in a different color or using a blinking method so that the user can recognize an abnormal recording situation at a glance. In one embodiment, the electronic device 101 may display information 1010 indicating an abnormal recording situation. In one embodiment, the electronic device 101 displays an object 1040 indicating the location of a microphone in an abnormal state, so that the user can intuitively check the location of the microphone in which a problem is occurring.

In one embodiment, if there is no abnormal recording situation, the electronic device 101 may identify whether video recording is ended in operation 950. The electronic device 101 may return from operation 950 to operation 905, where video capturing does not end, and continue to perform the above-described video capturing. According to one embodiment, the operation to check the abnormal recording situation may be performed periodically or a specified number of times (eg, twice).

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one component from another, and to refer to that component in other respects (e.g., importance or order) is not limited. One (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.” When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

According to one embodiment, in a non-volatile storage medium storing instructions, the instructions, when executed by at least one processor 120 of the electronic device 101, cause the electronic device to perform at least one operation. As set, the at least one operation includes outputting a reference sound through at least one speaker in response to receiving a user request for video shooting, and outputting an acoustic signal corresponding to the reference sound through at least one microphone. It may include an operation of acquiring, an operation of analyzing the acquired sound signal, and an operation of displaying information about a normal or abnormal recording state based on the analysis result of the acquired sound signal.

Claims (20)

In the electronic device 101,
at least one microphone (250);
at least one speaker (255);
display 160; and
Comprising at least one processor 120,
The at least one processor,
In response to receiving a user request for video shooting, outputting a reference sound through the at least one speaker,
Obtaining an acoustic signal corresponding to the reference sound through the at least one microphone,
Analyzing the acquired acoustic signal,
An electronic device configured to display information about a normal or abnormal recording state on at least a portion of the display based on an analysis result of the acquired acoustic signal.
The method of claim 1, wherein the reference sound is,
An electronic device that is a recording start sound or a sound in a non-audible frequency band provided when video recording begins.
The method of claim 1 or 2, wherein the at least one processor:
Identify whether the electronic device is set to silent,
When the electronic device is set to silent, the electronic device is set to output sound in the non-audible frequency band through the at least one speaker.
The method of any one of claims 1 to 3, wherein the at least one processor:
When the electronic device is not set to silent, the electronic device is set to output the shooting start sound through the at least one speaker in response to receiving a user request for shooting the video.
The method of any one of claims 1 to 4, wherein the at least one processor:
Compare the size and threshold of the acquired acoustic signal through analysis of the acquired acoustic signal,
An electronic device configured to identify the normal or abnormal recording state based on the comparison results.
The method of any one of claims 1 to 5, wherein the at least one processor:
When the size of the acquired sound signal is smaller than a threshold through analysis of the acquired sound signal, the electronic device is configured to display information about the abnormal recording state on at least a portion of the display.
The method of any one of claims 1 to 6, wherein the at least one processor:
Identifying whether there is an acoustic signal below a threshold among the acoustic signals obtained through the at least one microphone,
In response to the sound signal below the threshold, identify the microphone that acquired the sound signal below the threshold,
An electronic device configured to display information about the abnormal recording state guiding the location of the identified microphone on at least a portion of the display.
The method of any one of claims 1 to 7, wherein the at least one processor:
During the video recording, an acoustic signal is acquired through the at least one microphone,
An electronic device configured to display information about the normal or abnormal recording state on at least a portion of the display based on an analysis result of an acoustic signal acquired through the at least one microphone.
The method of any one of claims 1 to 8, wherein the at least one processor:
During the video recording, compare the sizes between sound signals obtained through the at least one microphone,
Based on the results of size comparison between the acoustic signals, identify whether a difference greater than a specified value occurs,
In response to a difference greater than or equal to the specified value, outputting sound in the non-audible frequency band through the at least one speaker,
Obtaining an acoustic signal corresponding to the sound in the non-audible frequency band through the at least one microphone,
An electronic device configured to display information about the normal or abnormal recording state on at least a portion of the display based on an analysis result of the acquired acoustic signal.
The method of any one of claims 1 to 9, wherein the at least one processor:
An electronic device configured to display a message notifying an abnormal recording state on at least part of the display in response to an acoustic signal below a threshold among the acoustic signals acquired through the at least one microphone.
In a method for shooting a video in an electronic device,
In response to receiving a user request for video shooting, outputting a reference sound through at least one speaker;
Obtaining an acoustic signal corresponding to the reference sound through at least one microphone;
Analyzing the acquired acoustic signal; and
A method for filming a video, comprising displaying information about a normal or abnormal recording state based on an analysis result of the acquired sound signal.
The method of claim 11, wherein the reference sound is,
A method for shooting a video using the recording start sound provided when video recording begins or the sound in the non-audible frequency band.
The method of claim 11 or 12, wherein the operation of outputting the reference sound through the at least one speaker includes:
Identifying whether the electronic device is set to silent; and
When the electronic device is set to the silent mode, outputting sound in the non-audible frequency band through the at least one speaker.
The method of any one of claims 11 to 13, wherein the operation of outputting the reference sound through the at least one speaker includes:
A method for shooting a video, comprising outputting the shooting start sound through the at least one speaker when the electronic device is not set to silent.
The method of any one of claims 11 to 14, wherein the operation of analyzing the obtained acoustic signal comprises:
Comparing the size of the acquired sound signal and a threshold value through analysis of the acquired sound signal; and
A method for filming a video, comprising identifying the normal or abnormal recording state based on a comparison result.
The method of any one of claims 11 to 15, wherein the operation of displaying information about the normal or abnormal recording state includes:
A method for shooting a video, comprising displaying information about the abnormal recording state when the size of the acquired sound signal is smaller than a threshold through analysis of the acquired sound signal.
According to any one of claims 11 to 16,
An operation of identifying whether there is an acoustic signal below a threshold among the acoustic signals obtained through the at least one microphone;
In response to the sound signal below the threshold, identifying a microphone that has acquired the sound signal below the threshold; and
A method for shooting a video, further comprising displaying information about the abnormal recording state that guides the location of the identified microphone.
According to any one of claims 11 to 17,
During the video recording, acquiring an audio signal through the at least one microphone; and
A method for shooting a video, further comprising displaying information about the normal or abnormal recording state based on an analysis result of the sound signal acquired through the at least one microphone.
According to any one of claims 11 to 18,
Comparing the size of sound signals obtained through the at least one microphone while shooting the video;
An operation of identifying whether a difference greater than a specified value occurs based on a size comparison result between the sound signals;
outputting sound in the non-audible frequency band through the at least one speaker in response to a difference greater than or equal to the specified value;
Obtaining an acoustic signal corresponding to sound in the non-audible frequency band through the at least one microphone; and
A method for shooting a video, further comprising displaying information about the normal or abnormal recording state based on an analysis result of the acquired sound signal.
A non-volatile storage medium storing instructions, wherein the instructions are set to cause the electronic device to perform at least one operation when executed by at least one processor 120 of the electronic device 101, wherein the at least one The operation is,
In response to receiving a user request for video shooting, outputting a reference sound through at least one speaker;
Obtaining an acoustic signal corresponding to the reference sound through at least one microphone;
Analyzing the acquired acoustic signal; and
A storage medium comprising displaying information about a normal or abnormal recording state based on an analysis result of the acquired acoustic signal.

Images