KR20220077819A - Electronic device comprising microphone and method for controlling thereof - Google Patents

Abstract

According to various embodiments, the electronic device includes at least a first housing, connected to at least a portion of the first housing, and coupled to at least one of a second housing movable with respect to the first housing, the first housing, or the second housing. one display, at least one microphone, at least one sensor, and at least one processor, wherein the at least one processor obtains first audio data by using the at least one microphone, the first audio data is obtained During the process, using at least one sensor, it is confirmed that the shape of the electronic device is changed according to the relative movement of the first housing and the second housing, and based on confirming that the shape of the electronic device is changed, noise data is checked, and , set to obtain second audio data from the first audio data based on the identified noise data, wherein the second audio data includes at least a portion of noise based on a change in the shape of the electronic device included in the first audio data. May contain reduced data.

Description

ELECTRONIC DEVICE COMPRISING MICROPHONE AND METHOD FOR CONTROLLING THEREOF

Various embodiments of the present disclosure relate to an electronic device including a microphone and a method for controlling the same.

Various services and additional functions provided through an electronic device, for example, a portable electronic device such as a smart phone, are gradually increasing. In order to increase the utility value of such electronic devices and satisfy the needs of various users, communication service providers or electronic device manufacturers are competitively developing electronic devices to provide various functions and differentiate them from other companies. Accordingly, various functions provided through the electronic device are also increasingly advanced.

The electronic device may detect an external voice using a microphone, convert the sensed external voice into data, and provide data (hereinafter, audio data) of the external voice to an application. For example, the electronic device may provide audio data to various applications such as a recording application and a call application, and use the audio data to provide various functions to the user.

When the electronic device detects an external voice, not only a voice desired by the user but also noise around the electronic device may be sensed. For this reason, the audio data provided to the application may include noise not desired by the user.

In the past, the form of portable electronic devices was a non-deformed bar type, but recently a foldable type, a rollable type, a swivel type, or Portable electronic devices, such as a slideable type, in which a shape (eg, an external shape) of an electronic device can be deformed, have been developed and released. Portable electronic devices whose shape can be deformed include, for example, that the display of the electronic device can be folded, unfolded, or rolled, and when the shape is deformed, the structure (structure) ) (eg, housings that form the outer surface of the electronic device) may generate noise (eg, instrument impact sound). In addition, a spring may be included in, for example, a folded or unfolded portion (eg, a hinge) of portable electronic devices whose shape may be deformed, and may be configured to automatically or semi-automatically change shape. If the shape of the above-described electronic device is changed while the user is shooting a video using the portable electronic device, for example, noise (eg, instrument impact sound) generated when the shape of the electronic device is deformed is also detected. By (eg, recording), noise may be included in audio data and provided to an application.

According to various embodiments, when it is detected that the shape of the electronic device is changed, an electronic device that performs processing for reducing (or removing) noise on acquired audio data, and a control method thereof can be provided.

According to various embodiments, the electronic device includes at least a first housing, connected to at least a portion of the first housing, and coupled to at least one of a second housing movable with respect to the first housing, the first housing, or the second housing. one display, at least one microphone, at least one sensor, and at least one processor, wherein the at least one processor obtains first audio data by using the at least one microphone, the first audio data is obtained During the process, using at least one sensor, it is confirmed that the shape of the electronic device is changed according to the relative movement of the first housing and the second housing, and based on confirming that the shape of the electronic device is changed, noise data is checked, and , set to obtain second audio data from the first audio data based on the identified noise data, wherein the second audio data includes at least a portion of noise based on a change in the shape of the electronic device included in the first audio data. May contain reduced data.

According to various embodiments of the present disclosure, a method of controlling an electronic device includes: acquiring first audio data using at least one microphone of the electronic device; An operation of confirming that the shape of the electronic device is changed according to the relative movement of the first housing of the electronic device and the second housing of the electronic device using the sensor, and noise data based on checking that the shape of the electronic device is changed and acquiring second audio data from the first audio data based on the operation and the confirmed noise data, wherein the second audio data is noise based on a change in a shape of an electronic device included in the first audio data. At least a portion of may include reduced data.

According to various embodiments, the computer-readable non-volatile recording medium, when executed, causes at least one processor to obtain first audio data using at least one microphone of the electronic device, and the first audio data During the acquisition, using at least one sensor of the electronic device, it is confirmed that the shape of the electronic device is changed according to the relative movement of the first housing of the electronic device and the second housing of the electronic device, and that the shape of the electronic device is changed store instructions for checking noise data based on the verification, and obtaining second audio data from the first audio data based on the identified noise data, wherein the second audio data is included in the first audio data Data in which at least a portion of noise based on a change in the shape of the electronic device is reduced may be included.

According to various embodiments, the electronic device may provide noise-reduced audio data to an application by predicting that noise is generated due to a change in the shape of the electronic device.

According to various embodiments, the electronic device may check a noise pattern expected to occur when the shape of the electronic device is changed, and provide audio data with reduced noise to the application.

Various effects exerted by the present disclosure are not limited by the above-described effects.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2A is a block diagram illustrating components included in an electronic device according to various embodiments of the present disclosure;
2B is a block diagram illustrating components included in an electronic device according to various embodiments of the present disclosure;
3A is a diagram illustrating an unfolded state of an electronic device according to various embodiments of the present disclosure;
3B is a diagram illustrating a folded state of an electronic device according to various embodiments of the present disclosure;
3C is an exploded perspective view of an electronic device according to various embodiments of the present disclosure;
4A is a 6-sectional view illustrating a state in which a second housing is accommodated in an electronic device according to various embodiments of the present disclosure;
4B is a 6-sectional view illustrating a state in which a second housing is withdrawn from an electronic device according to various embodiments of the present disclosure;
5A is a diagram for explaining a change in the shape of a foldable type electronic device according to various embodiments of the present disclosure;
FIG. 5B is a diagram for explaining a state in which a shape of a rollable type electronic device is changed, according to various embodiments of the present disclosure;
5C is a view for explaining a state in which a shape of a swivel-type electronic device is changed according to various embodiments of the present disclosure;
FIG. 5D is a diagram for describing a state in which a shape of a slideable type electronic device is changed according to various embodiments of the present disclosure;
6 is a flowchart illustrating a method of, by an electronic device, performing noise processing on audio data based on a shape change of the electronic device, according to various embodiments of the present disclosure;
7 is a flowchart illustrating a method for an electronic device to check a speed at which a shape of an electronic device is changed, according to various embodiments of the present disclosure;
8 is a flowchart illustrating a method for an electronic device to perform noise processing on audio data based on a speed at which a shape of the electronic device is changed, according to various embodiments of the present disclosure;
9 is a flowchart illustrating a method of providing, by an electronic device, audio data to an application based on whether the shape of the electronic device is changed, according to various embodiments of the present disclosure;
10 is a flowchart illustrating a method of an electronic device providing audio data to an application based on an application being executed, according to various embodiments of the present disclosure;
11 illustrates an example of a screen displayed on a display when a shape of an electronic device is changed, according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments.

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with at least one of the electronic device 104 and the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the co-processor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 , or an external electronic device (eg, a sound output module 155 ) connected directly or wirelessly with the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, bottom side) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2A is a block diagram illustrating components included in the electronic device 101 according to various embodiments of the present disclosure.

According to various embodiments, the electronic device 101 includes a microphone 201 (eg, the input module 150 of FIG. 1 ), an audio module 170 , and a sensor 203 (eg, the sensor module of FIG. 1 ) 176 ), memory 130 and/or processor 120 .

According to various embodiments, the microphone 201 may detect an external voice and output an electrical signal (eg, an analog signal) (hereinafter, an audio signal) corresponding to the sensed voice. According to various embodiments, one or more microphones may be included as a component of the electronic device 101 . According to an embodiment, the microphone 201 includes an air conduction microphone for detecting voice transmitted through air and/or an acceleration sensor for detecting voice by measuring vibration of the electronic device 101 . can do.

According to various embodiments, the audio module 170 may receive an audio signal from the microphone 201 and perform signal processing on the received audio signal. For example, the audio module 170 may convert a received audio signal into a digital signal (hereinafter, audio data). For example, the audio data may include data in the form of pulse coded modulation (PCM). According to various embodiments, the audio module 170 may include an analog-digital converter (ADC) and/or a digital signal processor (DSP), and will be described in more detail with reference to the drawings to be described later. to do it According to various embodiments, the audio module 170 may be referred to as an audio subsystem or other various terms.

According to various embodiments, the sensor 203 may include at least one of a gyro sensor, an acceleration sensor, an angular velocity sensor, a proximity sensor, and an illuminance sensor. According to various embodiments, whenever the shape of the electronic device 101 becomes one of the predefined shapes, the sensor 203 may sense it and output an electrical signal to the processor 120 . For example, the predefined shapes may include at least one or more shapes, and will be described in more detail with reference to the drawings below. According to an embodiment, the sensor 203 may be disposed in each of one or more housings forming the outer surface of the electronic device 101 , and detects movement (eg, linear movement and/or rotational movement) of each housing. Accordingly, an electrical signal corresponding thereto may be output. According to an embodiment, the sensor 203 may be disposed on at least a part of a hinge structure (eg, a hinge structure 325 of FIG. 3C to be described later) of the electronic device 101 (eg, a foldable type electronic device). Also, by detecting the movement (eg, linear movement and/or rotational movement) of each housing connected to the hinge structure (eg, the hinge structure 325 of FIG. 3C to be described later), an electrical signal corresponding thereto may be output. . According to an embodiment, the sensor 203 may be disposed on at least a portion of a rotating member (eg, a pinion gear and/or a guide roller to be described later) of the electronic device 101 (eg, a rollable type electronic device). In addition, the rotation member (eg, a pinion gear and/or a guide roller to be described later) may sense the rotation angle (or the number of rotations) and output an electrical signal corresponding thereto. According to various embodiments, the at least one sensor 203 used to confirm that the shape of the electronic device 101 is changed may be referred to as a step sensor.

According to various embodiments, the processor 120 may perform and/or control overall operations of the electronic device 101 . For example, the processor 120 may perform a process on electrical signals and/or data (eg, audio data) received from other hardware components (eg, the audio module 170 or the sensor 203 ). Performs, performs a specified operation based thereon, and/or another hardware component (eg, audio module 170, sensor 203, or display (eg, display module 160 of FIG. 1 ) performs a specified operation) As another example, the processor 120 accesses data stored in the memory 130 , stores data in the memory 130 , or loads data stored in the memory 130 . According to various embodiments, the processor 120 may include a main processor (eg, the main processor 121 of FIG. 1 ) and/or a secondary processor (eg, the auxiliary processor ( 123)) (eg, DSP), and the auxiliary processor 123 (eg, DSP) may be included in the audio module 170 .

According to various embodiments, the processor 120 may receive an electrical signal from the sensor 203 and check whether the shape of the electronic device 101 is changed based on the received electrical signal. For example, when a first signal is received from the sensor 203 , the processor 120 determines that the electronic device 101 has a first shape (eg, any one of Step 2 to Step (n-1) to be described later). ), and when the second signal is received, it can be confirmed that the shape of the electronic device 101 is the second shape (eg, Step 1 or Step n to be described later). According to various embodiments, the first signal may indicate a Step value corresponding to the shape of the electronic device 101 among Steps 2 to (n-1) to be described later. According to various embodiments, the second signal may indicate a Step value corresponding to the shape of the electronic device 101 among Step 1 or Step n, which will be described later. Meanwhile, the shape of the electronic device 101 may include three or more types. According to various embodiments, when the first signal or the second signal is received, the processor 120 checks the Step value indicated by the first signal or the second signal to determine the current form of the electronic device 101 . (eg, changed shape) and/or that the shape of the electronic device 101 is changed. According to an embodiment, the first signal or the second signal may indicate a direction in which the shape of the electronic device 101 is changed. For example, when the first signal is received from the sensor 203 when the shape of the electronic device 101 is a shape corresponding to Step k, the processor 120 may change the shape of the electronic device 101 to Step (k). When the shape is changed to the shape corresponding to -1) and the second signal is received, it may be confirmed that the shape of the electronic device 101 is changed to the shape corresponding to Step (k+1).

According to various embodiments, the processor 120 may identify the speed at which the shape of the electronic device 101 is changed based on the electrical signals received from the sensor 203 . For example, the processor 120 determines the speed at which the shape of the electronic device 101 is changed from the first shape to the second shape based on a difference between the time when the first signal is received and the time when the second signal is received. It can be confirmed, and will be described in more detail with reference to the drawings to be described later.

According to various embodiments, the processor 120 may receive audio data from the audio module 170 . According to various embodiments, the processor 120 may provide the received audio data to the application (eg, the application 146 of FIG. 1 ) or provide data based on the received audio data to the application 146 . have.

According to various embodiments, the processor 120 provides the audio data received from the audio module 170 to the application 146 or the received audio data based on whether the shape of the electronic device 101 is changed. Data based on the data may be provided to the application 146 . According to various embodiments of the present disclosure, when it is confirmed that the shape of the electronic device 101 is changed, the processor 120 is configured to respond to the changed shape of the electronic device 101 and/or the speed at which the shape of the electronic device 101 is changed. Check noise data (eg, reference data stored in advance), and add audio data (hereinafter, first audio data) (in other words, raw data) received from the audio module 170 based on the identified noise data. By performing noise processing (eg, noise canceling) on the , noise-reduced (or removed) audio data (hereinafter, second audio data) may be obtained. For example, noise processing (eg, noise canceling) of the first audio data is a process of removing a noise signal represented by the noise data with respect to the first audio data, and various techniques may be applied. According to various embodiments, if it is not confirmed that the shape of the electronic device 101 is changed, the processor 120 provides the first audio data to the application 146 (eg, noise data ( For example, it is possible to provide the application 146 without performing noise processing based on the reference data stored in advance).

According to various embodiments, the processor 120 provides the audio data received from the audio module 170 to the application 146 or , data based on the received audio data may be provided to the application 146 . According to various embodiments, the processor 120 is an application that converts the sensed external voice into data and stores the detected external voice in the memory 130 by the running application as a first application (eg, a recording application or a camera application) ), the second audio data may be provided to the first application. According to an embodiment, the first application may include, for example, a call application that converts the sensed external voice or sound into data and transmits it to an external network (eg, the second network 199 of FIG. 1 ). have. According to various embodiments, if the running application is the first application, the processor 120 transmits the first audio data or the second audio data to the first application according to whether the shape of the electronic device 101 is changed. can provide For example, when it is confirmed that the shape of the electronic device 101 is changed when the running application is the first application, the processor 120 provides the second audio data to the first application, and the electronic device 101 If it is not confirmed that the shape of , the first audio data may be provided to the first application. According to various embodiments, if the running application is a second application (eg, an application that mainly uses the user's voice among detected external voices, such as a call application), the processor 120 receives the user from the first audio data. By extracting the voice of the user, it is possible to provide data on the extracted user's voice to the second application. For example, voice activity detection (VAD) or other various techniques may be applied to the operation of extracting the user's voice by the processor 120 . According to an embodiment, when it is confirmed that the running application is the second application or the third application (eg, an application different from the first application and the second application), the processor 120 transmits the first audio data to the third application. It can also be provided to (eg, the running application).

According to various embodiments, the memory 130 may store various information and/or data for performing the operations described in the present disclosure. For example, the memory 130 may pre-store a plurality of noise data (eg, reference data) (in other words, noise pattern data). According to various embodiments, the pre-stored noise data may include information about a noise pattern corresponding to a speed at which the shape of the electronic device 101 is changed and/or the speed at which the shape of the electronic device 101 is changed. . According to various embodiments, the pre-stored noise data may be learned data based on a noise pattern corresponding to a speed at which the shape of the electronic device 101 is changed and/or the speed at which the shape of the electronic device 101 is changed. For example, in a quiet environment (eg, an environment in which external noise is low), while the shape of the electronic device 101 is changed in various ways, the external voice sensed through the microphone 201 may change the shape of the electronic device 101 . It can be stored in association with the method of change. More specifically, in relation to the changed shape of the electronic device 101 and/or the speed at which the shape of the electronic device 101 is changed, the obtained voice data (eg, noise pattern) is noise data (eg, reference data) can be stored as According to various embodiments, the acquired voice data (eg, a noise pattern) may be changed according to the structure of the electronic device 101 , the changed shape of the electronic device 101 , and/or the speed at which the shape of the electronic device 101 is changed. may be different. If the structure of the electronic device 101 is the same (eg, an electronic device of the same type that can be changed in shape), the changed shape of the electronic device 101 and/or the changed shape of the electronic device 101 is Depending on the speed, acquired voice data (eg, noise pattern) may be different. For example, if the electronic device 101 is a foldable electronic device, voice data (eg, noise pattern) and voice data (eg, noise pattern) acquired when the electronic device 101 enters an unfolded state (eg, an 'unfolded state' of FIG. 3A to be described later) may be different. For example, as the speed at which the shape of the electronic device 101 is changed is increased, a relatively high-frequency noise pattern (eg, a noise pattern having a large high-frequency component) is detected, and the speed at which the shape of the electronic device 101 is changed becomes slower. As a result, a relatively low-frequency noise pattern (eg, a noise pattern with a small high-frequency component) may be detected. According to an embodiment, the pre-stored noise data may be updated according to an actual use environment. For example, if a user uses the electronic device 101 by attaching a case to the housing of the electronic device 101 , a noise pattern generated when the shape of the electronic device 101 is changed is a pre-stored noise data may be different. When it is confirmed that the case is mounted and used (eg, when information indicating that the case is mounted is input to the electronic device 101 by the user), the electronic device 101 When the shape is changed, the changed shape of the electronic device 101 and/or the shape of the electronic device 101 is changed in voice data (eg, noise pattern) obtained by detecting an external voice through the microphone 201 . It is possible to update the pre-stored noise data (eg reference data) in relation to the speed at which it occurs.

According to various embodiments, the pre-stored noise data may be classified and stored in the form shown in Table 1 below.

changed form Shape change time(t _f )[s]
(Shape change rate (v _f )[m/s]) noise data Step 1 t _f < t ₁
(v ₁ < v _f ) reference a ₁ t ₁ ≤ t _f < t ₂
(v ₂ ≤v _f < v ₁ ) reference a ₂ t ₂ ≤ t _f < t ₃
(v ₃ ≤v _f <v ₂ ) reference a ₃ ... ... Step n t _f < t ₁
(v ₁ < v _f ) reference b ₁ t ₁ ≤ t _f < t ₂
(v ₂ ≤v _f < v ₁ ) reference b ₂ t ₂ ≤ t _f < t ₃
(v ₃ ≤v _f <v ₂ ) reference b ₃ ... ...

In Table 1, "changed form" is the final form of the electronic device 101 (eg, the current form after the change) in which the form of the electronic device 101 is changed, and "shape change time" is the electronic device 101 . is the time at which the shape is changed, the "shape change speed" is the speed at which the shape of the electronic device 101 is changed, and the "noise data" may represent pre-stored reference data used in noise processing. For example, the “shape change time” refers to a time when an electrical signal (eg, a first signal) is received from the sensor 203 when the electronic device 101 is in a previous shape, and It may be a difference value between when an electrical signal (eg, a second signal) is received from the sensor 203 in the current form (eg, a form changed from the previous form). For example, the “shape change speed” may be a value proportional to the reciprocal of the “shape change time”. Referring to Table 1, during noise processing on the first audio data, different noise data (eg, reference data) may be identified according to the changed shape of the electronic device 101 and/or the time when the shape of the electronic device 101 is changed. can According to an embodiment, the noise data (eg, reference data) used in noise processing for the first audio data is the changed shape of the electronic device 101 or the time when the shape of the electronic device 101 is changed. It may be based on only one of them. For example, irrespective of the time when the shape of the electronic device 101 is changed, different noise data may be used according to the changed shape of the electronic device 101 . For example, irrespective of the changed shape of the electronic device 101 , different noise data may be used according to the changed time of the electronic device 101 .

2B is a block diagram illustrating components included in the electronic device 101 according to various embodiments of the present disclosure. Hereinafter, portions overlapping with those described in FIG. 2A will be omitted.

According to various embodiments, the electronic device 101 includes a microphone 201 (eg, the input module 150 of FIG. 1 ), an audio module 170 , and a sensor 203 (eg, the sensor module of FIG. 1 ) 176)), a memory 130 and/or an application processor (AP) 211 (eg, the main processor 121 of FIG. 1 ).

According to various embodiments, the memory 130 may be included in the audio module 170 . According to an embodiment, the memory 130 may not be included in the audio module 170 (eg, it may be externally disposed or included in the AP 211 ).

According to various embodiments, the audio module 170 may include an A/D converter 205 , a DSP 207 and/or a buffer 209 (eg, the volatile memory 132 of FIG. 1 ). .

According to various embodiments, the A/D converter 205 may convert an audio signal received from the microphone 201 into a digital signal (eg, audio data). For example, the audio data may include data in the form of pulse coded modulation (PCM).

According to various embodiments, the DSP 207 may perform at least some of the operations of the processor 120 described with reference to FIG. 2A . For example, the DSP 207 may receive an electrical signal from the sensor 203 and check whether the shape of the electronic device 101 is changed based on the received electrical signal. For example, the DSP 207 may identify the time and/or speed at which the shape of the electronic device 101 is changed based on the electrical signals received from the sensor 203 . For example, the DSP 207 receives the first audio data (in other words, raw data) from the A/D converter 205 , and provides the first audio data to the AP 211 , or a memory Using the noise data stored in the 130 , data (eg, second audio data) based on the first audio data may be obtained and provided to the AP 211 . As an example, the DSP 207 temporarily stores the first audio data and/or the second audio data in the buffer 209, and then the buffer 213 of the AP 211 (eg, the volatile memory ( 132)) can be provided. According to various embodiments, the AP 211 may include an application layer, an audio hardware abstraction layer (HAL) and/or a kernel, and the above-described DSP 207 is the first Providing the audio data and/or the second audio data to the AP 211 (eg, the buffer 213 ) may include providing the first audio data and/or the second audio data to the audio HAL. According to various serial examples, the DSP 207 provides the first audio data to the AP 211 (eg, the buffer 213) without performing noise processing based on the noise data (eg, reference data stored in advance). This may be described as bypassing the first audio data to the AP 211 (eg, the buffer 213).

According to various embodiments, the AP 211 may perform at least some of the operations of the processor 120 described with reference to FIG. 2A . For example, the AP 211 may provide the first audio data and/or the second audio data provided from the DSP 207 and stored in the buffer 213 to the running application.

3A, 3B, and 3C illustrate a foldable electronic device 101 as an example of the electronic device 101 according to various embodiments of the present disclosure. 3A is a diagram illustrating an unfolded state of the electronic device 101 according to various embodiments of the present disclosure. 3B is a diagram illustrating a folded state of the electronic device 101 according to various embodiments of the present disclosure. 3C is an exploded perspective view of the electronic device 101 according to various embodiments of the present disclosure.

3A and 3B , in an embodiment, the electronic device 101 includes a foldable housing 300 , a hinge cover 330 covering a foldable portion of the foldable housing 300 , and the includes a flexible or foldable display 305 (hereinafter, abbreviated as “display” 305 ) (eg, the display module 160 of FIG. 1 ) disposed within the space defined by the foldable housing 300 . can do. According to an embodiment, the surface on which the display 305 is disposed (or the surface on which the display 305 is viewed from the outside of the electronic device 101 ) may be defined as the front surface of the electronic device 101 . In addition, the opposite surface of the front surface may be defined as the rear surface of the electronic device 101 . Also, a surface surrounding the space between the front surface and the rear surface may be defined as a side surface of the electronic device 101 .

According to various embodiments, the foldable housing 300 includes a first housing structure 310 , a second housing structure 320 including a sensor region 324 , a first rear cover 380 , and a second rear surface. It may include a cover 390 and a hinge structure (eg, the hinge structure 325 of FIG. 3C ). The foldable housing 300 of the electronic device 101 is not limited to the shape and combination shown in FIGS. 3A and 3B , and may be implemented by a combination and/or combination of other shapes or parts. For example, in another embodiment, the first housing structure 310 and the first rear cover 380 may be integrally formed, and the second housing structure 320 and the second rear cover 390 may be integrally formed. can be formed.

According to various embodiments, the first housing structure 310 is connected to a hinge structure (eg, the hinge structure 325 of FIG. 3C ), and has a first surface facing a first direction (eg, the first surface of FIG. 3C ). surface 311), and a second surface (eg, the second surface 312 of FIG. 3C ) facing in a second direction opposite to the first direction. The second housing structure 320 is connected to the hinge structure 325 and has a third surface facing a third direction (eg, the third surface 321 of FIG. 3C ), and a fourth surface opposite to the third direction. a fourth face (e.g., fourth face 322 in FIG. 3C) facing in the direction, and is attached to the first housing structure 310 about the hinge structure 325 (e.g., folding axis A). can rotate about The electronic device 101 may change to a folded state or an unfolded state, which will be described later with reference to FIG. 3C . Here, the direction may mean a direction parallel to the surface or a direction normal to the surface.

According to an embodiment, the first side of the electronic device 101 may face the third side in a fully folded state, and in a fully unfolded state, the third direction is substantially equal to the first direction. can be the same as

According to various embodiments, the first housing structure 310 and the second housing structure 320 may be disposed on both sides about the folding axis A, and may have an overall symmetrical shape with respect to the folding axis A. As will be described later, the first housing structure 310 and the second housing structure 320 may determine whether the electronic device 101 is in an unfolded state, a folded state, or partially unfolded (or The angle or distance formed from each other may vary depending on whether or not they are in an intermediate status (partially folded). According to an embodiment, the second housing structure 320, unlike the first housing structure 310, further includes a sensor area 324 in which various sensors are disposed, but has a mutually symmetrical shape in other areas. can have

According to various embodiments, as shown in FIG. 3A , the first housing structure 310 and the second housing structure 320 may together form a recess for receiving the display 305 . According to one embodiment, due to the sensor area 324 , the recess may have at least two different widths in a direction perpendicular to the folding axis A.

According to an embodiment, the recess is formed at the edge of the first portion 310a parallel to the folding axis A of the first housing structure 310 and the sensor region 324 of the second housing structure 320 . The recess may have a first width w1 between the first portion 320a , the second portion 310b of the first housing structure 310 and the sensor area 324 of the second housing structure 320 . ) and may have a second width w2 formed by the second portion 320b parallel to the folding axis A. In this case, the second width w2 may be formed to be longer than the first width w1. As another example, the first portion 310a of the first housing structure 310 and the first portion 320a of the second housing structure 320 having a mutually asymmetric shape form a first width w1 of the recess. and the second portion 310b of the first housing structure 310 having a mutually symmetrical shape and the second portion 320b of the second housing structure 320 may form a second width w2 of the recess. have. According to an embodiment, the distance from the folding axis A of the first part 320a and the second part 320b of the second housing structure 320 may be different from each other. The width of the recess is not limited to the illustrated example. In another embodiment, the recess may have a plurality of widths due to the shape of the sensor region 324 or the portion having the asymmetric shape of the first housing structure 310 and the second housing structure 320 .

According to various embodiments, at least a portion of the first housing structure 310 and the second housing structure 320 may be formed of a metallic material or a non-metallic material having a selected size of rigidity to support the display 305 . . At least a portion formed of a metal material may provide a ground plane of the electronic device 101, and may be electrically connected to a ground line formed on a printed circuit board (eg, the substrate part 335 of FIG. 3C ). can be connected to

According to various embodiments, the sensor area 324 may be formed to have a predetermined area adjacent to one corner of the second housing structure 320 . However, the arrangement, shape, and size of the sensor area 324 are not limited to the illustrated example. For example, in other embodiments, the sensor area 324 may be provided at another corner of the second housing structure 320 or any area between the top and bottom corners. In an embodiment, components for performing various functions embedded in the electronic device 101 are electronically provided through the sensor area 324 or through one or more openings provided in the sensor area 324 . Exposed, ie, visible, on the front side of the device 101 . In various embodiments, the components may include various types of sensors. The sensor may include, for example, at least one of a front camera, a receiver, or a proximity sensor.

According to various embodiments, the first rear cover 380 is disposed on one side of the folding axis A on the rear surface of the electronic device 101 and may have, for example, a substantially rectangular periphery. , an edge may be surrounded by the first housing structure 310 . Similarly, the second rear cover 390 may be disposed on the other side of the folding axis A of the rear surface of the electronic device 101 , and an edge thereof may be surrounded by the second housing structure 320 .

According to various embodiments, the first rear cover 380 and the second rear cover 390 may have a substantially symmetrical shape with respect to the folding axis A. However, the first back cover 380 and the second back cover 390 do not necessarily have symmetrical shapes, and in another embodiment, the electronic device 101 includes the first back cover 380 and the A second rear cover 390 may be included. In another embodiment, the first back cover 380 may be integrally formed with the first housing structure 310 , and the second rear cover 390 may be integrally formed with the second housing structure 320 . have.

According to various embodiments, the first back cover 380 , the second back cover 390 , the first housing structure 310 , and the second housing structure 320 may include various components ( For example, a printed circuit board, or a battery) may form a space in which it can be placed. According to an embodiment, one or more components may be disposed or visually exposed on the rear surface of the electronic device 101 . For example, at least a portion of the sub-display may be visually exposed, that is, viewed through the first rear region 382 of the first rear cover 380 . In another embodiment, one or more components or sensors may be visually exposed through the second back area 392 of the second back cover 390 . In various embodiments, the sensor may include a proximity sensor and/or a rear camera.

According to various embodiments, the second rear region 392 of the front camera or the second rear cover 390 exposed to the front of the electronic device 101 through one or more openings provided in the sensor region 324 . The rear-facing camera exposed through may include one or a plurality of lenses, an image sensor, and/or an image signal processor. The flash may include, for example, a light emitting diode or a xenon lamp. In some embodiments, two or more lenses (eg, infrared cameras, wide-angle and telephoto lenses) and image sensors may be disposed on one side of the electronic device 101 .

Referring to FIG. 3B , the hinge cover 330 may be disposed between the first housing structure 310 and the second housing structure 320 to cover internal components (eg, the hinge structure 325 of FIG. 3C ). It can be configured to According to an embodiment, the hinge cover 330 includes a first housing structure ( 310) and a portion of the second housing structure 320 may cover or may be exposed to the outside.

According to an embodiment, as shown in FIG. 3A , when the electronic device 101 is in an unfolded state (eg, a fully unfolded state), the hinge cover 330 includes the first housing structure 310 . And it may not be exposed by being covered by the second housing structure 320 . As another example, as shown in FIG. 3B , when the electronic device 101 is in a folded state (eg, in a fully folded state), the hinge cover 330 includes the first housing structure 310 and the second housing structure 310 . It may be exposed to the outside between the two housing structures 320 . As another example, when the first housing structure 310 and the second housing structure 320 are in an intermediate status that is folded with a certain angle, the hinge cover 330 is the first housing A portion of the structure 310 and the second housing structure 320 may be exposed to the outside. However, in this case, the exposed area may be smaller than in the fully folded state. In one embodiment, the hinge cover 330 may include a curved surface.

According to various embodiments, the display 305 may be disposed on a space formed by the foldable housing 300 . For example, the display 305 is seated on a recess formed by the foldable housing 300 and can be viewed from the outside through the front surface of the electronic device 101 . For example, the display 305 may constitute most of the front surface of the electronic device 101 . Accordingly, the front surface of the electronic device 101 may include a display 305 and a partial region of the first housing structure 310 and a partial region of the second housing structure 320 adjacent to the display 305 . In addition, the rear surface of the electronic device 101 has a first rear cover 380 , a partial region of the first housing structure 310 adjacent to the first rear cover 380 , a second rear cover 390 , and a second rear cover a portion of the second housing structure 320 adjacent to 390 .

According to various embodiments, the display 305 may refer to a display in which at least a portion of the area can be transformed into a flat surface or a curved surface. According to an embodiment, the display 305 has a folding area 305c and a first area 305a disposed on one side (eg, the left side of the folding area 305c shown in FIG. 3A ) with respect to the folding area 305c. and a second region 305b disposed on the other side (eg, the right side of the folding region 305c illustrated in FIG. 3A ).

However, the region division of the display 305 illustrated in FIG. 3A is exemplary, and the display 305 may be divided into a plurality (eg, four or more or two) regions according to a structure or function. For example, in the embodiment shown in FIG. 3A , the region of the display 305 may be divided by the folding region 305c extending parallel to the y-axis or the folding axis (A-axis), but in another embodiment, the display Regions 305 may be divided based on another folding region (eg, a folding region parallel to the x-axis) or another folding axis (eg, a folding axis parallel to the x-axis).

According to various embodiments, the first area 305a and the second area 305b may have an overall symmetrical shape with respect to the folding area 305c. However, unlike the first region 305a , the second region 305b may include a notch cut according to the presence of the sensor region 324 , but in other regions, the first region (305a) and may have a symmetrical shape. In other words, the first region 305a and the second region 305b may include a portion having a shape symmetric to each other and a portion having a shape asymmetric to each other.

Hereinafter, the first housing structure 310 and the second housing structure 320 according to a state (eg, a folded status, an unfolded status, or an intermediate status) of the electronic device 101 ) ) and each area of the display 305 will be described.

According to various embodiments, when the electronic device 101 is in an unfolded state (eg, FIG. 3A ), the first housing structure 310 and the second housing structure 320 form an angle of 180 degrees and are the same It may be arranged to face the direction. The surface of the first area 305a and the surface of the second area 305b of the display 305 may form 180 degrees with each other and may face the same direction (eg, the front direction of the electronic device). The folding area 305c may be substantially coplanar with the first area 305a and the second area 305b.

According to various embodiments, when the electronic device 101 is in a folded state (eg, FIG. 3B ), the first housing structure 310 and the second housing structure 320 may be disposed to face each other. have. The surface of the first area 305a and the surface of the second area 305b of the display 305 may face each other while forming a narrow angle (eg, between 0 degrees and 10 degrees). At least a portion of the folding area 305c may be formed of a curved surface having a predetermined curvature.

According to various embodiments, when the electronic device 101 is in an intermediate status, the first housing structure 310 and the second housing structure 320 may be disposed at a certain angle. can The surface of the first area 305a and the surface of the second area 305b of the display 305 may form an angle greater than that in the folded state and smaller than that in the unfolded state. At least a portion of the folding area 305c may be formed of a curved surface having a predetermined curvature, and in this case, the curvature may be smaller than that in a folded state.

Referring to FIG. 3C , an exploded perspective view of the electronic device 101 is shown, according to various embodiments of the present disclosure. In various embodiments, the electronic device 101 may include a foldable housing 300 , a display 305 , and a substrate 335 . The foldable housing includes a first housing structure 310 , a second housing structure 320 , a bracket assembly 315 , a first rear cover 380 and a second rear cover 390 , and a hinge structure 325 . may include

According to various embodiments, the display 305 may include a display panel (eg, a flexible display panel) and one or more plates or layers on which the display panel is mounted. In an embodiment, the support plate may be disposed between the display panel and the bracket assembly 315 . An adhesive structure (not shown) may be positioned between the support plate and the bracket assembly 315 to bond the support plate and the bracket assembly 315 to each other.

According to various embodiments, the bracket assembly 315 may include a first bracket assembly 315a and a second bracket assembly 315b. A hinge structure 325 is disposed between the first bracket assembly 315a and the second bracket assembly 315b, and when the hinge structure 325 is viewed from the outside, the hinge cover 330 covers the hinge structure 325 . can be placed. As another example, a printed circuit board (eg, a flexible circuit board (FPC) or a flexible printed circuit) may be disposed to cross the first bracket assembly 315a and the second bracket assembly 315b.

According to various embodiments, the board part 335 may include a first main circuit board 335a disposed on the first bracket assembly 315a side and a second main circuit board disposed on the second bracket assembly 315b side. (335b). The first main circuit board 335a and the second main circuit board 335b include a bracket assembly 315 , a first housing structure 310 , a second housing structure 320 , a first back cover 380 and a second 2 It may be disposed inside the space formed by the rear cover 390 . Components for implementing various functions of the electronic device 101 may be mounted on the first main circuit board 335a and the second main circuit board 335b.

According to various embodiments, the first housing structure 310 and the second housing structure 320 are coupled to both sides of the bracket assembly 315 while the display 305 is coupled to the bracket assembly 315 to each other. can be assembled. For example, the first housing structure 310 and the second housing structure 320 may be coupled to the bracket assembly 315 by sliding from both sides of the bracket assembly 315 .

According to one embodiment, the first housing structure 310 includes a first surface 311 , a second surface 312 facing in a direction opposite to the first surface 311 , and the second housing structure 320 includes: A third surface 321 may include a fourth surface 322 facing in a direction opposite to the third surface 321 . According to an embodiment, the first housing structure 310 may include a first rotational support surface 313 , and the second housing structure 320 may have a second rotation corresponding to the first rotational support surface 313 . It may include a support surface 323 . The first rotation support surface 313 and the second rotation support surface 323 may include curved surfaces corresponding to the curved surfaces included in the hinge cover 330 .

According to an embodiment, when the electronic device 101 is in an unfolded state (eg, the electronic device of FIG. 3A ), the first rotational support surface 313 and the second rotational support surface 323 include the hinge cover 330 . The hinge cover 330 may not be exposed to the rear side of the electronic device 101 or may be minimally exposed. As another example, when the electronic device 101 is in a folded state (eg, the electronic device 101 of FIG. 3B ), the first rotational support surface 313 and the second rotational support surface 323 may include a hinge cover 330 . ), the hinge cover 330 may be maximally exposed to the rear surface of the electronic device 101 by rotating along the curved surface included in the .

4A and 4B illustrate a rollable type electronic device 101 as an example of the electronic device 101 according to various embodiments of the present disclosure. 4A is a 6-sectional view illustrating a state in which the second housing 402 is accommodated in the electronic device 101 according to various embodiments of the present disclosure. 4B is a 6-sectional view illustrating a state in which the second housing 402 is withdrawn from the electronic device 101 according to various embodiments of the present disclosure.

4A and 4B , the electronic device 101 includes a first housing 401 , a second housing 402 slidably coupled to the first housing 401 , and/or a flexible display 403 . may include The second housing 402 may slide and reciprocate in one direction (eg, in the X-axis direction) between the positions where it is withdrawn by sliding by a specified distance from the position accommodated in the first housing 401 . In some embodiments, the direction in which the second housing 402 linearly reciprocates may be defined as a longitudinal direction (eg, Y-axis direction) or a width direction (eg, X-axis direction) of the electronic device 101 , which The electronic device 101 may be arbitrarily defined according to an arrangement or arrangement direction. In the following detailed description, the state shown in FIG. 4A may be referred to as a 'storage position', and the state shown in FIG. 4B may be referred to as a 'take-out position'. In some embodiments, the state shown in FIG. 4A may be referred to as a 'closed state' and the state shown in FIG. 4B may be referred to as an 'open state'.

According to various embodiments, the first housing 401 may be referred to as a main housing, a first slide unit, or a first slide housing, and both sides (eg, - The surface facing the Y direction and the surface facing the +Y direction) may be coupled to surround. In some embodiments, the first housing 401 may have a structure that further surrounds another side surface (eg, a surface facing the -X direction) of the second housing 402 , and the second housing 402 is the first housing 402 . It can be withdrawn from the first housing 401 by sliding in the +X direction while being accommodated in the 401 . Some electrical/electronic components (eg, the camera module 449) may be accommodated inside the first housing 401 , and generally, the inner space of the first housing 401 accommodates the second housing 402 . It can be used as a space for

According to various embodiments, the first housing 401 includes a rear plate 413a, a first sidewall 413b extending from the rear plate 413a, and a first sidewall 413b extending from the rear plate 413a. It may include a second sidewall 413c disposed substantially parallel to and a third sidewall 413d extending from the rear plate 413a and connecting the first sidewall 413b and the second sidewall 413c. The rear plate 413a, the first sidewall 413b, the second sidewall 413c, and/or the third sidewall 413d are the corresponding outer surfaces (eg, the rear surface and/or the sidewalls) of the second housing 402, respectively. ) may be arranged to face each other. For example, the back plate 413a, the first sidewall 413b, the second sidewall 413c, and/or the third sidewall 413d may define a space to substantially receive the second housing 402 and , a surface of the first housing 401 facing the +X direction and/or a surface facing the front of the electronic device 101 may be substantially open. In some embodiments, the second housing 402 may be interpreted as sliding relative to the first housing 401 substantially guided by the first sidewall 413b and the second sidewall 413c.

According to various embodiments, the second housing 402 may be referred to as a sub-housing, a second slide unit, or a second slide housing, and is coupled to the first housing 401 in the receiving position of FIG. 4A and FIG. 4B . Linear reciprocating motion between withdrawal positions is possible. Although not shown, in the inner space of the second housing 402 , the main circuit board, the battery 189 and/or the sensor module 176 on which hardware such as the processor 120 or the communication module 190 of FIG. 1 are mounted. Electrical/electronic components such as can be accommodated. In some embodiments, the electronic device 101 includes a rack gear 443 disposed on the first housing 401 and a pinion gear rotatably disposed on the second housing 402 . ) (not shown) may be further included, and as the pinion gear (not shown) rotates in engagement with the rack gear 443 , the second housing 402 may slide with respect to the first housing 401 . According to one embodiment, in the receiving position, the second housing 402 may be substantially accommodated in the first housing 401 with the side facing the +X direction exposed to the outside. In another embodiment, in the withdrawal position, the rear surface of the second housing 402 , the surface facing the -Y direction, and/or the surface facing the +Y direction may be substantially exposed to the outside.

According to various embodiments, the flexible display 403 may include a first area A1 and a second area A2 extending from the first area A1, and may include a touch sensing circuit, a touch intensity ( pressure), and/or a digitizer that detects a magnetic field type stylus pen may be coupled to or disposed adjacent to the pressure sensor. In an embodiment, the first area A1 may be disposed in the first housing 401 to output a screen toward the front of the electronic device 101 . In some embodiments, the receiving space of the first housing 401 may be defined, at least in part, by the flexible display 403 . For example, in the accommodated position, the second housing 402 may be accommodated in a space between the rear plate 413a and the flexible display 403 (eg, the first area A1 ). In one embodiment, the second area A2 is disposed substantially on the second housing 402 , and is accommodated in or received inside the second housing 402 according to the sliding movement of the second housing 402 . It may be exposed to the outside of 402 . For example, the second area A2 is accommodated in the interior of the second housing 402 in the stowed position and is at least partially disposed to face a direction opposite to the first area A1, and is disposed to face the opposite direction to the first area A1 in the withdrawal position. It may be exposed to the outside of the 402 and disposed side by side on one side of the first area A1 .

According to various embodiments, in the second area A2 , a portion accommodated inside the second housing 402 and/or exposed to the outside of the second housing 402 are parallel to one side of the first area A1 . The portion positioned to be substantially flat along with the first area A2 may be maintained. In another embodiment, in the operation accommodated inside the second housing 402 or exposed to the outside, the second area A2 moves at the edge of the second housing 402 while being guided by a guide roller and/or or may be modified. For example, the second area A2 is accommodated in the interior of the second housing 402 while being guided by a guide roller (not shown) and/or a portion corresponding to the guide roller (not shown) is deformed into a curved shape. or may be exposed to the outside world. According to various embodiments, the pinion gear (not shown) or the guide roller (not shown) is a sensor module (eg, an angle sensor) capable of determining the rotation angle of the pinion gear (not shown) or the guide roller (not shown) may further include. Through a sensor module (eg, an angle sensor) according to an embodiment, the processor (eg, the processor 120 of FIG. 1 ) may identify the angle at which the pinion gear (not shown) or the guide roller (not shown) is rotated, , by using the identified angle, it is possible to determine the extent to which the flexible display (eg, the display module 160 of FIG. 1 ) is expanded (eg, the size of the display area). For example, when the rotation angle of the sensor module (eg, angle sensor) is 180 degrees, the processor 120 according to an embodiment determines that 50% of the expandable flexible display area (or area) is expanded. can do. According to various embodiments, the movement of the second area A2 while being guided by a guide roller (not shown) may be linked to the sliding movement of the second housing 402 . For example, when the second housing 402 is accommodated in the interior of the first housing 401 , the second area A2 is gradually accommodated in the interior of the second housing 402 , and When drawn out of the first housing 401 , the second area A2 may be gradually exposed to the outside of the second housing 402 . In one embodiment, while the second housing 402 slides, a portion (eg, a contact portion) corresponding to a guide roller (not shown) in the second area A2 may be deformed into a curved shape. The electronic device 101 may further include a multi-joint hinge structure to guide the flexible display 403 , for example, supporting the second area A2 in a flat shape or deforming it into a curved shape.

According to various embodiments, at least a portion of the second area A2 is accommodated in the second housing 402 with an arbitrary position adjacent to the guide roller (not shown) as a boundary, or is a portion of the second housing 402 . can be exposed to the outside. In one embodiment, the second area A2 is not activated in a state accommodated inside the second housing 402 , and a portion (eg, in a state exposed or partially exposed to the outside of the second housing 402 ) is not activated. : part exposed to the outside) can be activated. In some embodiments, the second area A2 may be gradually deactivated in the operation of being accommodated inside the second housing 402 , and the second area A2 may be gradually activated in the operation of being exposed to the outside. "Gradually deactivated or activated" means that a portion of the second area A2 accommodated inside the second housing 402 is deactivated, and a portion exposed outside the second housing 402 is activated. can In another embodiment, a part of the flexible display 403 (eg, the second area A2) is gradually moved to the second housing ( It may be accommodated in the interior of the 402 or may be exposed to the outside of the second housing 402 . In another embodiment, a portion of the flexible display 403 (eg, the second area A2) is gradually moved to the second housing while the second area A2 and/or the entire first area A1 are inactivated. It may be accommodated in the interior of the 402 or exposed to the outside of the second housing 402 .

According to various embodiments, the electronic device 101 further includes a key input device 441 , a connector hole (not shown), audio modules 445a , 445b , 447a , 447b , and/or a camera module 449 . can do. Although not shown, the electronic device 101 may further include an indicator (eg, an LED device) and/or various sensor modules.

According to various embodiments, the key input device 441 may be disposed on at least one of the first sidewall 413b, the second sidewall 413c, and/or the third sidewall 413d of the first housing 401 . have. Depending on the appearance and usage state, the illustrated key input device 441 may be omitted or the electronic device 101 may be designed to include an additional key input device. The electronic device 101 may include a key input device (not shown), for example, a home key or a touch pad disposed around the home key. According to another embodiment, at least a portion of the key input device 441 may be located in one area of the first housing 401 and/or the second housing 402 .

According to various embodiments, the connector hole (not shown) includes a connector (eg, a USB connector) for transmitting and receiving power and/or data to and from an external electronic device (eg, the electronic devices 102 and 104 of FIG. 1 ). can be accepted The connector hole may be formed in one or a plurality, and may be formed in at least one of the first sidewall 413b, the second sidewall 413c, or the third sidewall 413d. According to an embodiment, the electronic device 101 may not include a connector hole, and in this case, the electronic device 101 may wirelessly transmit/receive power and/or data to/from an external electronic device.

According to various embodiments, the audio modules 445a, 445b, 447a, and 447b may include speaker holes 445a and 445b or microphone holes 447a and 447b. One of the speaker holes 445a and 445b (eg, the speaker hole indicated by the reference number '445b') may serve as a receiver hole for voice calls, and the other (eg the speaker hole indicated by the reference number '445a') may be provided. ) may be provided as an external speaker hole. A microphone for acquiring an external sound may be disposed inside the microphone holes 447a and 447b, and in some embodiments, a plurality of microphones may be disposed to detect the direction of the sound. In some embodiments, the speaker holes 445a and 445b and the microphone holes 447a and 447b may be implemented as a single hole, or a speaker may be included without the speaker holes 445a and 445b (eg, a piezo speaker). According to an embodiment, the speaker holes 445a and 445b or the microphone holes 447a and 447b may be disposed in the first housing 401 and/or the second housing 402 .

The camera module 449 is provided in the first housing 401 and may photograph a subject while oriented in a direction opposite to the first area A1 of the flexible display 403 . The electronic device 101 and/or the camera module 449 may include a plurality of cameras. For example, the electronic device 101 and/or the camera module 449 may include a wide-angle camera, a telephoto camera, or a close-up camera, and according to an embodiment, an infrared projector and/or an infrared receiver to reach a subject by including an infrared projector and/or an infrared receiver. distance can be measured. The camera module 449 may include one or more lenses, an image sensor and/or an image signal processor. Although not shown, the electronic device 101 may further include a camera module (eg, a front camera) for photographing a subject while oriented in the same direction as the first area A1 of the flexible display 403 . For example, the front camera may be disposed around the first area A1 or in an area overlapping the flexible display 403 , and when disposed in an area overlapping the flexible display 403 , the flexible display 403 . The subject can be photographed through the

According to various embodiments, an indicator (not shown) of the electronic device 101 may be disposed in the first housing 401 or the second housing 402 , and the state of the electronic device 101 by including a light emitting diode Information can be presented as visual cues. A sensor module (not shown) of the electronic device 101 (eg, the sensor module 176 of FIG. 1 ) has an electrical signal or data value corresponding to an internal operating state of the electronic device 101 or an external environmental state. can create The sensor module may include, for example, a proximity sensor, a fingerprint sensor, or a biometric sensor (eg, an iris/face recognition sensor or an HRM sensor). In another embodiment, the sensor module is, for example, one of a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a temperature sensor, a humidity sensor, or an illuminance sensor. It may further include at least one.

In describing the embodiments of the present disclosure, a foldable type electronic device (eg, the electronic device 101 illustrated in FIGS. 3A to 3C ) or a rollable type electronic device (eg, illustrated in FIGS. 4A and 4B ) is described. In addition to the electronic device 101), it can be applied to a swivel-type electronic device and/or a slideable-type electronic device, and if the electronic device can change the shape of the electronic device, the embodiments described in the present disclosure can be applied. have. Meanwhile, the structure of the electronic device 101 illustrated in FIGS. 3A to 3C or FIGS. 4A and 4B is exemplary, and foldable or rollable electronic devices having various structures will be described in the present disclosure. It can be applied to the embodiments.

5A illustrates a change in the shape of the foldable electronic device 101 (eg, the electronic device 101 illustrated in FIGS. 3A, 3B, and/or 3C) according to various embodiments of the present disclosure; It is a drawing for

According to various embodiments, the electronic device 101 includes a first housing 501 (eg, the first housing structure 310 ) and a second housing 503 (eg, the second housing structure 320 ). may include According to various embodiments, a display ( Example: The display 305 of FIGS. 3A and/or 3B may be disposed.

The shape of the electronic device 101 in “Step 1” is, for example, in a state where the angle between the first housing 501 and the second housing 503 is 0° (or a value substantially close to 0°). For example, it may be described as a 'fully folded state' (or a 'folded state').

The shape of the electronic device 101 in "Step 2" to "Step (n-1)" is in a state where the angle between the first housing 501 and the second housing 503 is greater than 0° and less than 180°, For example, it may be described as an 'intermediate state'. As the value of Step increases, the angle between the first housing 501 and the second housing 503 may be large.

The shape of the electronic device 101 in “Step n” is, for example, in a state where the angle between the first housing 501 and the second housing 503 is 180° (or a value substantially close to 180°), for example, For example, it may be described as a 'fully unfolded state' (or an 'unfolded state').

According to various embodiments, the first housing 501 or the second housing 503 may be rotated about one axis (eg, the folding axis A of FIGS. 3A and/or 3B ), which Through this, the shape of the electronic device 101 may be changed. For example, the shape of the electronic device 101 is gradually changed from any one of "Step 1" to "Step (n-1)" to "Step n", or "Step 2" to "Step n" When one step is gradually changed to “Step 1”, it may be described that the shape of the electronic device 101 is changed.

According to various embodiments, when the shape of the electronic device 101 is changed to a shape corresponding to any one of the steps described above, from at least one sensor (eg, the sensor 203 of FIG. 2 ), the electronic device ( An electrical signal corresponding to the changed shape of 101 ) may be transmitted to a processor (eg, the processor 120 of FIG. 1 ).

According to various embodiments, when the shape of the electronic device 101 is changed to “Step 1” or “Step n”, an impact between the first housing 501 and the second housing 503 (or other various impact between structures), an impact sound may occur.

FIG. 5B is a diagram for explaining a change in the shape of the rollable type electronic device 101 (eg, the electronic device 101 illustrated in FIGS. 4A and/or 4B ), according to various embodiments of the present disclosure; to be.

According to various embodiments, the electronic device 101 may include a first housing 501 (eg, a first housing 401 ) and a second housing 503 (eg, a second housing 402 ). can According to various embodiments, on one surface (eg, the surface facing the front of FIG. 5B ) of the first housing 501 and/or the second housing 503 (eg, the flexible display of FIGS. 4A and/or 4B ) A display 403 may be disposed. Referring to FIG. 5B , the 'hatched area' is a portion in which the area exposed to the outside increases as the display expands based on the area exposed to the outside of the display (eg, the flexible display 403) in "Step 1" indicates

The shape of the electronic device 101 in "Step 1" may be described as a state in which the second housing 503 is maximally accommodated in the first housing 501, for example, as a 'closed state'.

The shape of the electronic device 101 in "Step 2" to "Step (n-1)" is a state in which the second housing 503 is partially accommodated in the first housing 501 (eg, a 'closed state'). (a state in which the second housing 503 is drawn out by a certain portion), for example, may be described as an 'intermediate state'. As the value of Step increases, the distance at which the second housing 503 is drawn out from the first housing 501 may be large.

The shape of the electronic device 101 in “Step n” may be described as a state in which the second housing 503 is maximally drawn out to the first housing 501 , for example, an 'open state'.

According to various embodiments, the first housing 501 or the second housing 503 may be moved in a linear direction (eg, the horizontal direction of FIG. 5B ), and through this, the shape of the electronic device 101 is changed. can be changed. For example, the shape of the electronic device 101 is gradually changed from any one of "Step 1" to "Step (n-1)" to "Step n", or "Step 2" to "Step n" When one step is gradually changed to “Step 1”, it may be described that the shape of the electronic device 101 is changed.

According to various embodiments, when the shape of the electronic device 101 is changed to a shape corresponding to any one of the steps described above, from at least one sensor (eg, the sensor 203 of FIG. 2 ), the electronic device ( An electrical signal corresponding to the changed shape of 101 ) may be transmitted to a processor (eg, the processor 120 of FIG. 1 ).

According to various embodiments, when the shape of the electronic device 101 is changed to “Step 1” or “Step n”, an impact between the first housing 501 and the second housing 503 (or other various impact between structures), an impact sound may occur.

FIG. 5C is a diagram for explaining a state in which the shape of the swivel-type electronic device 101 is changed, according to various embodiments of the present disclosure.

According to various embodiments, the electronic device 101 may include a first housing 501 and a second housing 503 . According to various embodiments, a display (eg, the display module 160 of FIG. 1 ) on one surface (eg, the surface facing the front of FIG. 5C ) of the first housing 501 and/or the second housing 503 ) can be placed.

The shape of the electronic device 101 in “Step 1” is, for example, in a state where the angle between the first housing 501 and the second housing 503 is 0° (or a value substantially close to 0°). For example, it may be described as a 'closed state'.

The shape of the electronic device 101 in "Step 2" to "Step (n-1)" is in a state where the angle between the first housing 501 and the second housing 503 is greater than 0° and less than 90°, For example, it may be described as an 'intermediate state'. As the value of Step increases, the angle between the first housing 501 and the second housing 503 may be large.

The shape of the electronic device 101 in “Step n” is, for example, in a state where the angle between the first housing 501 and the second housing 503 is 90° (or a value substantially close to 90°), for example, For example, it may be described as an 'open state'.

According to various embodiments, the first housing 501 or the second housing 503 is based on one axis (eg, a point of an upper portion of the first housing 501 or the second housing 503 ). It may be rotated, and through this, the shape of the electronic device 101 may be changed. For example, the shape of the electronic device 101 is gradually changed from any one of "Step 1" to "Step (n-1)" to "Step n", or "Step 2" to "Step n" When one step is gradually changed to “Step 1”, it may be described that the shape of the electronic device 101 is changed.

According to various embodiments, when the shape of the electronic device 101 is changed to a shape corresponding to any one of the steps described above, from at least one sensor (eg, the sensor 203 of FIG. 2 ), the electronic device ( An electrical signal corresponding to the changed shape of 101 ) may be transmitted to a processor (eg, the processor 120 of FIG. 1 ).

According to various embodiments, when the shape of the electronic device 101 is changed to “Step 1” or “Step n”, an impact between the first housing 501 and the second housing 503 (or other various impact between structures), an impact sound may occur.

FIG. 5D is a diagram for explaining a state in which the shape of the slideable type electronic device 101 is changed according to various embodiments of the present disclosure.

According to various embodiments, the electronic device 101 may include a first housing 501 and a second housing 503 . According to various embodiments, a display (eg, the display module 160 of FIG. 1 ) is provided on one surface (eg, the surface facing upward in FIG. 5D ) of the first housing 501 and/or the second housing 503 . ) can be placed.

The shape of the electronic device 101 in "Step 1" may be described as a state in which the second housing 503 maximally overlaps the first housing 501, for example, a 'closed state'.

The shape of the electronic device 101 in "Step 2" to "Step (n-1)" is a state in which the second housing 503 overlaps a part of the first housing 501 (eg, a 'closed state') (a state in which the second housing 503 is moved by a certain distance), for example, may be described as an 'intermediate state'. As the value of Step is lower, a portion in which the second housing 503 overlaps the first housing 501 may be wide.

The shape of the electronic device 101 in “Step n” may be described as a state in which the second housing 503 is moved to the maximum with respect to the first housing 501 , for example, an ‘open state’. .

According to various embodiments, the first housing 501 or the second housing 503 may be moved in a linear direction (eg, a horizontal direction in FIG. 5D ), and through this, the shape of the electronic device 101 is changed. can be changed. For example, the shape of the electronic device 101 is gradually changed from any one of "Step 1" to "Step (n-1)" to "Step n", or "Step 2" to "Step n" When one step is gradually changed to “Step 1”, it may be described that the shape of the electronic device 101 is changed.

According to various embodiments, when the shape of the electronic device 101 is changed to a shape corresponding to any one of the steps described above, from at least one sensor (eg, the sensor 203 of FIG. 2 ), the electronic device ( An electrical signal corresponding to the changed shape of 101 ) may be transmitted to a processor (eg, the processor 120 of FIG. 1 ).

According to various embodiments, when the shape of the electronic device 101 is changed to “Step 1” or “Step n”, an impact between the first housing 501 and the second housing 503 (or other various impact between structures), an impact sound may occur.

FIG. 6 illustrates a method in which an electronic device (eg, the electronic device 101 of FIG. 1 ) performs noise processing on audio data based on a shape change of the electronic device 101, according to various embodiments of the present disclosure It is a flowchart 600 for doing this.

According to various embodiments, the electronic device 101 may acquire first audio data in operation 610 . For example, the electronic device 101 may acquire the first audio data using at least one microphone (eg, the microphone 201 of FIGS. 2A and/or 2B ).

According to various embodiments, in operation 630 , while the first audio data is being acquired, the electronic device 101 may determine that the shape of the electronic device 101 is changed. For example, the electronic device 101 may include a first housing (eg, the first housing 501 of FIGS. 5A, 5B, 5C and/or 5D) and a second housing (eg, FIG. 5A , The shape of the electronic device 101 is changed according to the relative movement (eg, rotational movement and/or linear movement) of the second housing 503 of FIGS. 5B , 5C and/or 5D (eg, FIGS. 5A and 5D ). 5b, 5c, and/or 5d step is changed from one Step to another step), from at least one sensor (eg, the sensor 203 of FIGS. An electrical signal (eg, a first signal and/or a second signal) corresponding to a shape (eg, indicating a changed shape) may be received. The electronic device 101 may confirm that the shape of the electronic device 101 is changed based on receiving an electrical signal from at least one sensor (eg, the sensor 203 ).

According to various embodiments, in operation 650 , the electronic device 101 may check the speed at which the shape of the electronic device 101 is changed. For example, the electronic device 101 may identify the speed at which the shape of the electronic device 101 is changed based on a difference between the time points at which electrical signals are received from at least one sensor (eg, the sensor 203 ). , to be described in more detail with reference to the drawings to be described later. According to various embodiments of the present disclosure, the electronic device 101, among noise data (eg, a mapping table of the form shown in Table 1) previously stored in a memory (eg, the memory 130 of FIG. 1 ), the electronic device 101 ), you can check the noise data corresponding to the speed at which the shape is changed (eg, the speed at which the shape is changed in Table 1). According to various embodiments, the electronic device 101 determines a shape change speed (eg, a shape change time and/or a shape change speed in Table 1) of the electronic device 101 among pre-stored noise data and the electronic device It is also possible to check the noise data corresponding to the changed form (eg, Step 1 or Step n) of (101). According to an embodiment, the electronic device 101 may perform operations to be described later after checking a difference in time points at which electrical signals are received without checking the speed at which the shape of the electronic device 101 is changed. According to an embodiment, the electronic device 101 may check noise data corresponding to a difference between the times at which the identified electrical signals are received. According to an embodiment, when an electrical signal corresponding to the changed shape of the electronic device 101 is received from at least one sensor (eg, the sensor 203 ), the electronic device 101 receives, based on this, the electronic device 101 . The changed shape of 101 may be checked, and noise data corresponding to the changed shape of the electronic device 101 may be checked, and will be described in more detail with reference to the drawings to be described later. For example, the electronic device 101 may check noise data corresponding to a changed form (eg, Step 1 or Step n) of the electronic device 101 from among the previously stored noise data.

According to various embodiments, in operation 690 , the electronic device 101 may obtain second audio data from the first audio data based on the identified noise data. For example, the electronic device 101 performs noise processing (eg, noise canceling) on the first audio data based on the identified noise data, thereby generating noise generated as the shape of the electronic device 101 is changed. It is possible to obtain the reduced (or removed) second audio data.

7 is a flowchart 700 for explaining a method for an electronic device (eg, the electronic device 101 of FIG. 1 ) to check a speed at which the shape of the electronic device 101 is changed, according to various embodiments of the present disclosure .

According to various embodiments, in operation 710 , in operation 710 , the electronic device 101 receives a second value from at least one sensor (eg, the sensor 203 of FIG. 2 ) based on the first shape. 1 signal (eg, an electrical signal received from the sensor 203 of FIGS. 2A and/or 2B ) For example, the first form may include FIGS. It may have a shape corresponding to any one of Step 2 to Step (n-1) of 5d For example, when the shape of the electronic device 101 is changed to the first shape, the first signal may include at least one sensor As an electrical signal received from (eg, the sensor 203 ), it may include a Step value indicating the first shape.

According to various embodiments of the present disclosure, in operation 730 , the electronic device 101 performs at least one sensor (eg, the sensor 203 ) based on the change of the shape of the electronic device 101 from the first shape to the second shape. ) can receive the second signal. For example, the second shape may be a shape corresponding to any one of Step 1 or Step n of FIGS. 5A, 5B, 5C and/or 5D. For example, the second signal is an electrical signal received from at least one sensor (eg, the sensor 203 ) when the shape of the electronic device 101 becomes the second shape, and is a Step value indicating the second shape. may include

According to various embodiments of the present disclosure, in operation 750 , when the second signal is received, the electronic device 101 performs 101), you can check the speed at which the shape was changed. For example, when the second signal is received after a predetermined time t has elapsed after the first signal is received, the electronic device 101 , the time at which the first signal is received and the time at which the second signal is received The difference (t _f ) can be confirmed. For example, when it is confirmed that the shape of the electronic device 101 is changed to Step 1 (or Step n) of FIGS. 5A, 5B, 5C and/or 5D, the previous Step On the basis of Step 2 (or Step (n-1)), when the first signal is received from at least one sensor (eg, the sensor 203), and Step 1 (or Step n) based on Based on the difference (eg, t _f in Table 1) when the second signal is received from at least one sensor (eg, the sensor 203 ), the speed at which the shape of the electronic device 101 is changed (eg, Table 1) v _f ) can be checked. According to an embodiment, the electronic device 101 may check noise data corresponding thereto, based on the viewpoint difference t _f .

8 is a method of an electronic device (eg, the electronic device 101 of FIG. 1 ) performing noise processing on audio data based on a speed at which the shape of the electronic device 101 is changed, according to various embodiments of the present disclosure; It is a flowchart 800 for explaining. Hereinafter, descriptions of portions overlapping with those described in FIG. 7 will be omitted.

According to various embodiments, in operation 810 , the electronic device 101 receives a second value from at least one sensor (eg, the sensor 203 of FIG. 2 ) based on the first shape. 1 signal (eg, an electrical signal received from the sensor 203 of FIGS. 2A and/or 2B ) may be received.

According to various embodiments of the present disclosure, in operation 730 , the electronic device 101 performs at least one sensor (eg, the sensor 203 ) based on the change of the shape of the electronic device 101 from the first shape to the second shape. ) can receive the second signal.

According to various embodiments, in operation 750 , the electronic device 101 may perform noise processing on the first audio data acquired within a predetermined time from the time when the second signal is received. 2A and/or 2B together, audio module 170 (eg, DSP 207 of FIG. 2B ) (or processor 120 of FIG. 2A ) includes at least one sensor (eg, of FIG. 2 ). The time when the second signal is received from the sensor 203) is when the shape of the electronic device 101 is changed to the second shape, and an impact sound is generated (eg, generated) as the shape of the electronic device 101 is changed. expected time). While the audio signal output from the microphone 201 is transmitted to the audio module 170 (eg, the DSP 207 of FIG. 2B ) (or the processor 120 of FIG. 2A ), a certain delay (eg: delay occurring in the analog-to-digital conversion process by the A/D converter 205) may occur. Due to this, the first audio data transmitted to the DSP 207 or the processor 120 after a predetermined time (eg, delayed time) from the time when the second signal is received is data in which the external voice affected by the impact sound is recorded. can be The audio module 170 (eg, the DSP 207 of FIG. 2B ) (or the processor 120 of FIG. 2A ), when the second signal is received, is obtained within a predetermined time from the time when the second signal is received. Noise processing may be performed on the first audio data. For example, the predetermined time may be set based on the above-described predetermined time (eg, delayed time). For example, the predetermined time may be set to be longer than the time (eg, buffer size) for the A/D converter 205 to convert the audio signal.

9 is a method of providing audio data to an application by an electronic device (eg, the electronic device 101 of FIG. 1 ), based on whether the shape of the electronic device 101 is changed, according to various embodiments of the present disclosure; It is a flowchart 900 for explaining.

According to various embodiments, the electronic device 101 may acquire first audio data in operation 910 .

According to various embodiments, in operation 930 , the electronic device 101 may determine whether the shape of the electronic device 101 is changed.

According to various embodiments, when it is confirmed that the shape of the electronic device 101 is changed, in operation 950 , the electronic device 101 may determine whether the changed shape is the second shape or the third shape. In this figure, for convenience of description, the second form is a form corresponding to "Step 1" of FIGS. 5A, 5B, 5C and/or 5D, and the third form is shown in FIGS. 5A, 5B, 5C and/or Alternatively, description will be made in a form corresponding to “Step n” of FIG. 5D .

According to various embodiments, when it is determined that the changed shape is the second shape or the third shape, the electronic device 101 obtains second audio data based on the noise data corresponding to the changed shape in operation 970. It can be provided to the application. For example, when it is confirmed that the changed shape is the second shape, the electronic device 101 may generate noise data corresponding to the second shape (eg, any one of reference a ₁ , a ₂ , a ₃ ,?? in Table 1). ), the second audio data obtained by performing noise processing on the first audio data may be provided to the application. For example, when it is confirmed that the changed shape is the third shape, the electronic device 101 may generate noise data corresponding to the third shape (eg, any one of reference b ₁ , b ₂ , b ₃ , ?? in Table 1). ), the second audio data obtained by performing noise processing on the first audio data may be provided to the application. According to various embodiments, the noise data corresponding to the changed shape may be identified based on the time (or the changed speed) when the shape of the electronic device 101 is changed. For example, when it is confirmed that the changed shape is the second shape, the electronic device 101 determines the time t _f (or the changed speed v _f ) when the shape of the electronic device 101 is changed to the second shape. After checking, noise processing is performed on the first audio data using noise data corresponding to the changed shape (eg, the current shape) and the shape change time t _f (or the shape change speed v _f ). can

According to various embodiments, when it is confirmed that the shape of the electronic device 101 is not changed (operation 930 - NO), or it is confirmed that the changed shape is not the second shape or the third shape (operation 930 - NO) In operation 950 - No) (eg, when the changed shape is the 'intermediate state' of FIGS. 5A, 5B, 5C and/or 5D), in operation 990, the obtained first audio data may be provided to the application. . For example, the electronic device 101 may provide the first audio data to the application without performing noise processing based on the noise data on the acquired first audio data.

According to various embodiments, after performing operation 970 or 990, the electronic device 101 performs operation 930 again to determine whether the shape of the electronic device 101 is changed while the first audio data is acquired. You can check again whether

10 is a flowchart 1000 for explaining a method in which the electronic device 101 provides audio data to an application based on an application being executed, according to various embodiments of the present disclosure.

According to various embodiments, the electronic device 101 may execute an application in operation 1010 . According to various embodiments, the executed application may be an application using an external voice sensed through at least one microphone (eg, the microphone 201 of FIG. 2 ).

According to various embodiments, in operation 1030 , the electronic device 101 may determine whether the running application is the first application. For example, the first application may be an application, such as a recording application or a camera application, that converts the sensed external voice into data and stores it in the memory 130 . According to an embodiment, the first application may include, for example, a call application that converts the sensed external voice or sound into data and transmits it to an external network.

According to various embodiments, if the electronic device 101 determines that the running application is the first application, in operation 1050, the first audio data or the second Audio data may be provided to the first application. For example, referring to FIG. 9 together, operation 930 may be performed (eg, it is checked whether the shape of the electronic device 101 is changed), and operation 950 , operation 970 , and/or operation 990 may be performed.

According to various embodiments of the present disclosure, if it is determined that the running application is not the first application, in operation 1070 , the electronic device 101 records the first audio data regardless of whether the shape of the electronic device 101 is changed. Based data can be provided to the running application. For example, when the running application is a second application that mainly uses the user's voice among external voices, such as a call application, the electronic device 101 irrespective of whether the shape of the electronic device 101 is changed. (For example, without checking whether the shape of the electronic device 101 is changed), VAD or other various user voice extraction techniques are applied to the first audio data to obtain data on the extracted user's voice, , it can be provided to the second application. As another example, when the running application is a third application different from the above-described first and second applications, the first audio data may be bypassed and provided as the third application.

11 illustrates, when the shape of the electronic device 101 (eg, the rollable electronic device 101 of FIGS. 4A and/or 4B ) is changed, the display 1101 (eg, : shows an example of a screen displayed on the display module 160 of FIG. 1).

According to various embodiments, whether or not to perform noise processing based on noise data (eg, reference data) described in the drawings above may be set in advance (eg, before detecting an external voice through a recording application). . For example, when the shape of the electronic device 101 is changed according to a user's setting, the electronic device 101 obtains and provides second audio data by performing noise processing based on the noise data, or 101), it is possible to acquire and provide the first audio data without performing noise processing based on the noise data regardless of the change in shape.

According to various embodiments, whether to perform noise processing based on the noise data (eg, reference data) described in the drawings is set (or changed) after the recording application (eg, the first application) is executed ) may be

Referring to FIG. 11 , when a recording application (eg, a first application) is running, an execution screen 1103 of the recording application may be displayed on the display 1101 . At this time, the electronic device 101 uses a microphone (eg, the microphone 201 of FIGS. 2A and/or 2B ) to convert and store the sensed external voice as data using a recording application, and transmits the external voice. may be sensing.

According to various embodiments, the execution screen 1103 of the recording application may include various information related to the recording application. For example, in the execution screen 1103, information 1105 about the recording time of the recording application (eg, the time that has elapsed after the recording function is executed) and/or a waveform related to the recorded voice (eg, recorded voice) information 1107 about the waveform indicating the magnitude of . According to various embodiments, the execution screen 1103 may include an icon related to the function of the recording application. For example, in the execution screen 1103, a first icon 1109a for providing a recording start function, a second icon 1109b for providing a recording pause function, and/or a recording stop function A third icon 1109c for providing a function may be included.

According to various embodiments, the relative movement (eg, the first housing 501 of FIG. 5B ) and the second housing (eg, the second housing 503 of FIG. 5B ) of the electronic device 101 ) The shape of the electronic device 101 may be changed according to (eg, linear movement). The shape of the electronic device 101 shown in FIG. 11 may be a shape corresponding to Step 1 of FIG. 5B . According to various embodiments, the shape of the electronic device 101 is changed according to the relative movement of the first housing 501 and the second housing 503 of the electronic device 101 to a second shape (eg, FIG. 5B ). in the form corresponding to Step 1 of ), an instrument impact sound 1104 may be generated due to an impact between structures (eg, the first housing 501 and the second housing 503 ) in the electronic device 101 . . According to various embodiments, whether the electronic device 101 is set not to perform noise processing based on noise data (eg, reference data) or whether to perform noise processing based on noise data (eg, reference data) is not preset, when it is confirmed that the shape of the electronic device 101 is changed to the second shape, for setting (or changing) the user to perform noise processing based on noise data (eg, reference data) A user interface can be provided. For example, referring to FIG. 11 , when it is confirmed that the shape of the electronic device 101 is changed to the second shape, the electronic device 101 displays a user interface (eg, a notification message 1111 ) through a pop-up. -up) can be displayed. According to various embodiments, the displayed user interface (eg, the notification message 1111) may include information indicating that an instrument impact sound may be included in audio data during voice recording (eg, “Instrument impact has been detected. Would you like to continue recording by removing it?"). According to various embodiments, the displayed user interface (eg, the notification message 1111 ) may include an approval button 1113a and/or a rejection button 1113b. According to various embodiments, when the approval button 1113a is selected (eg, touched) by the user, the electronic device 101 is approved by the user or when the shape of the electronic device 101 is changed to the second shape The button 1113a performs noise processing based on noise data (eg, reference data) on audio data (eg, first audio data) acquired before or from the selected time point to obtain second audio data and provide it to the recording application. According to various embodiments, when the reject button 1113b is selected (eg, touched) by the user, the electronic device 101 approves the electronic device 101 when the shape of the electronic device 101 is changed to the second shape or by the user Bypassing audio data (eg, first audio data) acquired before or from the time when the button 1113a is selected (eg, without performing noise processing based on noise data (eg, reference data)), It can be provided to the recording application.

According to various embodiments, the electronic device (eg, the electronic device 101 of FIG. 1 ) includes a first housing (eg, the first housing 501 of FIGS. 5A, 5B, 5C, or 5D), 1 of a second housing connected to at least a portion of the housing and movable with respect to the first housing (eg, the second housing 503 of FIGS. 5A, 5B, 5C, or 5D), the first housing, or the second housing. at least one display coupled with at least one (eg, display module 160 in FIG. 1 ), at least one microphone (eg, microphone 201 in FIGS. 2A and/or 2B ), at least one sensor (eg, 2A and/or 2B) and at least one processor (eg, processor 120 in FIG. 1), wherein the at least one processor is configured to: Acquire data, and while acquiring the first audio data, use at least one sensor to confirm that the shape of the electronic device is changed according to the relative movement of the first housing and the second housing, and the shape of the electronic device is changed The electronic device is configured to check noise data based on the confirmation, and to obtain second audio data from the first audio data based on the identified noise data, wherein the second audio data is included in the first audio data Data in which at least a portion of noise based on a change in the shape of ?

According to various embodiments, the at least one processor receives a first signal from the at least one sensor based on the shape of the electronic device being the first shape, and the shape of the electronic device is changed from the first shape to the second shape. Based on the change in shape, it may be further configured to receive a second signal from at least one sensor.

According to various embodiments, when the second signal is received, the at least one processor determines the speed at which the shape of the electronic device is changed based on a difference between a time point at which the first signal is received and a time point at which the second signal is received. check, and check the noise data corresponding to the checked speed.

According to various embodiments, the at least one processor may be configured to perform noise processing based on the identified noise data on the first audio data obtained within a predetermined time from the time when the second signal is received.

According to various embodiments, the at least one processor identifies the first noise data as noise data based on the change in the shape of the electronic device to the second shape, and the at least one processor based on the change in the shape of the electronic device to the third shape Accordingly, the second noise data may be identified as noise data, and the first noise data and the second noise data may be different.

According to various embodiments of the present disclosure, the electronic device further includes a memory, a plurality of noise data is pre-stored in the memory, and each of the pre-stored plurality of noise data is determined by a speed at which a shape of the electronic device is changed or the electronic device. Any one of a plurality of pre-stored noise data including information on a noise pattern corresponding to at least one of the changed shapes may be identified as noise data.

According to various embodiments, the at least one processor provides the first audio data to the application based on that the shape of the electronic device is not confirmed to be changed, and based on the confirmation that the shape of the electronic device is changed, the at least one processor 2 It may be further configured to provide audio data to the application.

According to various embodiments, the at least one processor executes an application, and when the running application is the first application, the first audio data or the second audio data is first transmitted according to whether the shape of the electronic device is changed. If provided as an application and the running application is the second application, it may be further configured to provide data based on the first audio data as the second application regardless of whether the shape of the electronic device is changed.

According to various embodiments, the at least one processor includes a DSP and an AP, wherein the DSP is configured to transfer audio data of at least one of the first audio data or the second audio data to a buffer of the AP, wherein the AP , at least one audio data transferred to the buffer may be set to be provided to an application running in the electronic device.

According to various embodiments, the second housing may be hinge-coupled to at least a portion of the first housing.

According to various embodiments of the present disclosure, a method of controlling an electronic device includes: acquiring first audio data using at least one microphone of the electronic device; An operation of confirming that the shape of the electronic device is changed according to the relative movement of the first housing of the electronic device and the second housing of the electronic device using the sensor, and noise data based on checking that the shape of the electronic device is changed and acquiring second audio data from the first audio data based on the operation and the confirmed noise data, wherein the second audio data is noise based on a change in a shape of an electronic device included in the first audio data. At least a portion of may include reduced data.

According to various embodiments of the present disclosure, in a method of controlling an electronic device, based on the shape of the electronic device being the first shape, the operation of receiving the first signal from at least one sensor and the shape of the electronic device are The method may further include receiving a second signal from at least one sensor based on the change from to the second form.

According to various embodiments, the operation of checking the noise data based on confirming that the shape of the electronic device is changed may include, when a second signal is received, a time point at which the first signal is received, and a time point at which the second signal is received. Based on the difference between , the operation of checking the speed at which the shape of the electronic device is changed and the operation of checking noise data corresponding to the checked speed may be included.

According to various embodiments, the obtaining of the second audio data from the first audio data based on the identified noise data may include: with respect to the first audio data obtained within a predetermined time from a time point at which the second signal is received, , performing noise processing based on the identified noise data.

According to various embodiments, the checking of the noise data based on confirming that the shape of the electronic device is changed may include checking the first noise data as noise data based on the change of the shape of the electronic device to the second shape. and checking the second noise data as noise data based on the operation and the change of the shape of the electronic device to the third shape, and the first noise data and the second noise data may be different from each other.

According to various embodiments of the present disclosure, the electronic device further includes a memory, a plurality of noise data is pre-stored in the memory, and each of the pre-stored plurality of noise data may correspond to a speed at which a shape of the electronic device is changed or a change in the electronic device. Any one of a plurality of pre-stored noise data including information on a noise pattern corresponding to at least one of the types may be identified as the noise data.

According to various embodiments of the present disclosure, a method of controlling an electronic device is based on an operation of providing the first audio data to an application and confirmation of a change in the shape of the electronic device based on not checking that the shape of the electronic device is changed Accordingly, the operation of providing the second audio data to the application may be further included.

According to various embodiments of the present disclosure, in a method of controlling an electronic device, the first audio data or the second audio data is based on whether the shape of the electronic device is changed if the running application is the first application and the running application is the first application. may further include the operation of providing as the first application and, if the running application is the second application, providing data based on the first audio data to the second application regardless of whether the shape of the electronic device is changed. have.

According to various embodiments of the present disclosure, a method of controlling an electronic device includes an operation of transferring at least one of first audio data and second audio data to a buffer of an AP of the electronic device, and at least one audio transferred to the buffer The method may further include providing data to an application running in the electronic device.

According to various embodiments, the computer-readable non-volatile recording medium, when executed, causes at least one processor to obtain first audio data using at least one microphone of the electronic device, and the first audio data During the acquisition, using at least one sensor of the electronic device, it is confirmed that the shape of the electronic device is changed according to the relative movement of the first housing of the electronic device and the second housing of the electronic device, and that the shape of the electronic device is changed store instructions for checking noise data based on the verification, and obtaining second audio data from the first audio data based on the identified noise data, wherein the second audio data is included in the first audio data Data in which at least a portion of noise based on a change in the shape of the electronic device is reduced may be included.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

101: electronic device
120: processor
130: memory
170: audio module
201: microphone
203: sensor
205: A/D converter
207: DSP
211: AP

Claims (20)

In an electronic device,
a first housing;
a second housing connected to at least a portion of the first housing and movable with respect to the first housing;
at least one display coupled with at least one of the first housing or the second housing;
at least one microphone;
at least one sensor; and
at least one processor;
The at least one processor,
acquiring first audio data by using the at least one microphone;
While the first audio data is being acquired, using the at least one sensor, it is confirmed that the shape of the electronic device is changed according to the relative movement of the first housing and the second housing,
Based on confirming that the shape of the electronic device is changed, the noise data is checked,
configured to obtain second audio data from the first audio data based on the identified noise data;
The second audio data includes data in which at least a portion of noise based on a change in a shape of the electronic device included in the first audio data is reduced. According to claim 1,
The at least one processor,
receiving a first signal from the at least one sensor based on the shape of the electronic device being a first shape;
The electronic device is further configured to receive a second signal from the at least one sensor based on a change in the shape of the electronic device from the first shape to the second shape. 3. The method of claim 2,
The at least one processor,
When the second signal is received, based on a difference between a time point at which the first signal is received and a time point at which the second signal is received, the speed at which the shape of the electronic device is changed is confirmed;
an electronic device configured to check the noise data corresponding to the checked speed. 3. The method of claim 2,
The at least one processor,
An electronic device configured to perform noise processing based on the identified noise data on the first audio data acquired within a predetermined time from a point in time when the second signal is received. According to claim 1,
The at least one processor,
Based on the change in the shape of the electronic device to the second shape, the first noise data is identified as the noise data (as);
It is set to check second noise data as the noise data based on the change in the shape of the electronic device to the third shape,
The first noise data and the second noise data are different from each other. According to claim 1,
more memory,
A plurality of noise data is stored in advance in the memory,
Each of the plurality of pre-stored noise data includes information about a noise pattern corresponding to at least one of a change speed of the electronic device and a changed shape of the electronic device,
An electronic device in which any one of the plurality of pre-stored noise data is identified as the noise data. According to claim 1,
The at least one processor,
providing the first audio data to an application on the basis that it is not confirmed that the shape of the electronic device is changed;
The electronic device further configured to provide the second audio data to the application based on it being confirmed that the shape of the electronic device is changed. According to claim 1,
The at least one processor,
run the application,
If the running application is a first application, providing the first audio data or the second audio data to the first application according to whether the shape of the electronic device is changed;
The electronic device further configured to provide data based on the first audio data to the second application regardless of whether the shape of the electronic device is changed when the running application is the second application. According to claim 1,
The at least one processor includes a digital signal processor (DSP) and an application processor (AP),
The DSP is
configured to transfer at least one audio data of the first audio data and the second audio data to a buffer of the AP;
The AP is
An electronic device configured to provide at least one audio data transferred to the buffer to an application running in the electronic device. According to claim 1,
The second housing is hinge-coupled to at least a portion of the first housing. A method for controlling an electronic device, comprising:
acquiring first audio data by using at least one microphone of the electronic device;
While the first audio data is being acquired, the shape of the electronic device is changed according to the relative movement of the first housing of the electronic device and the second housing of the electronic device using at least one sensor of the electronic device action to confirm;
checking noise data based on checking that the shape of the electronic device is changed; and
based on the identified noise data, obtaining second audio data from the first audio data;
The second audio data includes data in which at least a portion of noise based on a change in a shape of the electronic device included in the first audio data is reduced. 12. The method of claim 11,
receiving a first signal from the at least one sensor based on the shape of the electronic device being a first shape; and
The method further comprising receiving a second signal from the at least one sensor based on the change in the shape of the electronic device from the first shape to the second shape. 13. The method of claim 12,
Based on confirming that the shape of the electronic device is changed, the operation of checking the noise data includes:
when the second signal is received, determining a speed at which the shape of the electronic device is changed based on a difference between a time point at which the first signal is received and a time point at which the second signal is received; and
and identifying the noise data corresponding to the identified speed. 13. The method of claim 12,
Acquiring the second audio data from the first audio data based on the identified noise data includes:
and performing noise processing based on the identified noise data on the first audio data acquired within a predetermined time from the time when the second signal is received. 12. The method of claim 11,
Based on confirming that the shape of the electronic device is changed, the operation of checking the noise data includes:
checking first noise data as (as) the noise data based on the change in the shape of the electronic device to the second shape; and
and checking second noise data as the noise data based on the change in the shape of the electronic device to the third shape,
wherein the first noise data and the second noise data are different. 12. The method of claim 11,
The electronic device further includes a memory,
A plurality of noise data is stored in advance in the memory,
Each of the plurality of pre-stored noise data includes information about a noise pattern corresponding to at least one of a change speed of the electronic device and a changed shape of the electronic device,
Any one of the plurality of pre-stored noise data is identified as the noise data. 12. The method of claim 11,
providing the first audio data to an application based on not checking that the shape of the electronic device is changed; and
The method further comprising: providing the second audio data to the application based on it is confirmed that the shape of the electronic device is changed. 12. The method of claim 11,
running the application;
if the running application is a first application, providing the first audio data or the second audio data to the first application according to whether the shape of the electronic device is changed; and
If the running application is a second application, providing data based on the first audio data to the second application regardless of whether the shape of the electronic device is changed. 12. The method of claim 11,
transferring at least one of the first audio data and the second audio data to a buffer of the AP of the electronic device; and
The method further comprising providing the at least one audio data transferred to the buffer to an application running in the electronic device. A computer-readable non-volatile recording medium comprising:
The recording medium, when executed, at least one processor,
Obtaining first audio data by using at least one microphone of the electronic device,
While the first audio data is being acquired, the shape of the electronic device is changed according to the relative movement of the first housing of the electronic device and the second housing of the electronic device using at least one sensor of the electronic device check,
Based on confirming that the shape of the electronic device is changed, the noise data is checked,
storing instructions for obtaining second audio data from the first audio data based on the identified noise data;
The second audio data includes data in which at least a portion of noise based on a change in a shape of the electronic device included in the first audio data is reduced.

Images