KR20220078432A - Electronic device and method for outputting multi-channel audio using the same - Google Patents

Abstract

According to various embodiments of the present disclosure, an electronic device includes a plurality of audio output devices, and a plurality of audio output devices and a processor, wherein the processor, based on detecting output of audio data, Check direction information of the electronic device, and transmit channel information of audio data to be output by each of the plurality of audio output devices to each audio output device based on the direction information of the electronic device, and the channel information Based on , each audio output device may be configured to select a channel and control the plurality of audio output devices to output audio data of the selected channel.
Various embodiments other than the various embodiments disclosed herein are possible.

Description

Electronic device and multi-channel audio output method using same {ELECTRONIC DEVICE AND METHOD FOR OUTPUTTING MULTI-CHANNEL AUDIO USING THE SAME}

Various embodiments of the present disclosure relate to an electronic device and a multi-channel audio output method using the same.

The electronic device may output audio data in multi-channels using a plurality of audio output devices. For example, the electronic device may generate multi-channel audio data corresponding to the number of audio output devices or may generate multi-channel audio data based on the number of channels corresponding to the audio data. The electronic device may output the generated multi-channel audio data through a plurality of audio output devices.

A processing delay of the audio data may occur due to a time required to generate the audio data as multi-channel audio data to correspond to the number of audio output devices and/or the use of a buffer. For example, as processing delay occurs in audio data (eg, game sound, live streaming) of content requiring real-time performance, usability of the electronic device may deteriorate.

When reproducing audio data, the electronic device according to various embodiments of the present disclosure may transmit channel information of audio data to be output by each audio output device according to direction information of the electronic device to each audio output device. Each audio output device may output audio data of a corresponding channel based on channel information of the audio data.

An electronic device according to various embodiments of the present disclosure includes a plurality of audio output devices, and a plurality of audio output devices and a processor, wherein the processor is configured to: based on detecting output of audio data, Check direction information of the electronic device, and transmit channel information of audio data to be output by each of the plurality of audio output devices to each audio output device based on the direction information of the electronic device, and Based on this, each audio output device may be configured to select a channel and control the plurality of audio output devices to output audio data of the selected channel.

A method of outputting multi-channel audio from an electronic device according to various embodiments of the present disclosure includes an operation of checking direction information of the electronic device based on detecting output of audio data, transmission of channel information of audio data to be output by each of the plurality of audio output devices to each audio output device, and, based on the channel information, each audio output device selects a channel and provides audio of the selected channel and controlling the plurality of audio output devices to output data.

Each audio output device included in the electronic device according to various embodiments of the present disclosure may output audio data of a corresponding channel based on channel information of the audio data without separate processing of the audio data. Accordingly, a time delay according to the processing of audio data can be minimized. In addition, when content such as a game and/or live streaming requiring real-time performance is reproduced, a sense of difference between audio data and image data may be resolved, and thus the usability of the electronic device may be increased.

1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure;
2 is a block diagram illustrating a program, in accordance with various embodiments.
3 is a diagram illustrating an electronic device according to various embodiments of the present disclosure;
4 is a block diagram illustrating an electronic device according to various embodiments of the present disclosure.
5A is a diagram illustrating a hierarchical structure of an electronic device according to various embodiments of the present disclosure;
5B is a diagram for describing a method of outputting multi-channel audio data according to direction information of an electronic device, according to various embodiments of the present disclosure;
6 is a flowchart illustrating a method of outputting multi-channel audio data according to direction information of an electronic device, according to various embodiments of the present disclosure.
7 is a flowchart illustrating a method of outputting multi-channel audio data based on a change in direction information of an electronic device, according to various embodiments of the present disclosure;
8A is a diagram illustrating a flat state or an opening state of an electronic device according to various embodiments of the present disclosure;
8B is a diagram illustrating a folding state or a closing state of an electronic device according to various embodiments of the present disclosure;
9 is a flowchart illustrating a method of outputting multi-channel audio data according to direction information and/or a folding state of a foldable electronic device, according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments.

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with at least one of the electronic device 104 and the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included. In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 may use less power than the main processor 121 or may be set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ). The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)). The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, underside) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( eg commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 is to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 is a block diagram 200 illustrating a program 140, in accordance with various embodiments.

According to an embodiment, the program 140 executes an operating system 142 for controlling one or more resources of the electronic device 101 , middleware 144 , or an application 146 executable in the operating system 142 . may include Operating system 142 may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM . At least some of the programs 140 are, for example, preloaded into the electronic device 101 at the time of manufacture, or an external electronic device (eg, the electronic device 102 or 104 ), or a server (eg, the electronic device 102 or 104 ) when used by a user ( 108)) or may be updated.

The operating system 142 may control management (eg, allocation or retrieval) of one or more system resources (eg, a process, memory, or power) of the electronic device 101 . The operating system 142 may additionally or alternatively include other hardware devices of the electronic device 101 , for example, the input module 150 , the sound output module 155 , the display module 160 , and the audio module 170 . , sensor module 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or It may include one or more driver programs for driving the antenna module 197 .

The middleware 144 may provide various functions to the application 146 so that functions or information provided from one or more resources of the electronic device 101 may be used by the application 146 . The middleware 144 includes, for example, an application manager 201 , a window manager 203 , a multimedia manager 205 , a resource manager 207 , a power manager 209 , a database manager 211 , and a package manager 213 . ), a connectivity manager 215 , a notification manager 217 , a location manager 219 , a graphics manager 221 , a security manager 223 , a call manager 225 , or a voice recognition manager 227 . can

The application manager 201 may manage the life cycle of the application 146 , for example. The window manager 203 may manage one or more GUI resources used in the screen, for example. The multimedia manager 205, for example, identifies one or more formats required for playback of media files, and encodes or decodes a corresponding media file among the media files using a codec suitable for the selected format. can be done The resource manager 207 may manage the space of the source code of the application 146 or the memory of the memory 130 , for example. The power manager 209 may, for example, manage the capacity, temperature, or power of the battery 189 , and determine or provide related information necessary for the operation of the electronic device 101 by using the corresponding information. . According to an embodiment, the power manager 209 may interwork with a basic input/output system (BIOS) (not shown) of the electronic device 101 .

The database manager 211 may create, retrieve, or change a database to be used by the application 146 , for example. The package manager 213 may manage installation or update of an application distributed in the form of a package file, for example. The connectivity manager 215 may manage, for example, a wireless connection or a direct connection between the electronic device 101 and an external electronic device. The notification manager 217 may provide, for example, a function for notifying the user of the occurrence of a specified event (eg, an incoming call, a message, or an alarm). The location manager 219 may manage location information of the electronic device 101 , for example. The graphic manager 221 may manage, for example, one or more graphic effects to be provided to a user or a user interface related thereto.

Security manager 223 may provide, for example, system security or user authentication. The telephony manager 225 may manage, for example, a voice call function or a video call function provided by the electronic device 101 . The voice recognition manager 227, for example, transmits the user's voice data to the server 108, based at least in part on the voice data, a command corresponding to a function to be performed in the electronic device 101; Alternatively, the converted text data may be received from the server 108 based at least in part on the voice data. According to an embodiment, the middleware 244 may dynamically delete some existing components or add new components. According to an embodiment, at least a portion of the middleware 144 may be included as a part of the operating system 142 or implemented as software separate from the operating system 142 .

Application 146 includes, for example, home 251 , dialer 253 , SMS/MMS 255 , instant message (IM) 257 , browser 259 , camera 261 , alarm 263 . , contacts 265, voice recognition 267, email 269, calendar 271, media player 273, album 275, watch 277, health 279 (such as exercise or blood sugar) measuring biometric information), or environmental information 281 (eg, measuring atmospheric pressure, humidity, or temperature information). According to an embodiment, the application 146 may further include an information exchange application (not shown) capable of supporting information exchange between the electronic device 101 and an external electronic device. The information exchange application may include, for example, a notification relay application configured to transmit specified information (eg, call, message, or alarm) to an external electronic device, or a device management application configured to manage the external electronic device. have. The notification relay application, for example, transmits notification information corresponding to a specified event (eg, mail reception) generated in another application (eg, the email application 269 ) of the electronic device 101 to the external electronic device. can Additionally or alternatively, the notification relay application may receive notification information from the external electronic device and provide it to the user of the electronic device 101 .

The device management application is, for example, a power supply (eg, turn-on or turn-off) of an external electronic device or some component thereof (eg, a display module or a camera module of the external electronic device) that communicates with the electronic device 101 . ) or a function (eg brightness, resolution, or focus). The device management application may additionally or alternatively support installation, deletion, or update of an application operating in an external electronic device.

3 is a diagram 300 illustrating an electronic device 301 according to various embodiments of the present disclosure.

Referring to FIG. 3 , reference number <310> is a diagram indicating that orientation information of an electronic device 301 (eg, the electronic device 101 of FIG. 1 ) is a portrait mode, and reference number <350> is a diagram illustrating that direction information of the electronic device 301 is a landscape mode.

In various embodiments, the electronic device 301 may identify direction information of the electronic device 301 through a sensor (eg, the sensor module 176 of FIG. 1 ). The direction information of the electronic device 301 may include a portrait mode (eg, a state of reference number <310>) and a landscape mode (eg, a state of reference number <350>).

For example, in a state in which direction information of the electronic device 301 indicates the portrait mode, as shown in reference numeral <310>, the first side 311 of the electronic device 301 is in a first direction (eg, direction ①). ) and may include a state in which the second side 313 of the electronic device 301 faces in a second direction (eg, direction ②) opposite to the first direction (eg, ①). have.

As another example, the state in which the direction information of the electronic device 301 indicates the landscape mode is, as shown in reference numeral 350, a third side surface (311) longer than the first side surface 311 of the electronic device 301 . 315) is disposed to face the first direction (eg, direction ①), and the fourth side surface 317 longer than the second side 313 of the electronic device 301 is opposite to the first direction (eg, direction ①) It may include a state in which it is arranged to face the second direction (eg, direction ②).

In various embodiments, the electronic device 301 may include a plurality of audio output devices. For example, the plurality of audio output devices may include a first audio output device 321 , a second audio output device 323 , a third audio output device 325 , and a fourth audio output device 327 . For example, the first audio output device 321 may be disposed in a first area of the first side surface 311 of the electronic device 301 . The second audio output device 323 may be disposed in the second area of the first side 311 of the electronic device 301 . The third audio output device 325 may be disposed in the first area of the second side surface 313 of the electronic device 301 . The fourth audio output device 327 may be disposed in the second area of the second side surface 313 of the electronic device 301 .

In various embodiments, the plurality of audio output devices 321 , 323 , 325 , and 327 may be disposed at positions corresponding to each other. For example, the first audio output device 321 may be disposed in a first area of the first side 311 of the electronic device 301 , and the second side 313 of the electronic device 301 corresponds to a position corresponding thereto. A third audio output device 325 may be disposed in the first area of . A second audio output device 323 may be disposed in a second area of the first side 311 of the electronic device 301 , and the second audio output device 323 of the second side 313 of the electronic device 301 corresponds to a position corresponding thereto. A fourth audio output device 327 may be disposed in area 2 .

Although it has been described that the electronic device 301 includes four audio output devices in FIG. 3 according to various embodiments, the present invention is not limited thereto. For example, the electronic device 301 may include more than four audio output devices. A position in which the four audio output devices are arranged in the electronic device 301 is also not limited to the embodiment of FIG. 3 .

In various embodiments, the direction information of the electronic device 301 includes a position where a plurality of audio output devices are disposed when the electronic device 301 is viewed from the front in a portrait mode (eg, reference number <310>) and the electronic device 301 . When the direction information of the device 301 is viewed from the front in a landscape mode (eg, reference number <350>), the positions at which the plurality of audio output devices are arranged may be different.

For example, as shown in reference numeral <310>, when the direction information of the electronic device 301 is in the portrait mode and the first audio output device 321 is viewed from the front when the electronic device 301 is viewed from the front, the The second audio output device 323 may be disposed on the upper left side of the electronic device 301 , and the third audio output device 325 may be disposed on the lower side of the electronic device 301 . It may be disposed on the left side, and the fourth audio output device 327 may be disposed on the lower right side of the electronic device 301 .

For another example, as shown by reference numeral 350, the first audio output device 321 when the electronic device 301 is viewed from the front is in the landscape mode when the direction information of the electronic device 301 is in the landscape mode. The device 301 may be disposed on the upper right side, the second audio output device 323 may be disposed on the bottom right side of the electronic device 301 , and the third audio output device 325 may be disposed on the electronic device 301 . The fourth audio output device 327 may be disposed at the upper left side of , and the fourth audio output device 327 may be disposed at the lower left side of the electronic device 301 .

In various embodiments, the electronic device 301 outputs channel information of audio data to be finally output from each audio output device 321 , 323 , 325 , or 327 according to direction information of the electronic device 301 , each audio output. device 321 , 323 , 325 , or 327 . For example, the audio data may include multi-channel audio data. Assuming that multi-channel audio data is two-channel audio data, the electronic device 301 provides a first channel (eg, an L channel (left channel)) or a second channel (eg, an R channel (right channel)) To output audio data of , channel information including first channel information or second channel information of the audio data may be transmitted to each audio output device 321 , 323 , 325 , or 327 .

Channel information of audio data to be finally output from each audio output device 321 , 323 , 325 , or 327 according to the direction information of the electronic device 301 described above according to various embodiments is transferred to each audio output device 321 , 323 . , 325, or 327), various embodiments will be described with reference to FIGS. 5A to 7 to be described later.

4 is a block diagram 400 illustrating an electronic device 401 according to various embodiments.

Referring to FIG. 4 , an electronic device 401 (eg, the electronic device 301 of FIG. 3 ) includes a communication circuit 410 (eg, the communication module 190 of FIG. 1 ), a memory 420 (eg, FIG. 3 ). 1), a sensor circuit 430 (eg, the sensor module 176 of FIG. 1 ), an audio output device 440 (eg, the sound output module 155 of FIG. 1 ), a touch screen display ( 450 (eg, the display module 160 of FIG. 1 ), and/or a processor 460 (eg, the processor 120 of FIG. 1 ).

According to various embodiments of the present disclosure, the communication circuit 410 (eg, the communication module 190 of FIG. 1 ) may include an external electronic device (eg, the electronic devices 102 and 104 and the server 108 of FIG. 1 ). A communication channel may be established with an external electronic device, and various data may be transmitted and received with an external electronic device.

According to various embodiments of the present disclosure, the memory 420 (eg, the memory 130 of FIG. 1 ) may include each audio output device 441 , 443 , 445 , or 447 according to direction information of the electronic device 401 . may store channel information of audio data to be finally output in the . The electronic device 401 is a foldable device, and the memory 420 includes each audio output device 441, 443, 445, or 447), channel information of audio data to be finally output may be stored.

In an embodiment, the memory 420 may store information on the channel information of the audio data transmitted to each audio output device 441 , 443 , 445 , or 447 based on the direction information and/or the folding state of the electronic device 401 . Controls each audio output device 441 , 443 , 445 , or 447 to output audio data of the selected channel by selecting a channel to be finally output from each audio output device 441 , 443 , 445 , or 447 based on You can store instructions to perform an operation.

According to various embodiments of the present disclosure, the sensor circuit 430 (eg, the sensor module 176 of FIG. 1 ) may include an acceleration sensor, a geomagnetic sensor, and/or a gyro sensor. The sensor circuit 430 may determine a direction in which the first side surface (eg, the first side surface 311 of FIG. 3 ) of the electronic device 401 faces. The sensor circuit 430 obtains movement information (eg, a movement direction of the electronic device 401 , a tilt of the electronic device 401 ) of the electronic device 401 , and based on this, the first side surface of the electronic device 401 . (311) can determine the direction it faces.

According to various embodiments, the sensor circuit 430 may include at least one of a proximity sensor, an infrared (IR) sensor, a hall sensor, a motion sensor, an angle sensor, and an illuminance sensor. The sensor circuit 430 is configured to be configured in a folded state (eg, an unfolded state, a folded state, and/or an unfolded state of a predetermined angle) based on a distance (or angle) between the first housing structure and the second housing structure of the electronic device 401 . ) can be checked.

According to various embodiments of the present disclosure, the audio output device 440 (eg, the sound output module 155 of FIG. 1 ) may include a plurality of audio output devices, for example, the first audio output device 441 (eg, FIG. 1 ). 3 ), a second audio output device 443 (eg, the second audio output device 323 of FIG. 3 ), and a third audio output device 445 (eg, FIG. 3 ). a third audio output device 325 ), and a fourth audio output device 447 (eg, the fourth audio output device 327 of FIG. 3 ).

In one embodiment, each audio output device 441 , 443 , 445 , or 447 selects a channel to be finally output based on channel information of the audio data under the control of the processor 460 , and selects the audio data of the selected channel can be printed out.

According to various embodiments of the present disclosure, the touch screen display 450 (eg, the display module 160 of FIG. 1 ) may be integrally configured including the display 451 and the touch panel 453 .

In one embodiment, the touch screen display 450 displays an image under the control of the processor 460, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light emitting diode ( It may be implemented as any one of an organic light-emitting diode (OLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display. However, the present invention is not limited thereto.

In an embodiment, the touch screen display 450 may display a user interface that allows the user to control a function related to audio reproduction under the control of the processor 460 .

According to various embodiments of the present disclosure, the processor 460 (eg, the processor 120 of FIG. 1 ) may include, for example, a micro controller unit (MCU), and an operating system (OS). ) or an embedded software program to control a plurality of hardware components connected to the processor 460 . The processor 460 may control a plurality of hardware components according to, for example, instructions (eg, the program 140 of FIG. 1 ) stored in the memory 420 .

In one embodiment, the processor 460 may include a first processor 461 and a second processor 463 .

In various embodiments, the first processor 461 may control an overall operation of the electronic device 401 and a signal flow between internal components of the electronic device 401 , and may perform data processing.

In various embodiments, the second processor 463 is an audio output device 440 , such as a first audio output device 441 , a second audio output device 443 , a third audio output device 445 , and a second 4 may control the audio output device 447 . The second processor 463 is configured as one processor for controlling the audio output device 440 , or a plurality of audio output devices (eg, the first audio output device 441 and the second audio output device 443 ). ), the third audio output device 445 , and the fourth audio output device 447) may be included in each.

In an embodiment, the first processor 461 may detect an output of audio data. The audio data may include multi-channel audio data, for example, audio data of a first channel (eg, L channel) and audio data of a second channel (eg, R channel). The first processor 461 may transmit audio data of a first channel (eg, L channel) and audio data of a second channel (eg, R channel) to the second processor 463 .

In an embodiment, the first processor 461 may identify direction information of the electronic device 401 . The orientation information of the device 401 may include a portrait mode and a landscape mode. For example, the first processor 461 determines a direction in which the first side of the electronic device 401 (eg, the first side 311 of FIG. 3 ) faces through the sensor circuit 430 , and based on this, determines the direction of the electronic device The direction information of 401 can be confirmed. Based on the direction information of the electronic device 401 , the first processor 461 determines a channel of audio data to be finally output from each audio output device according to a location where each of the plurality of audio output devices is arranged in the electronic device 401 , based on the direction information of the electronic device 401 . information can be checked. The first processor 461 may transmit channel information of audio data to be finally output by the plurality of audio output devices 441 , 443 , 445 , and 447 to the second processor 463 .

In an embodiment, the second processor 463 is configured to output a plurality of audio output devices 441 and 443 such that each audio output device outputs audio data of a corresponding channel based on the channel information received from the first processor 461 . , 445, and 447) can be controlled. For example, based on the channel information of the audio data received from the first processor 461 , the second processor 463 may control audio data of a first channel (eg, L channel) or a second channel (eg, R channel). The plurality of audio output devices 441 , 443 , 445 , and 447 may be controlled to output audio data.

In an embodiment, when the first processor 461 determines that the direction information of the electronic device 401 is changed (eg, switched), the first processor 461 outputs a final output from each audio output device according to the changed direction information of the electronic device 401 . The changed channel information of the audio data to be performed may be transmitted to the second processor 463 . For example, changing the direction information of the electronic device 401 may include a change from a portrait mode to a landscape mode and a change from a landscape mode to a portrait mode. A plurality of audio output devices 441 when the electronic device 401 is viewed from the front based on the direction information of the electronic device 401 being switched from the portrait mode (or landscape mode) to the landscape mode (or portrait mode) , 443 , 445 , and 447 may also be changed, and accordingly, channel information of audio data to be finally output may also be changed.

In an embodiment, the second processor 463) outputs audio data of the corresponding channel to each audio output device 441 , 443 , 445 , or 447 based on the channel information received from the first processor 461 ). The plurality of audio output devices 441 , 443 , 445 , and 447 may be controlled to do so.

In various embodiments, when the electronic device 401 is configured as a foldable electronic device, the first processor 461 further checks the folding state of the electronic device 401 as well as the direction information of the electronic device 401 . can The folded state of the electronic device 401 may include an unfolded state and a closed state. For example, based on the direction information and/or the folding state of the electronic device 401 , the electronic device 401 performs the location information of each of the plurality of audio output devices in the electronic device 401 in each audio output device according to location information. You can check the channel information of the audio data to be output. The first processor 461 ) receives channel information of audio data to be output by the plurality of audio output devices 441 , 443 , 445 , and 447 based on the direction information and/or the folding state of the electronic device 401 . may be transmitted to the second processor 463 . The second processor 463) outputs a plurality of audio outputs so that each audio output device 441 , 443 , 445 , or 447 outputs audio data of a corresponding channel based on the channel information received from the first processor 461 . Devices 441 , 443 , 445 , and 447 may be controlled.

The electronic device 401 according to various embodiments includes a plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , a third audio output device 445 , and a fourth audio output device 447 ), and the plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , a third audio output device 445 , and a second and a processor (460) operatively connected to 4 audio output device (447), wherein the processor (460) checks direction information of the electronic device (401) based on detecting the output of audio data and, based on the direction information of the electronic device 401, transmit channel information of audio data to be output by each of the plurality of audio output devices to the respective audio output devices, and based on the channel information, Each audio output device may be configured to select a channel and control the plurality of audio output devices to output audio data of the selected channel.

The processor 460 according to various embodiments generates the audio data as multi-channel audio data, and uses the generated multi-channel audio data to the plurality of audio output devices (eg, a first audio output device). device 441 , second audio output device 443 , third audio output device 445 , and fourth audio output device 447 ), wherein the multi-channel audio data includes a first channel may include audio data of the second channel and audio data of the second channel.

The processor 460 according to various embodiments of the present disclosure may transmit audio data of the first channel among the multi-channel audio data to the plurality of audio output devices (eg, a first to output through at least some of the audio output devices of the audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 , the at least part controls an audio output device of the multi-channel audio data, and transmits the second channel audio data among the multi-channel audio data to the plurality of audio output devices (eg, a first audio output device 441 and a second audio output device 443 ). ), the third audio output device 445 , and the fourth audio output device 447) may be configured to control the audio output devices of at least some other audio output devices.

The processor 460 according to various embodiments is based on detecting a change in the direction information of the electronic device 401, and the changed channel of audio data to be output by the respective audio output devices according to the changed direction information The plurality of audio output devices (eg, first one) transmit information to the respective audio output devices, and based on the changed channel information, the respective audio output devices select a channel and output audio data of the selected channel. It may be set to control the audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 .

The processor 460 according to various embodiments of the present disclosure may include, based on the changed channel information of the audio data, the audio data of the second channel among the received multi-channel audio data to the plurality of audio output devices ( Example: output through at least some audio output devices among the first audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 ) to control the at least some of the audio output devices, and to transmit the first channel audio data among the multi-channel audio data to the plurality of audio output devices (eg, a first audio output device 441, a second control the at least other audio output devices to output through the at least other audio output devices among the audio output device 443, the third audio output device 445, and the fourth audio output device 447 can be set to

The electronic device 401 according to various embodiments may include a foldable electronic device.

The electronic device 401 according to various embodiments is a foldable electronic device, and the processor 460 is configured to check a folding state of the electronic device 401 based on detecting the output of the audio data. can be set.

The processor 460 according to various embodiments of the present disclosure may include, based on the direction information of the electronic device 401 and/or the folding state, the plurality of audio output devices (eg, the first audio output device 441 ). , the second audio output device 443, the third audio output device 445, and the fourth audio output device 447) transmit second channel information of the audio data to be output to each audio output device, and the plurality of audio output devices (eg, the first audio output device 441 , the second audio It may be set to control the output device 443 , the third audio output device 445 , and the fourth audio output device 447 .

The processor 460 according to various embodiments includes a first processor 461 and a second processor 463 , and the first processor 461 is based on the direction information of the electronic device 401 . Thus, each of the plurality of audio output devices (eg, the first audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 ) The channel information of the audio data to be output is transmitted to the second processor 463, and the second processor 463 outputs audio data of a channel set to each audio output device based on the channel information. to control the plurality of audio output devices (eg, the first audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 ) can be set.

The second processor 436 according to various embodiments may include the plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , and a third audio output device 445 ). ), and the fourth audio output device 447) may be set to be included in each.

In various embodiments, the direction information of the electronic device 401 includes a portrait mode and a landscape mode, and the folded state of the electronic device 401 includes an unfolded state and a folded state of the electronic device 401 . 5A is a diagram 500 illustrating a hierarchical structure of an electronic device 401 according to various embodiments of the present disclosure.

Referring to FIG. 5A , an electronic device (eg, the electronic device 401 of FIG. 4 ) may include software and hardware.

In one embodiment, software (eg, program 140 in FIG. 1 ) transfers from non-volatile memory (eg, non-volatile memory 134 in FIG. 1 ) to volatile memory (eg, volatile memory 132 in FIG. 1 ). It may be loaded and executed by a processor (eg, the processor 460 of FIG. 4 ). The software may include an application layer 510 , a platform layer 520 , a kernel layer 530 , and/or an audio layer 540 .

In one embodiment, the hardware may include an input/output device 550 . For example, the input/output device 550 includes the audio output device 551 (eg, the first audio output device 441 of FIG. 4 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447).

In an embodiment, the application layer 510 , the platform layer 520 , the kernel layer 530 , and the audio layer 540 may be executed in a first processor (eg, the first processor 461 of FIG. 4 ). . The input/output device 550 may be controlled by a second processor (eg, the second processor 463 of FIG. 4 ).

In various embodiments, the application layer 510 may include a media application 511 (eg, the media player 273 of FIG. 2 ).

In various embodiments, the media application 511 provides a function related to audio playback (eg, a function for activating audio playback, a function for deactivating audio playback, a function for adjusting a volume during audio playback, an audio equalizer function, or an audio playback function). It may include an application for controlling the function). The media application 511 may provide a user interface that allows a user to control a function related to audio reproduction. When a user input is received from the user interface, the media application 511 may transmit setting information corresponding to the received user input to the audio framework 523 of the platform layer 520 .

In various embodiments, the media application 511 may output multi-channel audio data. For example, the multi-channel audio data may include various types of multi-channel audio data used to provide stereoscopic sound such as 2-channel (or stereo), 2.1-channel, 5.1-channel, and 7.1-channel audio. The media application 511 may generate multi-channel audio data by processing the output audio data. For example, assuming that multi-channel audio data is two-channel audio data, the media application 511 provides audio data of a first channel (eg, L channel) and audio data of a second channel (eg, R channel). can create

In various embodiments, the media application 511 transmits the generated audio data of a first channel (eg, L channel) and audio data 563 of a second channel (eg, R channel) to the platform layer 520 and the kernel. It may be transmitted to the stream module 541 of the audio layer 540 through the layer 530 .

In various embodiments, the platform layer 520 includes a multimedia framework 521 (eg, multimedia manager 205 of FIG. 2 ), an audio framework 523 (eg, FIG. 2 ). of the multimedia manager 205), and/or an audio hardware abstraction layer (HAL) 525 (eg, the multimedia manager 205 of FIG. 2 ). The audio hardware abstraction layer 525 may include a control module 527 .

In various embodiments, the control module 527 of the audio hardware abstraction layer 525 provides control data 565 for controlling the plurality of audio output devices 441 , 443 , 445 , and 447 , such as , the plurality of audio output devices 441 , 443 , 445 , and 447 may transmit channel information of audio data to be output to the input/output device 550 . For example, channel information of audio data to be finally output from each audio output device 441 , 443 , 445 , or 447 according to the direction information of the electronic device 401 is stored in a memory (eg, the memory 420 of FIG. 4 ). may have been The control module 527 transmits channel information of audio data to be output by each audio output device 441 , 443 , 445 , or 447 according to the direction information of the electronic device 401 stored in the memory 420 to the input/output device 550 . can be forwarded to

In various embodiments, the multimedia framework 521 may provide an application programming interface (API) related to playback of audio played by the media application 511 . The multimedia framework 521 may convert the audio data to be reproduced into a format (eg, a pulse code modulation (PCM) data format) that can be provided to the audio layer 540 in a manner of decoding the audio data to be reproduced.

In various embodiments, the multimedia framework 521 transmits information about the audio data (eg, a sampling rate of the audio data, the number of channels, and/or the bit-width of the audio data) to the audio data. may be transmitted to the framework 523 .

In various embodiments, the audio framework 523 may be supported by a component (eg, the audio output device 440 of FIG. 4 ) of the electronic device 401 to which the media application 511 may output audio. functions can be provided.

In various embodiments, the audio framework 523 may receive audio data transmitted by the multimedia framework 521 and convert the received audio data into an audio stream. The audio stream may mean audio data divided in various ways. For example, the audio stream may mean audio data divided according to the size of a buffer required to process the audio stream. The buffer may include a buffer implemented on the stream module 541 . For example, the audio stream includes an audio stream including audio provided by the media application 511 requiring a buffer having a relatively large size, an audio stream provided by a notification application or a phone application requiring a buffer having a relatively small size ( For example: Noti sounds, ring-tone sounds). The audio stream may be classified according to an output channel or an output device.

In various embodiments, audio hardware abstraction layer 525 is an abstraction layer between hardware (eg, input/output device 550 ) and media application 511 , multimedia framework 521 , or audio framework 523 . can manage The audio hardware abstraction layer 525 receives information on the input/output device 550 transmitted by the audio framework 523, generates a control signal for controlling the input/output device 550, and sends the control signal to the audio driver ( audio driver) 533 .

In various embodiments, the audio hardware abstraction layer 525 is based on information on the audio stream (eg, the sampling rate of the audio stream, the number of channels, and/or the size of the audio stream), information on the input/output device 550 . to control the audio driver 533 .

In various embodiments, the kernel layer 530 may be a layer in which entities that control hardware outputting audio (eg, the input/output device 550) are implemented. The kernel layer 530 is an advanced linux sound architecture (ALSA) API & SOC core that provides an interface between an audio driver 533 and an audio hardware abstraction layer 525 and an audio driver 533 that control hardware outputting audio. (system-on-a-chip core) 531 may be included.

In various embodiments, the audio driver 533 receives a control signal transmitted by the audio hardware abstraction layer 525 and controls hardware (eg, the input/output device 550 ) that outputs audio based on the control signal. can

In various embodiments, the audio layer 540 may process the audio stream generated by the application layer 510 and the platform layer 520 and perform various operations for outputting the audio stream to the input/output device 550 . have. The audio layer 540 may include a stream module 541 , a device module 543 , and/or a port module 545 .

In various embodiments, the stream module 541 may receive an audio stream and a control signal transmitted from the audio hardware abstraction layer 525 of the platform layer 520 , and process the audio stream based on the control signal. A stream processing module 542 included in the stream module 541 receives a control signal requesting audio reproduction, applies various effects (eg, sound field effect) to the received audio stream, and processes it. The converted audio stream may be transmitted to the device module 543 . The stream processing module 542 may process an audio stream for each audio stream unit. The stream processing module 542 may include a buffer to process the audio stream.

In various embodiments, the device module 543 may include a device processing module 544 that performs post-processing on the audio stream transmitted from the stream module 541 . .

In various embodiments, the port module 545 may include an output port module 546 that allocates an audio stream transmitted by the device module 543 to an output port.

In various embodiments, the input/output device 550 receives channel information (eg, control data 565 ) of audio data to be output by a plurality of audio output devices from the control module 527 of the audio hardware abstraction layer 525 . can do.

In various embodiments, the input/output device 550 transmits audio data of a first channel (eg, L channel) and audio data 563 of a second channel (eg, R channel) output from the media application 511 . It may be received through the stream module 541 , the device module 543 , and the port module 545 of the layer 540 . The audio data 563 of the first channel (eg, L channel) and the audio data 563 of the second channel (eg, R channel) are original audio data of the first channel and the audio data of the second channel that do not go through separate processing. may include

In various embodiments, the input/output device 550 receives the audio output device 551 according to direction information of the electronic device 401 from the control module 527 of the audio hardware abstraction layer 525 through the kernel layer 530 . Control data 565 for controlling, for example, may receive channel information of audio data to be output by the plurality of audio output devices 441 , 443 , 445 , 447 .

According to various embodiments, each audio output device 441 , 443 , 445 , 447 included in the input/output device 550 includes audio data of a first channel (eg, L channel) or second audio data based on channel information. Audio data 563 of a channel (eg, R channel) may be output 561 .

In various embodiments, when the electronic device 401 is configured as a foldable device, the input/output device 550 receives the control module 527 of the audio hardware abstraction layer 525 from the electronic device ( Control data 565 for controlling the plurality of audio output devices 441 , 443 , 445 , and 447 according to the direction information and/or the folding state of the 401 , for example, the plurality of audio output devices 441 , 443 , 445 and 447 may receive channel information of audio data to be output.

FIG. 5B is a diagram 570 for explaining a method of outputting multi-channel audio data according to direction information of the electronic device 401, according to various embodiments of the present disclosure.

Referring to FIG. 5B , a media application 511 of the application layer 510 includes an L channel (left channel) (eg, a first channel) audio data and an R channel (right channel) (eg, a second channel). ) of the audio data may be reproduced 571 .

In one embodiment, the audio data of the L channel (eg, the first channel) and the audio data 571 of the R channel (eg, the second channel) are reproduced without separate processing 573 of the audio layer 540 . It may be transmitted to the port module 545 through the stream module 541 and the device module 543 . The port module 545 transmits the audio data of the L channel (eg, the first channel) and the audio data 571 of the R channel (eg, the second channel) reproduced through one output port to the audio output device, for example, the first An amplifier (eg, the first audio output device 441 of FIG. 4 ), a second amplifier (eg, the second audio output device 443 of FIG. 4 ), a third amplifier (eg, the third audio output device of FIG. 4 ) 445 ), and a fourth amplifier (eg, the fourth audio output device 447 of FIG. 4 ) may output 575 .

In one embodiment, the control module 527 of the audio hardware abstraction layer 525 controls the audio data to be output by each amplifier according to direction information (eg, portrait mode and landscape mode) of the electronic device 401 through the control software. Channel information (eg, L channel (eg, first channel) information and R channel (eg, second channel) information) to an audio output device such as the first amplifier, the second amplifier, the third amplifier, and the fourth amplifier Can transmit (577).

In one embodiment, each amplifier (eg, the first amplifier, the second amplifier, the third amplifier, or the fourth amplifier) outputs audio data of the L channel or the audio data of the R channel based on the received channel information ( 579) can be done. For example, when the direction information of the electronic device 401 is in the portrait mode, the electronic device 401 controls the first amplifier and/or the third amplifier to output L-channel audio data based on the received channel information, Each amplifier may be controlled so that the second amplifier and/or the fourth amplifier output audio data of the R channel. For another example, when the direction information of the electronic device 401 is in a landscape mode, the electronic device 401 may cause the first amplifier and/or the second amplifier to output R channel audio data based on the received channel information. and each amplifier may be controlled so that the third amplifier and/or the fourth amplifier output L-channel audio data.

6 is a flowchart 600 for explaining a method of outputting multi-channel audio data according to direction information of the electronic device 401, according to various embodiments of the present disclosure.

Referring to FIG. 6 , the processor (eg, the processor 460 of FIG. 4 ) (eg, the first processor 461 of FIG. 4 ) of the electronic device (eg, the electronic device 401 of FIG. 4 ) in operation 605 . , the output of audio data can be detected.

In an embodiment, the processor 460 (eg, the first processor 461 ) may detect output of audio data through a media application (eg, the media application 511 of FIG. 5A ). The audio data may include multi-channel audio data. The multi-channel audio data may include various types of multi-channel audio data used to provide stereoscopic sound such as 2-channel (or stereo), 2.1-channel, 5.1-channel, and/or 7.1-channel audio. .

In an embodiment, the processor 460 (eg, the first processor 461 ) may process audio data output through the media application 511 to generate multi-channel audio data.

In the following embodiment, it is assumed that multi-channel audio data is 2-channel audio data. For example, the processor 460 may generate audio data as audio data of a first channel (eg, L channel) and audio data of a second channel (eg, R channel).

In an embodiment, the processor 460 (eg, the first processor 461 ) transmits the generated audio data of the first channel (eg, L channel) and the audio data of the second channel (eg, R channel) to the platform layer. (eg, the platform layer 520 of FIG. 5A ), a kernel layer (eg, the kernel layer 530 of FIG. 5A ), and an input/output device (eg, the audio layer 540 of FIG. 5A ) through It may be transmitted to the input/output device 550 of FIG. 5A (eg, the second processor 463 of FIG. 4 ).

In an embodiment, the processor 460 (eg, the first processor 461 ) may check direction information of the electronic device 401 in operation 610 . For example, processor 460 (eg, first processor 461 ) may electronically via sensor circuitry (eg, sensor circuit 430 of FIG. 4 ) (eg, an acceleration sensor, a geomagnetic sensor, and/or a gyro sensor). A direction in which the first side surface of the device 401 (eg, the first side surface 311 of FIG. 3 ) faces may be determined. The processor 460 (eg, the first processor 461 ) receives movement information (eg, a movement direction of the electronic device 401 , a tilt of the electronic device 401 ) of the electronic device 401 through the sensor circuit 430 . , and based on this, a direction in which the first side surface 311 of the electronic device 401 faces may be determined.

In an embodiment, the orientation information of the electronic device 401 may include a portrait mode and a landscape mode.

In an embodiment, the processor 460 (eg, the first processor 461 ) transmits channel information of audio data to be finally output to each audio output device based on the direction information of the electronic device 401 in operation 615 . can be transmitted

In various embodiments, the electronic device 401 may include a plurality of audio output devices. For example, the plurality of audio output devices may include a first audio output device (eg, the first audio output device 321 of FIG. 3 ) and a second audio output device (eg, the second audio output device 323 of FIG. 3 ). , a third audio output device (eg, the third audio output device 325 of FIG. 3 ) and a fourth audio output device (eg, the fourth audio output device 327 of FIG. 3 ).

In various embodiments, the direction information of the electronic device 401 includes a position and an electronic device in which a plurality of audio output devices are disposed when the electronic device 401 is viewed from the front in a portrait mode (eg, reference number <310>). When the direction information of the device 401 is viewed from the front when the electronic device 401 is viewed in a landscape mode (eg, reference number <350>), the positions at which the plurality of audio output devices are arranged may be different.

For example, when the direction information of the electronic device 401 is viewed from the front in the portrait mode, the first audio output device 321 is disposed on the upper left side of the electronic device 401 and the electronic device ( When the direction information of the 401 is viewed from the front of the electronic device 401 in the landscape mode, it may be confirmed that the first audio output device 321 is disposed on the upper right side of the electronic device 401 .

As another example, when the direction information of the electronic device 401 is viewed from the front when the electronic device 401 is viewed in a portrait mode (eg, reference number <310>), the second audio output device 323 may display the electronic device ( The second audio output device 323 is disposed on the upper right side of the electronic device 401 when the direction information of the electronic device 401 is viewed from the front in the landscape mode. It can be confirmed that it is placed in

As another example, when the direction information of the electronic device 401 is viewed from the front of the electronic device 401 in a portrait mode (eg, reference number <310>), the third audio output device 325 is the electronic device The third audio output device 325 is disposed on the lower left side of the electronic device 401 when the direction information of the electronic device 401 is viewed from the front in the landscape mode. It can be confirmed that it is disposed on the top.

As another example, when the direction information of the electronic device 401 is viewed from the front when the electronic device 401 is viewed in a portrait mode (eg, reference number <310>), the fourth audio output device 327 is the electronic device The fourth audio output device 327 is disposed on the lower right side of the electronic device 401 and the direction information of the electronic device 401 is the left side of the electronic device 401 when the electronic device 401 is viewed from the front in the landscape mode. It can be confirmed that it is arranged at the bottom.

In an embodiment, the processor 460 (eg, the first processor 461 ) outputs, based on direction information of the electronic device 401 , audio data of a channel according to location information of each of the plurality of audio output devices. (eg, based on the type of audio data (eg, channel type), each of the plurality of audio output devices outputs different types of audio data (eg, channel)) may be transmitted to each audio output device (eg, the second processor 463 ). For example, the processor 460 (eg, the first processor 461 ), for example, the control module 527 included in the audio hardware abstraction layer 525 of the platform layer 520 , control data for controlling the plurality of audio output devices 321, 323, 325, and 327 according to It may be transmitted to the input/output device 550 (eg, the second processor 463 ).

In various embodiments, based on direction information of the electronic device 401 as shown in <Table 1> and <Table 2>, each audio output device 321 , 323 , 325 , or 327 Channel information of audio data to be finally output by each audio output device 321 , 323 , 325 , or 327 may be stored in a memory (eg, the memory 420 of FIG. 4 ).

audio output device The orientation information of the electronic device is the position where the audio output device is placed in portrait mode. of the final output audio data.
Channel information first audio output device 321 upper left 1st channel (eg L channel) second audio output device (323) top right 2nd channel (e.g. R channel) third audio output device (325) bottom left 1st channel (eg L channel) Fourth audio output device (327) bottom right 2nd channel (e.g. R channel)

audio output device The orientation information of the electronic device is the position where the audio output device is placed in landscape mode. of the final output audio data.
Channel information first audio output device 321 in the upper-right 2nd channel (e.g. R channel) second audio output device (323) bottom right 2nd channel (e.g. R channel) third audio output device (325) upper left 1st channel (eg L channel) Fourth audio output device (327) bottom left 1st channel (eg L channel)

In an embodiment, the processor 460 (eg, the second processor 463 ) transmits all audio data to each audio output device in operation 620 , and a channel to be finally output from each audio output device based on channel information. may be selected to control the plurality of audio output devices to output audio data. For example, channel information of audio data to be output by the plurality of audio output devices 321 , 323 , 325 , and 327 received from the control module 527 included in the audio hardware abstraction layer 525 (eg, <Table 1) > or <Table 2>), the processor 460 (eg, the second processor 463 ) controls each audio output device 321 , 323 , 325 , or 327 to output audio data of a corresponding channel can do.

For example, the processor 460 (eg, the second processor 463 ) receives audio data of the first channel received by the first audio output device 321 and the third audio output device 325 from the media application 511 . output, and the second audio output device 323 and the fourth audio output device 327 may control to output audio data of the second channel received from the media application 511 .

For another example, the processor 460 (eg, the second processor 463 ) controls the third audio output device 325 and the fourth audio output device 327 to output audio data of the first channel, The first audio output device 321 and the second audio output device 323 may be controlled to output audio data of the second channel.

Channel information of audio data to be output by each audio output device according to <Table 1> and <Table 2> according to various embodiments of the present disclosure is only one embodiment, but is not limited thereto.

6 , the electronic device 401 generates through the media application 511 based on channel information of audio data to be output by the plurality of audio output devices received through the control module 527 in FIG. 6 according to various embodiments. In order to output the audio data of the first channel (eg, L channel) and the audio data of the second channel (eg, R channel) (eg, the first and second audio data of the original that do not undergo separate processing) By controlling the audio output devices, it is possible to minimize a time delay according to the processing of audio data. Accordingly, when content such as a game and/or live streaming requiring real-time performance is reproduced, a sense of difference between audio data and image data can be resolved, and thus the usability of the electronic device 401 can be increased.

7 is a flowchart 700 for explaining a method of outputting multi-channel audio data based on a change in direction information of the electronic device 401 according to various embodiments of the present disclosure.

Operations of FIG. 7 according to various embodiments may be additional operations of operation 620 of FIG. 6 described above.

Referring to FIG. 7 , the processor (eg, the processor 460 of FIG. 4 ) (eg, the first processor 461 of FIG. 4 ) of the electronic device (eg, the electronic device 401 of FIG. 4 ) performs operation 705 . , whether the direction information of the electronic device 401 has been changed (eg, switched) may be determined. For example, the change of direction information of the electronic device 401 may include changing from a portrait mode (eg, reference number <310> in FIG. 3 ) to a landscape mode (eg, reference number <350> in FIG. 3 ) and a landscape mode (eg, reference number <350> in FIG. 3 ). : A change from reference number <350> of FIG. 3) to a portrait mode (eg, reference number <310> of FIG. 3) may include a change. The processor 460 (eg, the first processor 461 ) acquires motion information of the electronic device 401 through a sensor circuit (eg, the sensor circuit 430 of FIG. 4 ), and based on this, the electronic device ( 401), it may be determined whether the direction information has been changed (eg, switched).

In an embodiment, when the direction information of the electronic device 401 is changed (eg, YES in operation 705 ), the processor 460 (eg, the first processor 461 ) performs the operation of the electronic device 401 in operation 710 . Based on the changed direction information, changed channel information of audio data to be finally output may be transmitted to each audio output device. For example, as the direction information of the electronic device 401 is switched from the portrait mode (or landscape mode) to the landscape mode (or portrait mode), the plurality of audio output devices 321 when the electronic device 401 is viewed from the front , 323 , 325 , and 327 ) may also be arranged, and accordingly, channel information of audio data to be finally output may also be changed.

In an embodiment, the processor 460 (eg, the first processor 461 ), for example, the control module 527 included in the audio hardware abstraction layer 525 of the platform layer 520 , Changed control data for controlling the plurality of audio output devices 321 , 323 , 325 , and 327 according to the changed direction information, for example, audio to be output by the plurality of audio output devices 321 , 323 , 325 , and 327 The changed channel information of data may be transmitted to the input/output device 550 (eg, the second processor 463 ).

In an embodiment, the processor 460 (eg, the second processor 463 of FIG. 4 ) transmits all audio data to each audio output device in operation 715 , and transmits the entire audio data to each audio output device based on the changed channel information. The plurality of audio output devices 321 , 323 , 325 , and 327 may be controlled to output audio data by selecting a channel to be finally outputted.

For example, the plurality of audio output devices 321 , 323 , 325 , and 327 according to the changed direction information of the electronic device 401 received from the control module 527 included in the audio hardware abstraction layer 525 may output Based on the changed channel information (eg, <Table 1> or <Table 2>) of the audio data, the processor 460 (eg, the second processor 463) is configured to each audio output device 321 , 323 , 325 , or 327) may output audio data of the corresponding channel.

For example, when the direction information of the electronic device 401 is changed from the portrait mode to the landscape mode, the processor 460 (eg, the second processor 463 ) is configured to control each audio output device 321 based on Table 2 above. , 323, 325, or 327) may output audio data of a corresponding channel. In this case, the processor 460 (eg, the second processor 463 ) controls the third audio output device 325 and the fourth audio output device 327 to output audio data of the first channel, and the first The audio output device 321 and the second audio output device 323 may be controlled to output audio data of the second channel.

As another example, when the direction information of the electronic device 401 is changed from the landscape mode to the portrait mode, the processor 460 (eg, the second processor 463 ) outputs each audio based on the aforementioned <Table 1>. The device 321 , 323 , 325 , or 327 may output audio data of a corresponding channel. In this case, the processor 460 (eg, the second processor 463 ) controls the first audio output device 321 and the third audio output device 325 to output audio data of the first channel, and the second The audio output device 323 and the fourth audio output device 327 may be controlled to output audio data of the second channel.

In an embodiment, when the direction information of the electronic device 401 is not changed (eg, NO in operation 705), the processor 460 (eg, the second processor 463) performs operation 620 of FIG. 6 described above. You can continue to do it.

In FIG. 7 according to various embodiments of the present disclosure, when direction information of the electronic device 401 is changed while audio data is being output, the processor 460 (eg, the first processor 461 ) dynamically controls the electronic device 401 . The changed channel information of audio data may be transmitted to each audio output device 321 , 323 , 325 , or 327 by checking the direction information of . Each audio output device (eg, the second processor 463 ) may output audio data of a corresponding channel based on the changed channel information. Accordingly, when detecting a change in direction information of the electronic device 401, the plurality of audio output devices output audio data based on the changed channel information of the audio data without additional processing on the audio data, thereby generating audio data It is possible to prevent deterioration in usability of the electronic device 401 due to processing delay.

FIG. 8A is a diagram 800 illustrating a flat state or an opening state of an electronic device 801 according to various embodiments of the present disclosure. 8B is a diagram 870 illustrating a folding state or a closing state of the electronic device 801 according to various embodiments of the present disclosure.

Although the electronic device (eg, the electronic device 301 of FIG. 3 ) is described as having a plate type form factor in FIG. 3 according to various embodiments, the present disclosure is not limited thereto. For example, the electronic device 801 may have a form factor of a foldable type (eg, an in-folding type or an out-folding type) as shown in FIGS. 8A and 8B .

8A and 8B , an electronic device 801 (eg, the electronic device 401 of FIG. 4 ) is a pair of housing structures that are rotatably coupled through a hinge structure 825 to be folded with respect to each other. (eg, the first housing structure 820 and the second housing structure 830) (eg, a foldable housing structure).

In an embodiment, the first housing structure 820 and the second housing structure 830 may be disposed on both sides about the folding axis 880 , and may have an overall symmetrical shape with respect to the folding axis 880 .

In one embodiment, as shown in FIG. 8A , when the electronic device 801 is in a flat state or an opening state, the first housing structure 820 and the second housing structure 830 are at an angle of 180 degrees. can achieve

In various embodiments, reference number <810> of FIG. 8A indicates a state in which direction information of the electronic device 801 is unfolded in a portrait mode, and reference number <850> of FIG. 8A indicates a direction of the electronic device 801 It is a diagram showing the unfolded state of information in landscape mode.

In various embodiments, the electronic device 801 may check direction information and/or a folding state of the electronic device 801 through a sensor (eg, the sensor circuit 430 of FIG. 4 ). The direction information of the electronic device 301 may include a portrait mode (eg, a state of reference number <810>) and a landscape mode (eg, a state of reference number <850>). The folded state of the electronic device 801 may include an unfolded state and a closed state.

For example, in the unfolded state of the orientation information of the electronic device 801 in the portrait mode, as shown in reference numeral <810>, the first side surfaces 821 and 831 of the electronic device 801 are in the first direction (eg: ① direction), and the second side surfaces 822 and 832 of the electronic device 801 are disposed to face in a second direction (eg, direction ②) opposite to the first direction (eg, direction ①) It can include status.

As another example, in the unfolded state of the direction information of the electronic device 801 in the landscape mode, as shown in reference numeral 850, the third side surface 823 of the electronic device 801 moves in the first direction (eg, : A state in which the fourth side surface 833 of the electronic device 801 faces in the direction of ①), and the fourth side 833 of the electronic device 801 faces in a second direction (eg, the direction of ②) opposite to the first direction (eg, the direction of ①). may include

In various embodiments, the electronic device 801 may include a plurality of audio output devices 841 , 843 , 845 , and 847 . The plurality of audio output devices 841 , 843 , 845 , and 847 may be provided in the first housing 820 and the second housing 830 rotated around the hinge structure 825 of the electronic device 801 . . For example, each of the plurality of audio output devices 841 , 843 , 845 , and 847 may be located on a side surface (eg, the first side surface 821 , 831 , and the second side surface 822 , 832 ) of each housing.

In an embodiment, the plurality of audio output devices 841 , 843 , 845 , and 847 may be located at positions corresponding to each other. For example, the first audio output device 841 (eg, the first audio output device 441 of FIG. 4 ) is positioned on the first side 821 of the first housing 820 , and correspondingly to the first housing 820 ( A second audio output device 845 (eg, the third audio output device 445 of FIG. 4 ) may be positioned on the second side 822 of the 820 . Corresponding to the first audio output device 841 positioned on the first side 821 of the first housing 820 , on the first side 831 of the second housing 830 foldable with the first housing 820 . A second audio output device 843 (eg, the second audio output device 443 in FIG. 4 ) is positioned, correspondingly to the second side 832 of the second housing 830 , a fourth audio output device ( 847) (eg, the fourth audio output device 447 of FIG. 4 ) may be located.

According to various embodiments, when the electronic device 801 has a form factor of a foldable type (eg, an in-folding type or an out-folding type), a plurality of audio outputs disposed in the electronic device 801 The positions of the devices 841 , 843 , 845 , and 847 are not limited to the embodiment of FIG. 8A described above.

In various embodiments, when the electronic device 801 is viewed from the front in a portrait mode and an unfolded state (eg, reference numeral <810>), a position where a plurality of audio output devices are disposed and an electronic device When the electronic device 801 is viewed from the front in the landscape mode and the unfolded state (eg, reference numeral <850>), the positions at which the plurality of audio output devices are arranged may be different.

For example, as shown in reference numeral <810>, when the electronic device 801 is viewed from the front in the portrait mode and the unfolded state, the first audio output device 841 is the electronic device ( The second audio output device 843 may be disposed on the upper left side of the electronic device 801 , and the third audio output device 845 may be disposed on the lower side of the electronic device 801 . It may be disposed on the left side, and the fourth audio output device 847 may be disposed on the lower right side of the electronic device 801 .

For another example, as shown by reference numeral 850, when the electronic device 801 is viewed from the front in the landscape mode and the unfolded state, the first audio output device 841 is an electronic device. The device 801 may be disposed at the upper right, the second audio output device 843 may be disposed at the bottom right of the electronic device 801 , and the third audio output device 845 may be disposed at the bottom right of the electronic device 801 . The fourth audio output device 847 may be disposed at the upper left side of , and the fourth audio output device 847 may be disposed at the lower left side of the electronic device 801 .

Referring to FIG. 8B , when the electronic device 801 is in a folding state or a closing state, the first housing structure 820 and the second housing structure 830 may be disposed to face each other. When the electronic device 801 is in a folded state, the first audio output device 841 and the third audio output device 845 may be disposed to correspond to each other, and the second audio output device 843 and the fourth audio output device 847 may be disposed to correspond to each other.

In various embodiments, when the electronic device 801 of the electronic device 801 is viewed from the front in a portrait mode and a folded state, a position where a plurality of audio output devices are disposed and the electronic device 801 ) when the electronic device 801 is viewed from the front in the horizontal mode and the folded state, the positions at which the plurality of audio output devices are arranged may be different.

For example, when the electronic device 801 is viewed from the front in the portrait mode and the folded state, the first audio output device 841 and the second audio output device 843 are the electronic device 801 . The third audio output device 845 and the fourth audio output device 847 may be disposed on the lower right side of the electronic device 801 .

As another example, when the electronic device 801 is viewed from the front in the landscape mode and the folded state, the first audio output device 841 and the second audio output device 843 are the electronic devices It may be disposed on the right side of the 801 , and the third audio output device 845 and the fourth audio output device 847 may be disposed on the left side of the electronic device 801 .

In various embodiments, the electronic device 801 provides channel information of audio data to be finally output from each audio output device 841 , 843 , 845 , or 847 according to direction information and/or a folding state of the electronic device 801 . may be transmitted to each audio output device 841 , 843 , 845 , or 847 . For example, if audio data is described as audio data of two channels, the electronic device 801 converts the audio data of the first channel or the second channel based on the direction information and/or the folding state of the electronic device 801 . To output the audio data, channel information including the first channel information or the second channel information of the audio data may be transmitted to each audio output device 841 , 843 , 845 , or 847 .

Each audio output device 841 , 843 , 845 , or 847 outputs channel information of audio data to be finally output according to the direction information and/or the folding state of the electronic device 801 described above according to various embodiments. With respect to the embodiment of transmitting to the device 841 , 843 , 845 , or 847 , various embodiments will be described below with reference to FIGS. 9 to 10B .

9 is a flowchart 900 for explaining a method of outputting multi-channel audio data according to direction information and/or a folding state of the foldable electronic device 801 according to various embodiments of the present disclosure.

Referring to FIG. 9 , a processor (eg, the processor 460 of FIG. 4 ) of an electronic device (eg, the electronic device 401 of FIG. 4 , and the electronic device 801 of FIG. 8 ) (eg, the first step of FIG. 4 ) The processor 461 may detect output of audio data in operation 905 . In an embodiment, the processor 460 (eg, the first processor 461 ) processes audio data output through a media application (eg, the media application 511 of FIG. 5A ) to generate multi-channel audio data. can do. For example, assuming that multi-channel audio data is two-channel audio data, for example, the processor 460 converts the audio data into audio data of a first channel (eg, L channel) and a second channel (eg, R). channel) as audio data.

In an embodiment, the processor 460 (eg, the first processor 461 ) transmits the generated audio data of the first channel (eg, L channel) and the audio data of the second channel (eg, R channel) to the platform layer. (eg, the platform layer 520 of FIG. 5A ), a kernel layer (eg, the kernel layer 530 of FIG. 5A ), and an input/output device (eg, the audio layer 540 of FIG. 5A ) through It may be transmitted to the input/output device 550 of FIG. 5A (eg, the second processor 463 of FIG. 4 ).

In an embodiment, in operation 910 , the processor 460 may check direction information and/or a folding state of the electronic device 801 . The orientation information of the electronic device 801 may include a portrait mode and a landscape mode. The folded state of the electronic device 801 may include an unfolded state and a closed state.

In one embodiment, processor 460 (eg, first processor 461 ) includes sensor circuitry (eg, sensor circuit 430 of FIG. 4 ) (eg, an acceleration sensor, a geomagnetic sensor, and/or a gyro sensor). The direction in which the first side surface of the electronic device 801 (eg, the first side surfaces 821 and 831 of FIG. 8 ) faces is determined through , and direction information of the electronic device 801 may be confirmed based on the determined direction. In addition, the processor 460 (eg, the first processor 461 ) may be electronically configured via a sensor circuit 430 (eg, a proximity sensor, an infrared (IR) sensor, a hall sensor, a motion sensor, an angle sensor, or an illuminance sensor). the distance (or angle) between a first housing structure (eg, first housing structure 820 in FIG. 8 ) and a second housing structure (eg, second housing structure 830 in FIG. 8 ) of device 801 . Based on the folded state (eg, an unfolded state, a folded state, or an unfolded state of a predetermined angle) may be checked.

In an embodiment, the processor 460 (eg, the first processor 461 ) performs audio to be finally output to each audio output device based on direction information and/or a folding state of the electronic device 801 in operation 915 . It is possible to transmit channel information of data. The electronic device 801 may include a plurality of audio output devices. For example, the plurality of audio output devices may include a first audio output device (eg, the first audio output device 841 of FIG. 8 ) and a second audio output device (eg, the second audio output device 843 of FIG. 8 ). , a third audio output device (eg, the third audio output device 845 of FIG. 8 ) and a fourth audio output device (eg, the fourth audio output device 847 of FIG. 8 ).

In various embodiments, as shown in FIGS. 8A and 8B , a plurality of audio outputs when the electronic device 801 is viewed from the front in a portrait mode and/or in an unfolded state (or a folded state) A position in which the devices are arranged and a position in which the plurality of audio output devices are arranged when the electronic device 801 is viewed from the front in a landscape mode and/or in an unfolded (or folded state) state may be different. have.

In one embodiment, a control module included in the processor 460 (eg, the first processor 461 ), eg, an audio hardware abstraction layer (eg, the audio hardware abstraction layer 525 of FIG. 5A ) of the platform layer 520 ). (For example, the control module 527 of FIG. 5A ) provides control data for controlling the plurality of audio output devices 841 , 843 , 845 , 847 according to direction information and/or a folding state of the electronic device 801 . For example, the plurality of audio output devices 841 , 843 , 845 , and 847 may transmit channel information of audio data to be output to the input/output device 550 (eg, the second processor 463 ).

In various embodiments, each audio output device 841 , 843 , 845 , 847 is disposed based on direction information and/or a folding state of the electronic device 801 as shown in Tables 3 to 6 below. Channel information of audio data to be finally output from each of the audio output devices 841 , 843 , 845 , and 847 according to the selected location may be stored in a memory (eg, the memory 420 of FIG. 4 ).

audio output device The unfolded state and orientation information of the electronic device is the position where the audio output device is placed in portrait mode. of the final output audio data.
Channel information first audio output device (841) top of the first housing 1st channel (eg L channel) Second audio output device (843) top of the second housing 2nd channel (e.g. R channel) Third audio output device (845) lower end of the first housing 1st channel (eg L channel) Fourth audio output device (847) bottom of the second housing 2nd channel (e.g. R channel)

audio output device The unfolded state and orientation information of the electronic device is where the audio output device is placed in landscape mode. of the final output audio data.
Channel information first audio output device (841) right side of the first housing 2nd channel (e.g. R channel) Second audio output device (843) right side of the second housing 2nd channel (e.g. R channel) Third audio output device (845) left side of the first housing 1st channel (eg L channel) Fourth audio output device (847) left side of the second housing 1st channel (eg L channel)

audio output device The folded state and orientation information of the electronic device shows where the audio output device is placed in portrait mode. of the final output audio data.
Channel information first audio output device (841) top of the first housing 1st channel (eg L channel)
(or the second channel (eg R channel)) Second audio output device (843) top of the second housing 1st channel (eg L channel)
(or the second channel (eg R channel)) Third audio output device (845) lower end of the first housing 2nd channel (e.g. R channel)
(or the first channel (eg L channel)) Fourth audio output device (847) bottom of the second housing 2nd channel (e.g. R channel)
(or the first channel (eg L channel))

audio output device The folded state and orientation information of the electronic device shows where the audio output device is placed in landscape mode. of the final output audio data.
Channel information first audio output device (841) right side of the first housing 2nd channel (e.g. R channel)
(or the first channel (eg L channel)) Second audio output device (843) right side of the second housing 2nd channel (e.g. R channel)
(or the first channel (eg L channel)) Third audio output device (845) left side of the first housing 1st channel (eg L channel)
(or the second channel (eg R channel)) Fourth audio output device (847) left side of the second housing 1st channel (eg L channel)
(or the second channel (eg R channel))

In an embodiment, the processor 460 (eg, the second processor 463 of FIG. 4 ) transmits the entire audio data to each audio output device in operation 920 , and finally receives the final audio data from each audio output device based on channel information. A plurality of audio output devices may be controlled to output audio data by selecting a channel to be output. For example, channel information of audio data to be output by the plurality of audio output devices 841 , 843 , 845 , or 847 received from the control module 527 included in the audio hardware abstraction layer 525 (eg, <Table 3) >, <Table 4>, <Table 5>, or <Table 6>), the processor 460 (eg, the second processor 463 ) is configured to each audio output device 841 , 843 , 845 , or 847 . ) can be controlled to output the audio data of the corresponding channel.

For example, when the electronic device 801 is in the portrait mode and the unfolded state, the processor 460 (eg, the second processor 463 ) performs the first audio output device 841 and the third The audio output device 845 may be controlled to output the audio data of the first channel, and the second audio output device 843 and the fourth audio output device 847 may be controlled to output the audio data of the second channel .

As another example, when the electronic device 801 is in a landscape mode and an unfolded state, the processor 460 (eg, the second processor 463 ) performs the third audio output device 845 based on <Table 4> and controlling the fourth audio output device 847 to output the audio data of the first channel, and control the first audio output device 841 and the second audio output device 843 to output the audio data of the second channel can do.

As another example, when the electronic device 801 is in the portrait mode and the folded state, the processor 460 (eg, the second processor 463 ) is configured based on <Table 5>, in a second case, the processor 460 (eg, the second processor 463 ) controls the first audio output device 841 and the second audio output device 843 to output audio data of the first channel (or the second channel), and the third The audio output device 845 and the fourth audio output device 847 may be controlled to output audio data of the second channel (or the first channel).

As another example, when the electronic device 801 is in the landscape mode and the folded state, the processor 460 (eg, the second processor 463 ) performs the third audio output device 845 based on <Table 6>. ) and the fourth audio output device 847 to output the audio data of the first channel (or the second channel), and the first audio output device 841 and the second audio output device 843 to the second It is possible to control to output audio data of the channel (or the first channel).

However, the present invention is not limited thereto, and when the electronic device 801 is in the landscape mode and the folded state, the processor 460 (eg, the second processor 463 ) performs the third audio output device 845 and the fourth audio output device ( 847), control to output audio data of a first channel (eg, L channel) (or second channel (eg, R channel)) to one audio output device, and turn off the other audio output device. can be controlled When the electronic device 801 is in the landscape mode and the folded state, the processor 460 (eg, the second processor 463 ) is connected to one of the first audio output device 841 and the second audio output device 843 . It is possible to control to output audio data of a second channel (eg, an R channel) (or a first channel (eg, an L channel)) to an audio output device, and control another audio output device to be in an off state.

According to various embodiments, channel information of audio data to be finally output by each audio output device according to <Table 3> to <Table 6> is an exemplary embodiment, but is not limited thereto.

In an embodiment, the processor 460 (eg, the first processor 461 ) may determine whether to detect a change in direction information and/or a folding state of the electronic device 801 in operation 925 . For example, the change of direction information of the electronic device 801 may include a change from a portrait mode to a landscape mode and a change from the landscape mode to a portrait mode. The change of the folded state of the electronic device 801 may include a change from an unfolded state to a folded state and a change from a folded state to an unfolded state.

In an embodiment, if a change in direction information and/or a folding state of the electronic device 801 is not detected (eg, NO in operation 925 ), the processor 460 (eg, the first processor 461 ) performs operation 925 . can be continued.

In an embodiment, when detecting a change in direction information and/or a folding state of the electronic device 801 (eg, YES in operation 925), the processor 460 (eg, the first processor 461) in operation 930 , based on the changed direction information and/or the folding state of the electronic device 801 , the changed channel information of audio data to be finally output may be transmitted to each audio output device. For example, when direction information and/or a folding state of the electronic device 801 is changed, a plurality of audio output devices 841 , 843 , 845 , and 847 are disposed when the electronic device 801 is viewed from the front. Location information may also be changed, and accordingly, channel information of audio data to be finally output may also be changed.

In an embodiment, the processor 460 (eg, the first processor 461 ), for example, the control module 527 included in the audio hardware abstraction layer 525 of the platform layer 520 , Changed control data for controlling the plurality of audio output devices 841, 843, 845, and 847 according to the changed direction information and/or the folding state, for example, the plurality of audio output devices 841, 843, 845, 847 The changed channel information of audio data to be output may be transmitted to the input/output device 550 (eg, the second processor 463 ).

In an embodiment, the processor 460 transmits all audio data to each audio output device in operation 935, selects a channel to be finally output from each audio output device based on the changed channel information, and outputs audio data of audio output devices. For example, the processor 460 (eg, the second processor 463 ) may change the direction information of the electronic device 801 and/or the folding state received from the control module 527 included in the audio hardware abstraction layer 525 . Based on changed channel information (eg, <Table 3> to <Table 6>) of audio data to be output by the plurality of audio output devices 841, 843, 845, and 847, each audio output device 841, 843 , 845 , and 847 may control the plurality of audio output devices 841 , 843 , 845 , and 847 to output audio data of a corresponding channel.

A method of outputting multi-channel audio from an electronic device 401 according to various embodiments includes an operation of checking direction information of the electronic device 401 based on detecting output of audio data, the electronic device ( Based on the direction information of the 401 , a plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , a third audio output device 445 , and a fourth audio output device) The device 447) transmits channel information of audio data to be output to each audio output device, and based on the channel information, each audio output device selects a channel to output audio data of the selected channel controlling the plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , a third audio output device 445 , and a fourth audio output device 447 ). It can include actions.

The method of outputting multi-channel audio from the electronic device 401 according to various embodiments may further include generating the audio data as multi-channel audio data based on detecting the output of the audio data. can

In various embodiments, the multi-channel audio data may include audio data of a first channel and audio data of a second channel.

The plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , a third audio output device 445 , and a fourth audio output device ( 447)) may include, based on the channel information of the audio data, transmitting the audio data of the first channel among the multi-channel audio data through at least some of the audio output devices among the plurality of audio output devices. output, controlling at least some of the audio output devices, and outputting the audio data of the second channel among the multi-channel audio data through at least other audio output devices of the plurality of audio output devices , controlling the at least some other audio output devices.

In a method of outputting multi-channel audio from an electronic device 401 according to various embodiments, based on detecting a change in direction information of the electronic device 401, each audio output device according to the changed direction information transmitting changed channel information of audio data to be output to each audio output device, and based on the changed channel information, the plurality of audio output devices select a channel to output audio data of the selected channel The operation of controlling the audio output devices (eg, the first audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 ) is further performed. may include

Based on the changed channel information according to various embodiments, the plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , and a third audio output device 445 ) , and the operation of controlling the fourth audio output device 447 may include converting the audio data of the second channel among the audio data of the multi-channel to the plurality of audio output devices based on the changed channel information of the audio data. controlling the at least some audio output devices to output through the at least some audio output devices, and outputting the first channel audio data among the multi-channel audio data among the plurality of audio output devices and controlling the at least other part of the audio output device to output it through at least another part of the audio output device.

In various embodiments, the electronic device 401 is a foldable electronic device (eg, the electronic device 401 of FIG. 4 and the electronic device 801 of FIG. 8 ), and a method of outputting multi-channel audio of the electronic device may further include checking a folding state of the electronic device 801 based on detecting the output of the audio data.

In the method of outputting multi-channel audio of the electronic device 401 according to various embodiments, each of the plurality of audio output devices outputs the output based on direction information and/or the folding state of the electronic device 401 transmitting second channel information of the audio data to be prepared to the respective audio output devices, and based on the second channel information, the plurality of audio output devices select a channel to output audio data of the selected channel The operation of controlling the audio output devices (eg, the first audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 ) is further performed. may include

In various embodiments, the operation of transmitting the channel information of the audio data to each audio output device is performed by the first processor 461 of the electronic device 401 to the plurality of audio output devices (eg, the first processor 461 ). Each of the first audio output device 441 , the second audio output device 443 , the third audio output device 445 , and the fourth audio output device 447 ) transmits channel information of audio data to be output to the electronic device ( and transmitting to the second processor 463 of 401 .

In various embodiments, the plurality of audio output devices (eg, a first audio output device 441 , a second audio output device 443 , a third audio output device 445 , and a fourth audio output device ( 447)), the second processor 463 controls the plurality of audio output devices to output audio data of a channel set to each audio output device based on the channel information. It can include actions.

In various embodiments, the direction information of the electronic device 401 includes a portrait mode and a landscape mode, and the folded state of the electronic device 401 and 801 includes an unfolded state of the electronic device 401 and 801 . It may include a state and a folded state. The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C" each may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to various embodiments of the present document, one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101) may be implemented as software (eg, the program 140) including For example, a processor (eg, processor 120 ) of a device (eg, electronic device 101 ) may call at least one command among one or more commands stored from a storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to an embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly between smartphones (eg: smartphones) and online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

401: electronic device 410: communication circuit
420: memory 430: sensor circuit
440: audio output device 450: touch screen display
460: processor

Claims (20)

In an electronic device,
a plurality of audio output devices; and
a processor operatively coupled to the plurality of audio output devices;
The processor is
Based on detecting the output of the audio data, check the direction information of the electronic device,
Transmitting channel information of audio data to be output by each of the plurality of audio output devices to each audio output device based on the direction information of the electronic device, and
an electronic device configured to control the plurality of audio output devices so that each audio output device selects a channel and outputs audio data of the selected channel based on the channel information. The method of claim 1,
The processor is
generating the audio data as multi-channel audio data; and
configured to transmit the generated multi-channel audio data to the plurality of audio output devices;
The multi-channel audio data includes audio data of a first channel and audio data of a second channel. 3. The method of claim 2,
The processor is
Output the at least part of the audio data to output the audio data of the first channel among the audio data of the multi-channel through at least some of the audio output devices among the plurality of audio output devices based on the channel information of the audio data control the device; and
an electronic device configured to control the at least some other audio output devices to output the second channel audio data among the multi-channel audio data through at least other audio output devices among the plurality of audio output devices. 4. The method of claim 3,
The processor is
Transmitting, to each audio output device, changed channel information of audio data to be output by each audio output device according to the changed direction information, to each audio output device based on detecting a change in the direction information of the electronic device, and
an electronic device configured to control the plurality of audio output devices so that each audio output device selects a channel and outputs audio data of the selected channel based on the changed channel information. 5. The method of claim 4,
The processor is
outputting the audio data of the second channel among the received multi-channel audio data through the at least some audio output devices among the plurality of audio output devices based on the changed channel information of the audio data; control at least some audio output devices, and
an electronic device configured to control the at least other audio output devices to output the first channel audio data among the multi-channel audio data through the at least other audio output devices among the plurality of audio output devices . The method of claim 1,
The electronic device includes a foldable electronic device. 7. The method of claim 6,
The electronic device is a foldable electronic device,
The processor is
an electronic device configured to check a folding state of the electronic device based on detecting the output of the audio data. 8. The method of claim 7,
The processor is
Transmitting second channel information of audio data to be output by each of the plurality of audio output devices to each audio output device based on the direction information and/or the folding state of the electronic device, and
an electronic device configured to control the plurality of audio output devices so that each audio output device selects a channel and outputs audio data of the selected channel based on the second channel information. The method of claim 1,
The processor includes a first processor and a second processor,
The first processor,
transmit channel information of audio data to be output by each of the plurality of audio output devices to the second processor based on the direction information of the electronic device;
The second processor,
an electronic device configured to control the plurality of audio output devices to output audio data of a channel set to each audio output device based on the channel information. 10. The method of claim 9,
The second processor,
An electronic device configured to be included in each of the plurality of audio output devices. 9. The method of claim 8,
The direction information of the electronic device includes a portrait mode and a landscape mode, and
The folded state of the electronic device includes an unfolded state and a folded state of the electronic device. A method for outputting multi-channel audio in an electronic device, the method comprising:
checking direction information of the electronic device based on detecting the output of the audio data;
transmitting channel information of audio data to be output by each of a plurality of audio output devices to each audio output device based on direction information of the electronic device; and
and controlling the plurality of audio output devices so that each audio output device selects a channel and outputs audio data of the selected channel based on the channel information. 13. The method of claim 12,
Based on detecting the output of the audio data, the method further comprises generating the audio data as multi-channel audio data,
The multi-channel audio data includes audio data of a first channel and audio data of a second channel. 14. The method of claim 13,
The operation of controlling the plurality of audio output devices includes:
Output the at least part of the audio data to output the audio data of the first channel among the audio data of the multi-channel through at least some of the audio output devices among the plurality of audio output devices based on the channel information of the audio data controlling the device; and
and controlling the at least other audio output devices to output the second channel audio data among the multi-channel audio data through at least other audio output devices among the plurality of audio output devices. Way. 15. The method of claim 14,
transmitting, to each audio output device, changed channel information of audio data to be output by each audio output device according to the changed direction information, based on detecting a change in the direction information of the electronic device; and
and controlling the plurality of audio output devices so that each audio output device selects a channel and outputs audio data of the selected channel based on the changed channel information. 16. The method of claim 15,
The operation of controlling the plurality of audio output devices based on the changed channel information includes:
outputting the audio data of the second channel among the multi-channel audio data through the at least some audio output devices among the plurality of audio output devices based on the changed channel information of the audio data; controlling the audio output device; and
and controlling the at least other audio output devices to output the first channel audio data among the multi-channel audio data through the at least other audio output devices among the plurality of audio output devices. How to. 13. The method of claim 12,
The electronic device is a foldable electronic device, and the method further comprising: checking a folding state of the electronic device based on detecting the output of the audio data. 18. The method of claim 17,
transmitting second channel information of audio data to be output by each of the plurality of audio output devices to each audio output device based on direction information of the electronic device and/or the folding state; and
and controlling the plurality of audio output devices so that each audio output device selects a channel and outputs audio data of the selected channel based on the second channel information. 13. The method of claim 12,
The operation of transmitting channel information of the audio data to each audio output device includes:
transmitting, by the first processor of the electronic device, channel information of audio data to be output by each of the plurality of audio output devices to a second processor of the electronic device,
The operation of controlling the plurality of audio output devices includes:
and controlling, by the second processor, the plurality of audio output devices to output audio data of a channel set to each audio output device based on the channel information. 18. The method of claim 17,
The direction information of the electronic device includes a portrait mode and a landscape mode, and
The folded state of the electronic device includes an unfolded state and a folded state of the electronic device.

Images