KR20160002132A - Electronic device and method for providing sound effects - Google Patents

Electronic device and method for providing sound effects Download PDF

Info

Publication number
KR20160002132A
KR20160002132A KR1020140080997A KR20140080997A KR20160002132A KR 20160002132 A KR20160002132 A KR 20160002132A KR 1020140080997 A KR1020140080997 A KR 1020140080997A KR 20140080997 A KR20140080997 A KR 20140080997A KR 20160002132 A KR20160002132 A KR 20160002132A
Authority
KR
South Korea
Prior art keywords
electronic device
sound source
output level
video call
module
Prior art date
Application number
KR1020140080997A
Other languages
Korean (ko)
Inventor
황호철
김문수
천재봉
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority to KR1020140080997A priority Critical patent/KR20160002132A/en
Publication of KR20160002132A publication Critical patent/KR20160002132A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4852End-user interface for client configuration for modifying audio parameters, e.g. switching between mono and stereo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Abstract

A variety of embodiments of the present invention relate to a device for providing sound field effects in an electronic device and a method thereof. A method for operating the electronic device comprises the following operations of: checking a location of at least one counterpart included in a video call screen; determining an audio output level about each sound source output module based on the location of at least one counterpart; and outputting a sound source to each sound source output module based on the audio output level. Other embodiments can be possible.

Description

[0001] ELECTRONIC DEVICE AND METHOD FOR PROVIDING SOUND EFFECTS [0002]

Various embodiments of the present invention are directed to an electronic device and to an apparatus and method for providing a sound field effect in an electronic device.

With the development of information communication technology and semiconductor technology, various electronic devices are being developed as multimedia devices providing various multimedia services. For example, the portable electronic device can provide various multimedia services such as a broadcasting service, a wireless Internet service, a camera service, and a music reproduction service.

The electronic device can provide various sound field effects using various audio channels (e.g., 2.1 channel, 5.1 channel) corresponding to a plurality of sound source output devices.

In the case where the electronic device provides a call service such as a video call or a voice call, the electronic device converts the audio signal collected through the microphone into a mono sound source to transmit to a counterpart electronic device, The sound source can be converted into an audio signal and outputted through a speaker. Accordingly, even if a user of the electronic device provides a call service to a plurality of persons located in different areas, it is inconvenient to use only a monotonous call service due to the limitation of a mono sound source.

Embodiments of the present invention can provide an apparatus and method for providing a sound field effect when providing a call service in an electronic device.

Embodiments of the present invention can provide an apparatus and method for controlling microphone sensitivity when providing a call service in an electronic device.

According to an embodiment of the present invention, a method of operating an electronic device includes: checking an at least one location of a counterpart included in a video call screen; and displaying audio of each audio output module based on the location of the at least one counterpart. Determining an output level, and outputting the sound source to each sound source output module based on the audio output level.

According to an embodiment of the present invention, an operation method of an electronic device includes: an operation of confirming a position of a user of the electronic device when providing a call service and an operation of determining a reception sensitivity of each microphone based on the position of the user And collecting sound sources through respective microphones based on the reception sensitivity.

According to an embodiment of the present invention, an electronic device includes a communication interface for transmitting and receiving signals with at least one counterpart electronic device, at least one sound source output module for outputting an audio signal, and at least one position And a processor for determining an audio output level for each sound output module based on the audio output level and outputting the sound output to each sound output module based on the audio output level.

According to an embodiment of the present invention, an electronic device includes a communication interface for transmitting and receiving signals with at least one counterpart electronic device, at least one sound source output module for outputting an audio signal, at least one microphone for collecting audio signals, And a processor for determining the reception sensitivity for each microphone based on the position of the user of the electronic device when provided and collecting the sound source through each microphone based on the reception sensitivity.

According to various embodiments of the present invention, by adjusting the output level of each sound source output module that outputs an audio signal based on the location information of the other party included in the video call screen in the electronic device, .

When providing a call service in an electronic device, the sensitivity of each microphone that collects audio signals based on the user's position is adjusted, thereby enhancing the quality of the call sound.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1A-1B show a perspective view of an electronic device according to an embodiment of the present invention.
2A and 2B illustrate a configuration of an ear jack of an external sound source output apparatus according to an embodiment of the present invention.
3 illustrates a network environment including an electronic device according to an embodiment of the present invention.
4 shows a detailed block diagram of an audio control module according to an embodiment of the present invention.
FIG. 5 illustrates a procedure for controlling an audio output level based on a location of a calling party included in a video call screen in an electronic device according to an exemplary embodiment of the present invention.
6 shows a procedure for changing the audio output level based on the movement of the other party in the electronic device according to the embodiment of the present invention.
7A and 7B illustrate a video call screen configuration for controlling an audio output level in an electronic device according to an embodiment of the present invention.
8 illustrates a procedure for controlling an audio output level based on motion information of a calling party included in a video call screen in an electronic device according to an embodiment of the present invention.
9 illustrates a video call screen configuration for controlling an audio output level based on motion information of a calling party in an electronic device according to an embodiment of the present invention.
FIG. 10 illustrates a procedure for changing the audio output level based on the location and size of a calling party included in a video call screen in an electronic device according to an embodiment of the present invention.
11A to 11C illustrate a video call screen configuration for controlling an audio output level based on the location and size of a calling party in an electronic device according to an embodiment of the present invention.
12 shows a procedure for controlling microphone sensitivity in an electronic device according to an embodiment of the present invention.
13 shows a procedure for controlling an audio output level of a sound output module in an electronic device according to an embodiment of the present invention.
14 shows a configuration for controlling the microphone sensitivity in an electronic device according to an embodiment of the present invention.
15 shows a block diagram of an electronic device according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The various embodiments of the present invention are described below in connection with the accompanying drawings. The various embodiments of the present invention are capable of various changes and may have various embodiments, and specific embodiments are illustrated in the drawings and the detailed description is described with reference to the drawings. It should be understood, however, that it is not intended to limit the various embodiments of the invention to the specific embodiments, but includes all changes and / or equivalents and alternatives falling within the spirit and scope of the various embodiments of the invention. In connection with the description of the drawings, like reference numerals have been used for like elements.

The use of "including" or "including" in various embodiments of the present invention can be used to refer to the presence of a corresponding function, operation or component, etc., which is disclosed, Components and the like. Also, in various embodiments of the invention, the terms "comprise" or "having" are intended to specify the presence of stated features, integers, steps, operations, components, parts or combinations thereof, But do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

The expression " or " or " at least one of A and / or B " in various embodiments of the present invention includes any and all combinations of words listed together. For example, each of " A or B " or " at least one of A and / or B " may comprise A, comprise B, or both A and B.

The expressions " first ", " second ", " first ", or " second ", etc. used in various embodiments of the present invention are capable of modifying various elements of various embodiments, . For example, the representations do not limit the order and / or importance of the components. The representations may be used to distinguish one component from another. For example, both the first user equipment and the second user equipment are user equipment and represent different user equipment. For example, without departing from the scope of the various embodiments of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it is to be understood that the element may be directly connected or connected to the other element, It should be understood that there may be other new components between the different components. On the other hand, when it is mentioned that an element is "directly connected" or "directly connected" to another element, it is understood that there is no other element between the element and the other element It should be possible.

The terminology used in the various embodiments of the present invention is used only to describe a specific embodiment and is not intended to limit the various embodiments of the present invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the various embodiments of the present invention belong. Terms such as those defined in commonly used dictionaries should be interpreted to have the meanings consistent with the contextual meanings of the related art and, unless expressly defined in the various embodiments of the present invention, It is not interpreted as meaning.

An electronic device according to various embodiments of the present invention may be a device including a communication function. For example, the electronic device may be a smartphone, a tablet personal computer, a mobile phone, a videophone, an e-book reader, a desktop personal computer, Such as a laptop personal computer (PC), a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device Such as a head-mounted device (HMD) such as electronic glasses, an electronic garment, an electronic bracelet, an electronic necklace, an electronic app apparel, an electronic tattoo, or a smart watch.

According to some embodiments, the electronic device may be a smart home appliance with communication capabilities. The smart household appliances can be, for example, electronic devices such as televisions, digital video disk players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air cleaners, set- And may include at least one of a box (e.g., Samsung HomeSync ™, Apple TV ™, or Google TV ™), game consoles, an electronic dictionary, an electronic key, a camcorder,

According to some embodiments, the electronic device may be a variety of medical devices (e.g., magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), a camera, an ultrasonic device, etc.) , A global positioning system receiver, an event data recorder (EDR), a flight data recorder (FDR), an automotive infotainment device, a marine electronic device (eg marine navigation device and gyro compass) avionics, a security device, a car head unit, an industrial or home robot, an ATM (automatic teller's machine) of a financial institution, or a point of sale (POS) of a store.

According to some embodiments, the electronic device may be a piece of furniture or a structure / structure including a communication function, an electronic board, an electronic signature receiving device, a projector, (E.g., water, electricity, gas, or radio wave measuring instruments, etc.). An electronic device according to various embodiments of the present invention may be one or more of the various devices described above. The electronic device according to various embodiments of the present invention may be a flexible device. It will be apparent to those skilled in the art that the electronic device according to various embodiments of the present invention is not limited to the devices described above.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. The term user as used in various embodiments may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

Various embodiments of the present invention will now be described in the context of providing a sound field effect in an electronic device.

1A to 1B are perspective views of an electronic device according to an embodiment of the present invention.

1A, an electronic device 100 may include a display area 101 and a bezel area 102 on a front surface thereof. A display module may be installed in the display area 101, and a touch panel may be installed on the display area 101 as input means. Accordingly, the display module of the display area 101 may be a touch screen device. The display area 101 may be disposed over the entire front surface of the electronic device 100 and the bezel area 102 may be disposed in the edge area of the electronic device 100 in such a manner as to surround the display area 101. [ The bezel region 102 can be utilized as a layout region for various electrical wiring for a touch screen device such as an LDI (LCD Driver IC) region.

At least one first microphone device 103 and an earphone hole 109 may be installed on the upper portion of the display area 101. At least one second microphone device 104 and a plurality Speaker units 107 and 108 can be installed. However, the microphone devices 103 and 104, the speaker devices 107 and 108, and the earphone hole 109 may be disposed at other positions other than the illustrated positions of the electronic device 100.

According to one embodiment, a camera module 105 may be installed on the front surface of the electronic device 100 and at least one sensor module 106 may be used as sensing means for controlling the electronic device 100 according to the surrounding environment. Can be installed. For example, the sensor module 106 senses the illuminance of the surroundings and controls the brightness of the display module, detects whether the electronic device 100 is close to an external object (e.g., a user) And a proximity sensor for controlling the sensor.

The electronic device 100 may be connected to an external sound source output device (e.g., an earphone) 110 through an earphone hole 109 as shown in FIG. 1B.

The external sound source output device 110 may output the audio signal provided from the electronic device 100 through the left and right terminals of the ear jack connected to the earphone jack 109 of the electronic device 100. [

2A and 2B illustrate a configuration of an ear jack of an external sound source output apparatus according to an embodiment of the present invention.

2A, when the external sound source output apparatus 110 includes a stereo sound output module 200 including a microphone, the ear jack 210 of the external sound source output apparatus 110 is connected to the left terminal 211 (L , A right terminal 212 (R), a ground terminal 213 (GND), and a microphone terminal 214 (MIC).

The left terminal 211 is connected to the left port of the electronic device 100 through an ear jack hole 109 of the electronic device 100 and outputs the audio signal provided from the electronic device 100 to the stereo It can be provided to the left output module of the sound output module.

The right terminal 212 is connected to the right port of the electronic device 100 through an ear jackhole 109 of the electronic device 100 so that the audio signal provided from the electronic device 100 is transmitted through the signal line 202 to the stereo It can be provided as the right output module among the sound output modules.

The ground terminal 213 is connected to a ground terminal of the electronic device 100 through an earphone hole 109 of the electronic device 100 to perform a grounding function of the external sound source output device 110.

The microphone terminal 214 is connected to the microphone port of the electronic device 100 through an earphone hole 109 of the electronic device 100 and supplies the audio signal collected through the microphone module 200 to the electronic device 100 can do.

2B, when the external sound source output apparatus 110 includes a stereo sound output module 220 that does not include a microphone, the ear jack 230 of the external sound source output apparatus 110 is connected to the left terminal 231 L, a right terminal 232 (R), and a ground terminal 233 (GND). Here, the left terminal 231, the right terminal 232, and the ground terminal 233 of FIG. 2B perform the same functions as the left terminal 211, the right terminal 212, and the ground terminal 213 of FIG. The description will be omitted.

In the above-described embodiment, the external sound source output apparatus 110 may include a left terminal 211 or 231 and a right terminal 212 or 232. The electronic device 100 can transmit audio signals set to different output levels through the left terminal 211 or 231 and the right terminal 212 or 232 of the external sound source output apparatus 110. [

3 illustrates a network environment including an electronic device according to an embodiment of the present invention.

3, the electronic device 301 includes a bus 310, a processor 320, a memory 330, an input / output interface 340, a display 350, a communication interface 360, an audio control module 370, And may include at least one speaker 380 and at least one microphone 390.

The bus 310 may be a circuit that couples the components of the electronic device 310 together and communicates (e.g., a control message) between the components of the electronic device 301.

Processor 320 may be coupled to other components (e.g., memory 330, input / output interface 340, display 350, communication interface 360) of electronic device 301 via bus 310, for example, Or the XXX module 170, etc.), decrypts the received command, and executes an operation or data processing according to the decrypted command.

The memory 330 may include a processor 320 or other components (e.g., an input / output interface 340, a display 350, a communication interface 360, an audio control module 370, a speaker 380, ), Etc.) or store instructions or data generated by processor 320 or other components. The memory 330 may include programming modules such as, for example, a kernel, a middleware, an application programming interface (API), or an application. Here, each of the programming modules may be composed of software, firmware, hardware, or a combination of at least two of them.

The input interface 340 may be configured to send commands or data entered from a user via an input device (e.g., a sensor, keyboard or touch screen) to the processor 320, memory 330, Communication interface 360, or audio control module 370. For example, the input / output interface 340 may provide the processor 320 with data on the user's touch input via the touch screen.

Display 350 may display various information (e.g., multimedia data or text data, etc.) to the user. For example, display 350 may display commands or data received from processor 320, memory 330, communication interface 360, or audio control module 370 via bus 310.

The communication interface 360 may connect communications between the electronic device 301 and an external device (e.g., the electronic device 304 or the server 306). For example, the communication interface 360 may be connected to a network via wireless communication or wired communication to communicate with an external device. A wireless communication may be, for example, a wireless fidelity (Wifi), a Bluetooth (BT), a near field communication (NFC), a satellite communication (e.g. GPS) or a cellular communication (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS , WiBro or GSM, etc.). The wired communication may include at least one of, for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232) or a plain old telephone service (POTS).

According to one embodiment, the network may be a telecommunications network. The communication network may include at least one of a computer network, an internet, an internet of things, or a telephone network. According to one embodiment, a protocol (e.g., a transport layer protocol, a data link layer protocol, or a physical layer protocol) for communication between the electronic device 3010 and an external device is provided to the application, API, middleware, Or at least one of the communication interface 360.

According to one embodiment, the server 306 may support the operation of the electronic device 301 by performing at least one of the operations (or functions) implemented in the electronic device 301. For example, the server 306 may include an audio control server module capable of supporting an audio control module 370 implemented in the electronic device 301. For example, the audio control server module may include at least one component of the audio control module 370 to perform (e.g., act on) at least one of the operations performed by the audio control module 370 .

The audio control module 370 may control at least one speaker 380 to provide a sound field effect. For example, when the external sound source output apparatus 110 is connected to the electronic apparatus 100, the audio control module 370 controls the stereo sound source output module 200 or 220 included in the external sound source output apparatus 110 to provide a sound field effect, Can be determined.

According to one embodiment, the audio control module 370 may adjust the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position of the person in the other party's image. For example, when the electronic device 301 includes a plurality of speakers 380, the audio control module 370 can set the output level of the speaker to be higher as the distance from the face of the person is closer.

According to one embodiment, when providing a video call service, the audio control module 370 may divide the video call screen into a plurality of sound source output control areas. The audio control module 370 may control the speaker output level of the at least one speaker 380 or the stereo sound source output module 200 or the sound source output module 300 based on the speaker output level information mapped to the sound source output control area including the face of the other party, 220 can be adjusted. For example, in a case where the electronic device 301 includes a plurality of speakers 380, the audio control module 370 controls the speaker output level of the talk partner, The closer the distance from the face is, the higher the output level of the speaker can be set.

According to one embodiment, the audio control module 370 may adjust the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position and face size of the person in the conversation partner's image . For example, when the electronic device 301 includes a plurality of speakers 380, the audio control module 370 can set the output level of the speaker to be higher as the distance from the relatively large face is closer.

According to one embodiment, the audio control module 370 can adjust the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position of the person included in the playback picture of the moving picture have. For example, when the electronic device 301 includes a plurality of speakers 380, the audio control module 370 can set the output level of the speaker to be higher as the distance from the user's face is closer.

According to one embodiment, the audio control module 370 controls the output level of at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position and face size of a person included in the moving picture playback screen Can be adjusted. For example, when the electronic device 301 includes a plurality of speakers 380, the audio control module 370 can set the output level of the speaker to be higher as the distance from the relatively large face is closer.

According to one embodiment, the audio control module 370 may adjust the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the location of the user of the electronic device 301. For example, when the electronic device 301 includes a plurality of speakers 380, the audio control module 370 can adjust the output balance of the speakers by setting the output level of the speakers higher as the distance from the user increases. For example, the audio control module 370 can detect the location of the user of the electronic device 301 using a sensor module (not shown). In another example, when the electronic device 301 includes a plurality of microphones 390, the audio control module 370 may control the microphones 390 in at least one of the difference in the volume of received sound sensed by each microphone or the audio signal sensing delay time The position of the user of the electronic device 301 can be detected.

The audio control module 370 may control the sensitivity of the at least one microphone 390 based on the location of the call user. For example, when the electronic device 301 includes a plurality of microphones 390, the audio control module 370 can set the reception sensitivity of the microphone to be higher as the distance from the user is shorter. For example, the audio control module 370 can detect the location of the user of the electronic device 301 using a sensor module (not shown). In another example, when the electronic device 301 includes a plurality of microphones 390, the audio control module 370 may control the microphones 390 in at least one of the difference in the volume of received sound sensed by each microphone or the audio signal sensing delay time The position of the user of the electronic device 301 can be detected.

At least one speaker 380 may output an audio signal provided from the processor 320 to the outside. For example, each speaker 380 may output an audio signal provided from the processor 320 to the outside based on an output level determined by the audio control module 370. [

At least one microphone 390 may collect external sound and convert it into an electrical audio signal and provide it to the processor 320. For example, each microphone 390 may acquire external sound based on the microphone reception sensitivity determined by the audio control module 370.

According to the embodiment described above, the audio control module 370 can control the output level of the at least one speaker 380 and the reception sensitivity of the at least one microphone 390 in one module.

According to one embodiment, the audio control module 370 includes separate hardware, software, or firmware modules for controlling the output level of the at least one speaker 380 and the receive sensitivity of the at least one microphone 390, Combinations thereof.

4 shows a detailed block diagram of an audio control module according to an embodiment of the present invention.

Referring to FIG. 4, the audio control module 370 may include an output level determination module 400, an audio output control module 410, and a microphone sensitivity control module 420.

The output level determination module 400 may determine the output level of the at least one speaker 380 to provide a sound field effect. For example, when the external sound source output apparatus 110 is connected to the electronic device 100, the output level determination module 400 may control the stereo sound source output module 200 or 220 included in the external sound source output apparatus 110 to provide a sound field effect Can be determined.

According to one embodiment, the output level determination module 400 may determine the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position of the person in the conversation partner's image . For example, when the electronic device 301 includes a plurality of speakers 380, the output level determination module 400 can set the output level of the speaker to be higher as the distance from the face of the person is closer.

According to one embodiment, when providing a video call service, the output level determination module 400 may divide the video call screen into a plurality of sound source output control areas. The output level determination module 400 determines whether or not the speaker output level of the at least one speaker 380 or the stereo sound source output module 200 Or 220). For example, in a case where the electronic device 301 includes a plurality of speakers 380, the output level determination module 400 determines the output level of the speaker 300 based on the speaker output level information mapped to the sound source output control area, The output level of the speaker can be set higher.

According to one embodiment, the output level determination module 400 determines the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position and the face size of the person You can decide. For example, when the electronic device 301 includes a plurality of speakers 380, the output level determination module 400 can set the output level of the speaker to be higher as the distance from the relatively large face is closer.

According to one embodiment, the output level determination module 400 determines the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position of the person included in the moving picture playback screen . For example, when the electronic device 301 includes a plurality of speakers 380, the output level determination module 400 may set the output level of the speaker to be higher as the distance from the user's face is closer.

According to one embodiment, the output level determination module 400 determines the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the face position and face size of the person included in the moving picture playback screen The level can be determined. For example, when the electronic device 301 includes a plurality of speakers 380, the output level determination module 400 can set the output level of the speaker to be higher as the distance from the relatively large face is closer.

According to one embodiment, the output level determination module 400 may determine the output level of the at least one speaker 380 or the stereo sound source output module 200 or 220 based on the location of the user of the electronic device 301 . For example, when the electronic device 301 includes a plurality of speakers 380, the output level determination module 400 may set the output level of the speaker to be higher as the distance from the user increases. For example, the output level determination module 400 may detect the position of the user of the electronic device 301 using a sensor module (not shown). In another example, when the electronic device 301 includes a plurality of microphones 390, the output level determination module 400 may determine at least one of the difference in the volume of received sound sensed through each microphone or the audio signal sensing delay time The location of the user of the electronic device 301 can be detected.

The audio output control module 410 may adjust the output level of the audio signal for output through the respective speakers 380 based on the output levels of the respective speakers 380 determined by the output level determination module 400. [ For example, when the external sound source output apparatus 110 is connected to the electronic apparatus 100, the audio output control module 410 determines whether the output level of the stereo sound source output module 200 or 220 So that the output level of the audio signal for outputting through each output module included in the stereo sound source output module 200 or 220 can be adjusted.

The microphone sensitivity control module 420 may control the sensitivity of the at least one microphone 390 based on the location of the call user. For example, when the electronic device 301 includes a plurality of microphones 390, the microphone sensitivity control module 420 may set the reception sensitivity of the microphones higher as the distance from the user is shorter.

According to the embodiment described above, the electronic device 301 may use the audio control module 370 to control the output level of the at least one speaker 380 and the reception sensitivity of the at least one microphone 390. [

According to one embodiment, the electronic device 301 may perform at least a portion of the functions of the audio control module 370 in the processor 320.

According to various embodiments of the present invention, an electronic device comprises at least one sound source output module for outputting an audio signal, a communication interface for transmitting and receiving signals to and from at least one counterpart electronic device, and at least one counterpart And a processor for determining an audio output level for each sound output module based on the position and outputting the sound source to each sound output module based on the audio output level.

In the embodiment of the present invention, the processor may be configured to identify the position of at least one counter party included in the video call screen through face recognition of the video call screen.

In the embodiment of the present invention, when the sound output module includes a plurality of sound output modules, the processor outputs the audio output level of at least one sound output module, which is relatively adjacent to the position of the other party included in the video call screen, May be set to be higher than the audio output level of the output module.

In an embodiment of the present invention, the sound source output module may include at least one of at least one speaker and an earphone.

In the embodiment of the present invention, the processor divides the video call screen into a plurality of areas, and recognizes the presence of the other party among the plurality of areas included in the video call screen through face recognition of the video call screen To identify at least one region that has been < / RTI >

In the embodiment of the present invention, when the change of the mouth shape of the other party included in the video call screen is sensed, the processor may detect at least one of the plurality of areas, May be set to determine the audio output level for each sound source output module based on the audio output level mapped to the region.

In a preferred embodiment of the present invention, when a plurality of parties are included in the video call screen, the processor compares face sizes of the parties included in the video call screen, and when the plurality of sound source output modules are included, The audio output level of at least one sound output module relatively adjacent to the position of the counterpart having a relatively large face size on the call screen may be set to be higher than the audio output level of the remaining one sound output module.

According to various embodiments of the present invention, an electronic device comprises a communication interface for transmitting and receiving signals with at least one counterpart electronic device, at least one sound source output module for outputting an audio signal, at least one microphone for collecting audio signals, And a processor for determining the reception sensitivity for each microphone based on the position of the user of the electronic device when provided and collecting the sound source through each microphone based on the reception sensitivity.

And may further include at least one sensor module in an embodiment of the present invention. The processor may be configured to identify the location of a user of the electronic device using the sensor module.

In the embodiment of the present invention, the processor is configured to check the position of the user of the electronic device based on at least one of the size of the sound source and the detection time of the sound source collected through each microphone, when the micro- phone includes a plurality of microphones .

In the embodiment of the present invention, when the processor includes a plurality of microphones, the processor may be configured to determine the reception sensitivity of at least one microphone relatively adjacent to the user's position to be higher than the reception sensitivity of the remaining at least one microphone .

FIG. 5 illustrates a procedure for controlling an audio output level based on a location of a calling party included in a video call screen in an electronic device according to an exemplary embodiment of the present invention.

5, in operation 501, an electronic device (e.g., the electronic device 301 can confirm the location of a communication partner included in the video call screen). For example, when providing a video call service, It is possible to recognize the location of the calling party included in the video call screen by recognizing the face of the calling party on the video call screen.

In operation 503, the electronic device determines whether the sound output module (e.g., the speaker 390, the stereo sound output module 200 or 220 of the external sound output device 110) of the sound source output module 110 The audio output level can be determined. According to one embodiment, when the calling party 710 is located on the left side in the display 700 of the electronic device, as shown in FIG. 7A, the electronic device may transmit the audio output of the first speaker 702, which is adjacent to the calling party 710, Level can be set higher than the audio output level of the second speaker 704. For example, the electronic device may increase the audio output level of the first speaker 702 or lower the audio output level of the second speaker 704 to reduce the audio output level of the first speaker 702 to the audio of the second speaker 704 It can be set higher than the output level. According to one embodiment, when the calling party 720 is located on the right side in the display 700 of the electronic device, as shown in FIG. 7B, the electronic device may be configured to receive the audio output of the second speaker 704 adjacent to the calling party 720, Level can be set higher than the audio output level of the first speaker 702. For example, the electronic device may increase the audio output level of the second speaker 704 or lower the audio output level of the first speaker 702 to reduce the audio output level of the second speaker 704 to the audio of the first speaker 702 It can be set higher than the output level.

In operation 505, the electronic device may output the audio signal to the outside through each sound source output module based on the audio output level. According to one embodiment, when the calling party 710 is located on the left side of the display 700 of the electronic device, as shown in FIG. 7A, the electronic device is switched to the first party through the first speaker 702 adjacent to the calling party 710 It is possible to output an audio signal having a larger volume than the two speakers 704. According to one embodiment, when the other party 720 is located on the right side of the display 700 of the electronic device, as shown in FIG. 7B, the electronic device is controlled by the second speaker 704, It is possible to output an audio signal having a volume larger than that of one speaker 702.

FIG. 6 shows a procedure for changing the audio output level based on the movement of the other party in the electronic device according to the embodiment of the present invention.

Referring to FIG. 6, in operation 601, the electronic device can confirm whether the call service is terminated when the audio signal is output to the outside through each sound source output based on the audio output level in operation 505 of FIG.

If the call service is terminated, the electronic device may terminate the algorithm.

In operation 603, if the call service is not terminated, the electronic device can confirm whether the face position of the calling party is changed. For example, the electronic device can check whether the motion of the other party is detected on the video call screen.

In operation 501 of FIG. 5, when the face position of the communication partner is changed, the electronic device can confirm the position of the communication partner included in the video call screen.

In operation 505 of FIG. 5, the electronic device may output the audio signal through each sound source output to the outside based on the audio output level determined in operation 503, if the face position of the called party is not changed.

FIG. 8 illustrates a procedure for controlling an audio output level based on motion information of a calling party included in a video call screen in an electronic device according to an embodiment of the present invention.

8, an electronic device 301, for example, may provide a video call service with at least one other electronic device at operation 801. For example, 360 to establish a communication link with at least one counterpart electronic device to provide a video call service.

In operation 803, the electronic device may divide the video call screen for the video call service into a plurality of sound source output control areas. According to one embodiment, the electronic device can divide the video call screen 900 into four sound source output control areas 910, 920, 930, and 940 as shown in FIG. For example, the electronic device does not display the sound source output control areas 910, 920, 930, 940 on the display 350, nor does it display a reference line 906 that divides the sound source output control areas 910, 920, 930, Can be displayed on the display 350.

At operation 805, the electronic device can verify the location of the calling party included in the video call screen. According to one embodiment, the electronic device recognizes the face 951 and the face 952 of the calling party on the video call screen 900 as shown in FIG. 9 to confirm the position of the calling party included in the video call screen. For example, the electronic device can identify the tone generator output control area 910 or 920 or 930 or 940 where the called party is located.

At operation 807, the electronic device can verify that mouth-shaped movement included in the face of the calling party is detected. According to one embodiment, the electronic device continuously recognizes the face of the calling party during the video call service and can confirm whether a change in mouth shape of the calling party is detected. For example, the electronic device can confirm whether a change in mouth shape of the other party is detected at the time when the output of the audio signal is detected based on the video call service.

In operation 815, if the electronic device fails to sense the mouth-shaped motion included in the face of the calling party, it can confirm whether the call service is terminated.

In operation 809, when the electronic device senses the mouth-shaped movement included in the face of the calling party, it can identify the sound source output control region in which the movement of the face of the calling party is detected.

In operation 811, the electronic device generates a sound output module (e.g., speaker 390, stereo sound output module 200 or 220 of the external sound output device 110) based on the sound output control area in which mouth- Can be determined.

9, when the change in mouth shape of the calling party 952 is sensed in the third sound source output control area 930, the electronic device controls the third sound source output control area 930, The audio output level mapped to the audio output level can be confirmed. For example, if the electronic device senses a change in mouth shape of the calling party 952 in the third sound source output control area 930, which is relatively adjacent to the second speaker 904, The audio output level can be set higher than the audio output level of the first speaker 902.

9, when the electronic device detects a change in the shape of the mouth of the calling party 951 in the second sound source output control region 920, the electronic device controls the second sound source output control region 920, The audio output level mapped to the audio output level can be confirmed. For example, if the electronic device senses a change in mouth shape of the calling party 951 in the second sound source output control area 920 that is relatively adjacent to the first speaker 902, The audio output level can be set higher than the audio output level of the second speaker 904.

In operation 813, the electronic device may output the audio signal externally through each sound source output module based on the audio output level. 9, when the change in mouth shape of the calling party 952 is sensed in the third sound source output control area 930, the electronic device controls the third sound source output control area 930, An audio signal having a volume larger than that of the first speaker 902 can be output through the second speaker 904 adjacent to the first speaker 902. 9, when the electronic device detects a change in the shape of the mouth of the calling party 951 in the second sound source output control region 920, the electronic device controls the second sound source output control region 920, The second speaker 904 can output an audio signal having a higher volume than the second speaker 904 through the first speaker 902 adjacent to the second speaker 904.

At operation 815, the electronic device can verify that the call service is terminated.

In operation 807, if the call service is not terminated, the electronic device can confirm whether mouth-shaped movement included in the face of the calling party is detected.

If the call service is terminated, the electronic device may terminate the algorithm.

According to one embodiment, if the electronic device detects movement (e.g., movement) of the face of the calling party, the electronic device may determine the location of the calling party at operation 805. [ For example, the electronic device can identify the tone generator output control area 910 or 920 or 930 or 940 where the called party is located.

FIG. 10 shows a procedure for changing the audio output level based on the position and size of the communication party included in the video call screen in the electronic device according to the embodiment of the present invention.

10, in operation 1001, an electronic device (for example, the electronic device 301 can confirm the location and size of the communication party included in the video call screen). For example, when providing a video call service, The device recognizes the face of the calling party on the video call screen and can check the position and size of the calling party included in the video call screen.

In operation 1003, the electronic device displays the sound output module (e.g., speaker 390), the stereo sound output module 200 or 220 of the external sound source output device 110 based on the position and size of the communication party included in the video call screen, ) Can be determined. 11A, when the size of the first communication partner 1110 located on the left side of the video call screen is larger than that of the second communication partner 1120 located on the right side, the electronic device transmits the first communication partner 1110 The audio output level of the first speaker 1102 adjacent to the second speaker 1104 can be set higher than the audio output level of the second speaker 1104. [

According to one embodiment, when the size of the second communication party 1122 located on the right side in the video call screen is larger than that of the first communication partner 1112 located on the left as shown in FIG. 11B, the electronic device can communicate with the second communication partner 1122 And the audio output level of the second speaker 1104 adjacent to the first speaker 1104 can be set higher than the audio output level of the first speaker 1102. [

According to one embodiment, when the size of the second communication party 1124 located on the right side of the video call screen is larger than that of the first communication party 1114 located on the left as shown in FIG. 11C, And the audio output level of the second speaker 1104 adjacent to the first speaker 1104 can be set higher than the audio output level of the first speaker 1102. [

In operation 1005, the electronic device may output the audio signal externally through each sound source output module based on the audio output level. 11A, when the size of the first communication partner 1110 located on the left side of the video call screen is larger than that of the second communication partner 1120 located on the right side, the electronic device transmits the first communication partner 1110 The second speaker 1104 can output an audio signal having a higher volume than the second speaker 1104 through the first speaker 1102 adjacent to the second speaker 1104. According to one embodiment, when the size of the second communication party 1122 located on the right side in the video call screen is larger than that of the first communication partner 1112 located on the left as shown in FIG. 11B, the electronic device can communicate with the second communication partner 1122 The second speaker 1104 and the second speaker 1104 adjacent to the first speaker 1102.

According to one embodiment, if the electronic device detects movement (e.g., movement) of the face of the calling party, the electronic device may again verify the location and size of the calling party at operation 1001.

12 shows a procedure for controlling the microphone sensitivity in an electronic device according to an embodiment of the present invention.

12, at operation 1201, an electronic device (e.g., electronic device 301) may provide a call service (e.g., a voice call service or a video call service) with at least one other electronic device. , The electronic device 301 may establish a communication link with the at least one counterpart electronic device via the communication interface 360 to provide the call service.

At operation 1203, the electronic device can verify the location of the electronic device with respect to the user. According to one embodiment, the electronic device can detect the position of the user of the electronic device using a sensor module (e.g., an image sensor, an ultrasonic sensor, etc.). According to one embodiment, when the electronic device includes a plurality of microphones 390, the electronic device may be configured to determine a user of the electronic device based on at least one of a difference in received volume detected through the respective microphones, The position can be detected.

At operation 1205, the electronic device can determine the receiving sensitivity of the microphone based on the position of the electronic device with respect to the user. According to one embodiment, when the user 1420 is located on the right / bottom of the electronic device 1400 (1422), as shown in FIG. 14, the electronic device may be connected to the second microphone 1404 relatively adjacent to the user 1420 The reception sensitivity can be set higher than the reception sensitivity of the first microphone 1402. [ According to one embodiment, when the user 1420 is located at the left / top of the electronic device 1400 (1424), as shown in FIG. 14, the electronic device may be located in the first microphone 1402 relatively adjacent to the user 1420 It is possible to set the reception sensitivity higher than the reception sensitivity of the second microphone 1404.

At operation 1207, the electronic device can collect the sound source via each microphone based on the microphone receive sensitivity.

According to one embodiment, if the electronic device detects movement (e.g., movement) of the face of the calling party, the electronic device can re-verify the location of the calling party at operation 1203.

13 shows a procedure for controlling an audio output level of a sound output module in an electronic device according to an embodiment of the present invention.

Referring to FIG. 13, at operation 1301, an electronic device (e.g., electronic device 301 may provide a call service (e.g., a voice call service or a video call service) with at least one other electronic device.

In operation 1303, the electronic device can verify the location of the electronic device with respect to the user.

In operation 1305, the electronic device determines whether the audio output level (e.g., the speaker 390, the stereo sound output module 200 or 220 of the external sound source output device 110) of the sound output module Can be determined. According to one embodiment, if the user 1420 is located on the right / bottom of the electronic device 1400 as shown in FIG. 14, the electronic device may be located on the first speaker 1412 located relatively far away from the user 1420, The audio output level of the second speaker 1414 can be set higher than the audio output level of the second speaker 1414. For example, the electronic device may increase the audio output level of the first speaker 1412 or lower the audio output level of the second speaker 1414 to reduce the audio output level of the first speaker 1412 to the audio of the second speaker 1414 It can be set higher than the output level.

According to one embodiment, if the user 1420 is located at the left / top 1424 of the electronic device 1400, as shown in FIG. 14, the electronic device may include a second speaker 1414 located relatively farther away from the user 1420, The audio output level of the first speaker 1412 can be set higher than the audio output level of the first speaker 1412.

In operation 1307, the electronic device may output the audio signal externally through each sound source output module based on the audio output level. According to one embodiment, if the user 1420 is located on the right / bottom of the electronic device 1400 as shown in FIG. 14, the electronic device may be located on the first speaker 1412 located relatively far away from the user 1420, It is possible to output an audio signal having a volume larger than that of the second speaker 1414. [ According to one embodiment, if the user 1420 is located at the left / top 1424 of the electronic device 1400, as shown in FIG. 14, the electronic device may include a second speaker 1414 located relatively farther away from the user 1420, It is possible to output an audio signal having a volume higher than that of the first speaker 1412. [

According to one embodiment, if the electronic device detects movement (e.g., movement) of the face of the calling party, the electronic device may re-verify the location of the calling party at operation 1303.

According to various embodiments of the present invention, a method of operating an electronic device includes: identifying a location of at least one counter party included in a video call screen; and determining a location of each of the sound source output modules based on the location of the at least one counterpart. Determining an audio output level, and outputting the sound source to each sound source output module based on the audio output level.

In the embodiment of the present invention, the operation of confirming the position may include an operation of confirming the position of at least one other party included in the video call screen through face recognition of the video call screen.

In the embodiment of the present invention, the operation of determining the audio output level may include: when the sound output module includes a plurality of sound output modules, the audio output level of at least one sound output module To an audio output level of at least one of the remaining sound source output modules.

In an embodiment of the present invention, the sound source output module may include at least one of at least one speaker and an earphone.

The method may further include dividing the video call screen into a plurality of areas. The checking of the location may include identifying at least one area of the plurality of areas included in the video call screen through the face recognition of the video call screen.

In the exemplary embodiment of the present invention, the operation of determining the audio output level may include an operation of detecting a change in a mouth shape of a counter party included in the video call screen, and a step of detecting a change in mouth shape of the plurality of areas, And determining an audio output level for each sound source output module based on the audio output level mapped to the at least one area.

In the embodiment of the present invention, the operation of determining the audio output level may include an operation of comparing face sizes of the parties included in the video call screen when a plurality of opponents are included in the video call screen, , Setting an audio output level of at least one sound source output module relatively adjacent to a position of a counterpart having a relatively large face size in the video call screen to be higher than an audio output level of at least one sound source output module . ≪ / RTI >

According to various embodiments of the present invention, a method of operating an electronic device includes the steps of: identifying a location of a user of the electronic device when providing a call service; and determining a reception sensitivity for each microphone based on the location of the user And collecting sound sources via respective microphones based on the operation and the reception sensitivity.

In an embodiment of the present invention, the act of confirming the location may include the act of confirming the location of the user of the electronic device using the sensor module.

In the embodiment of the present invention, the operation of confirming the position may include a step of detecting a position of a user of the electronic device based on at least one of a size of a sound source collected through each microphone and a sound source detection time, As shown in FIG.

In the exemplary embodiment of the present invention, the operation of determining the reception sensitivity may include setting a reception sensitivity of at least one microphone relatively adjacent to the position of the user to be higher than a reception sensitivity of at least one other microphone when the microphone includes a plurality of microphones . ≪ / RTI >

15 shows a block diagram of an electronic device according to an embodiment of the present invention.

The electronic device 1500 may constitute all or part of the electronic device 301 shown in Fig. 3, for example. 15, an electronic device 1500 includes at least one application processor (AP) 1510, a communication module 1520, a SIM (subscriber identification module) card 1524, a memory 1530, An input device 1550, a display 1560, an interface 1570, an audio module 1580, a camera module 1591, a power management module 1595, a battery 1596, an indicator 1597, Lt; RTI ID = 0.0 > 1598 < / RTI >

The AP 1510 may control a plurality of hardware or software components connected to the AP 1510 by driving an operating system or an application program, and may perform various data processing and calculations including multimedia data. The AP 1510 may be implemented with, for example, a system on chip (SoC). According to one embodiment, the AP 1510 may further include a graphics processing unit (GPU) (not shown).

Communication module 1520 (e.g., communication interface 360) may communicate with electronic device 1500 (e.g., electronic device 301) and other electronic devices (e.g., electronic device 304 or server 306 ) Can perform data transmission / reception. According to one embodiment, the communication module 1520 includes a cellular module 1521, a Wifi module 1523, a BT module 1525, a GPS module 1527, an NFC module 1528, and a radio frequency (RF) module 1529 ).

The cellular module 1521 may provide voice calls, video calls, text services, or Internet services over a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM). The cellular module 1521 can also perform identification and authentication of electronic devices within the communication network using, for example, a subscriber identity module (e.g., SIM card 1524). According to one embodiment, the cellular module 1521 may perform at least some of the functions that the AP 1510 may provide. For example, the cellular module 1521 may perform at least some of the multimedia control functions.

According to one embodiment, the cellular module 1521 may include a communication processor (CP). Further, the cellular module 1521 may be implemented with, for example, SoC. In FIG. 15, components such as cellular module 1521 (e.g., communications processor), memory 1530, or power management module 1595 are shown as separate components from AP 1510, but according to one embodiment , The AP 1510 may be implemented to include at least a portion of the aforementioned components (e.g., cellular module 1521).

According to one embodiment, AP 1510 or cellular module 1521 (e.g., communication processor) loads commands or data received from at least one of non-volatile memory or other components connected to each, into volatile memory, . In addition, AP 1510 or cellular module 1521 may store data generated by at least one of the other components or received from at least one of the other components in non-volatile memory.

Each of the Wifi module 1523, the BT module 1525, the GPS module 1527 or the NFC module 1528 may include a processor for processing data transmitted and received through the corresponding module, for example. 15, the cellular module 1521, the Wifi module 1523, the BT module 1525, the GPS module 1527, or the NFC module 1528 are shown as separate blocks, respectively. However, according to one embodiment, At least some (e.g., two or more) of the wireless module 1521, the Wifi module 1523, the BT module 1525, the GPS module 1527 or the NFC module 1528 may be included in one integrated chip (IC) have. At least some of the processors (e.g., cellular module 1521) corresponding to each of cellular module 1521, Wifi module 1523, BT module 1525, GPS module 1527 or NFC module 1528, And a Wifi processor corresponding to the Wifi module 1523) may be implemented in one SoC.

The RF module 1529 can transmit and receive data, for example, transmit and receive RF signals. The RF module 1529 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, or a low noise amplifier (LNA), although not shown. Further, the RF module 1529 may further include a component, for example, a conductor or a lead wire, for transmitting and receiving electromagnetic waves in free space in wireless communication. 15, the cellular module 1521, the Wifi module 1523, the BT module 1525, the GPS module 1527, and the NFC module 1528 are illustrated as sharing one RF module 1529, At least one of the cellular module 1521, the Wifi module 1523, the BT module 1525, the GPS module 1527 or the NFC module 1528 transmits and receives an RF signal through a separate RF module can do.

The SIM card 1524 may be a card containing a subscriber identity module and may be inserted into a slot formed at a specific location in the electronic device. SIM card 1524 may include unique identification information (e.g., ICCID) or subscriber information (e.g., international mobile subscriber identity (IMSI)).

The memory 1530 (e.g., memory 330) may include an internal memory 1532 or an external memory 1534. The built-in memory 1532 may be a nonvolatile memory such as a dynamic RAM (SRAM), a synchronous dynamic RAM (SDRAM), or a volatile memory At least one of programmable ROM (ROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, One can be included.

According to one embodiment, the internal memory 1532 may be a solid state drive (SSD). The external memory 1534 may be a flash drive, such as a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital Stick, and the like. The external memory 1534 may be operatively coupled to the electronic device 1500 via various interfaces. According to one embodiment, the electronic device 1500 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 1540 may measure the physical quantity or sense the operating state of the electronic device 1500 and convert the measured or sensed information into an electrical signal. The sensor module 1540 includes a gesture sensor 1540A, a gyro sensor 1540B, an air pressure sensor 1540C, a magnetic sensor 1540D, an acceleration sensor 1540E, a grip sensor 1540F, 1540G, a color sensor 1540H (e.g., an RGB (red, green, blue) sensor), a living body sensor 1540I, a temperature / humidity sensor 1540J, an illuminance sensor 1540K, ). ≪ / RTI > Additionally or alternatively, the sensor module 1540 may include, for example, an E-nose sensor (not shown), an EMG sensor (not shown), an EEG sensor (not shown) (not shown), an IR (infra red) sensor (not shown), an iris sensor (not shown), or a fingerprint sensor (not shown). The sensor module 1540 may further include a control circuit for controlling at least one or more sensors belonging thereto.

The input device 1550 may include a touch panel 1552, a (digital) pen sensor 1554, a key 1556 or an ultrasonic input device 1558 have. The touch panel 1552 can recognize the touch input in at least one of, for example, an electrostatic type, a pressure sensitive type, an infrared type, or an ultrasonic type. Further, the touch panel 1552 may further include a control circuit. In electrostatic mode, physical contact or proximity recognition is possible. The touch panel 1552 may further include a tactile layer. In this case, the touch panel 1552 can provide a tactile response to the user.

(Digital) pen sensor 1554 can be implemented using, for example, the same or similar method as receiving the touch input of the user or using a separate recognizing sheet. Key 1556 may include, for example, a physical button, an optical key or a keypad. The ultrasonic input device 1558 is a device that can confirm data by sensing a sound wave from the electronic device 1500 to a microphone (e.g., a microphone 1088) through an input tool for generating an ultrasonic signal. Do. According to one embodiment, the electronic device 1500 may use the communication module 1520 to receive user input from an external device (e.g., a computer or a server) connected thereto.

Display 1560 (e.g., display 350) may include panel 1562, hologram device 1564, or projector 1566. Panel 1562 may be, for example, a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED) Panel 1562 can be implemented, for example, flexible, transparent or wearable. The panel 1562 may be composed of one module with the touch panel 1552. [ The hologram device 1564 can display stereoscopic images in the air using the interference of light. The projector 1566 can display an image by projecting light onto the screen. The screen may be located, for example, inside or outside the electronic device 1500. According to one embodiment, the display 1560 may further comprise control circuitry for controlling the panel 1562, the hologram device 1564, or the projector 1566.

Interface 1570 may be implemented as a high-definition multimedia interface (HDMI) 1572, a universal serial bus (USB) 1574, an optical interface 1576, or a D- Lt; RTI ID = 0.0 > 1578 < / RTI > The interface 1570 may be included, for example, in the communication interface 360 shown in Fig. Additionally or alternatively, the interface 1570 may include a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an infrared data association .

The audio module 1580 can convert sound and electrical signals in both directions. At least some of the components of the audio module 1580 may be included, for example, in the input interface 340 shown in FIG. The audio module 1580 may process sound information input or output through, for example, a speaker 1582, a receiver 1584, an earphone 1586, a microphone 1588, or the like.

The camera module 1591 is a device capable of capturing a still image and a moving image. According to an embodiment, the camera module 1591 includes at least one image sensor (e.g., a front sensor or a rear sensor), a lens (not shown), an image signal processor Or a flash (not shown), such as a LED or xenon lamp.

The power management module 1595 may manage the power of the electronic device 1500. Although not shown, the power management module 1595 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (PMIC), or a battery or fuel gauge.

The PMIC can be mounted, for example, in an integrated circuit or a SoC semiconductor. The charging method can be classified into wired and wireless. The charging IC can charge the battery and can prevent an overvoltage or an overcurrent from the charger. According to one embodiment, the charging IC may comprise a charging IC for at least one of a wired charging mode or a wireless charging mode. The wireless charging system may be, for example, a magnetic resonance system, a magnetic induction system or an electromagnetic wave system, and additional circuits for wireless charging may be added, such as a coil loop, a resonant circuit or a rectifier have.

The battery gauge can measure, for example, the remaining amount of the battery 1596, the voltage during charging, the current or the temperature. The battery 1596 may store or generate electricity and supply power to the electronic device 1500 using the stored or generated electricity. The battery 1596 may include, for example, a rechargeable battery or a solar battery.

The indicator 1597 may indicate a particular state of the electronic device 1500 or a portion thereof (e.g., AP 1510), e.g., a boot state, a message state, or a state of charge. The motor 1598 can convert an electrical signal to mechanical vibration. Although not shown, the electronic device 1500 may include a processing unit (e.g., a GPU) for mobile TV support. The processing device for mobile TV support can process media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow.

Each of the above-described components of the electronic device according to various embodiments of the present invention may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. The electronic device according to various embodiments of the present invention may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components. In addition, some of the components of the electronic device according to various embodiments of the present invention may be combined into one entity, so that the functions of the components before being combined can be performed in the same manner.

The term " module " as used in various embodiments of the present invention may mean a unit that includes, for example, one or a combination of two or more of hardware, software or firmware. A " module " may be interchangeably used with terms such as, for example, unit, logic, logical block, component or circuit. A " module " may be a minimum unit or a portion of an integrally constructed component. A " module " may be a minimum unit or a portion thereof that performs one or more functions. &Quot; Modules " may be implemented either mechanically or electronically. For example, a " module " in accordance with various embodiments of the present invention may be implemented as an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) And a programmable-logic device.

According to various embodiments, at least a portion of a device (e.g., modules or functions thereof) or a method (e.g., operations) according to various embodiments of the present invention may be, for example, a computer readable And may be implemented with instructions stored on a computer-readable storage medium. An instruction, when executed by one or more processors (e.g., processor 320), may perform one or more functions corresponding to instructions. The computer readable storage medium may be, for example, memory 330. [ At least some of the programming modules may be implemented (e.g., executed) by, for example, the processor 320. At least some of the programming modules may include, for example, modules, programs, routines, sets of instructions, or processes for performing one or more functions.

A computer-readable recording medium includes a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, and an optical recording medium such as a CD-ROM (Compact Disc Read Only Memory) and a DVD (Digital Versatile Disc) ), A magneto-optical medium such as a floppy disk and a program command such as a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, ) ≪ / RTI > and a hardware device that is specifically configured to store and perform operations. The program instructions may also include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the various embodiments of the present invention, and vice versa.

Modules or programming modules according to various embodiments of the present invention may include at least one or more of the elements described above, some of which may be omitted, or may further include other additional elements. Operations performed by modules, programming modules, or other components in accordance with various embodiments of the invention may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

According to various embodiments, in a storage medium storing instructions, instructions are configured to cause at least one processor to perform at least one operation when executed by at least one processor, In the case where at least one of the first signal corresponding to the first communication network or the second signal corresponding to the second communication network is transmitted or received and the at least one signal is received, 1 signal and a second signal, distributing the at least one signal to a first communication control module for processing the first signal and a second communication control module for processing the second signal, respectively can do.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. And the like. Accordingly, the scope of various embodiments of the present invention should be construed as being included in the scope of various embodiments of the present invention without departing from the scope of the present invention, all changes or modifications derived from the technical idea of various embodiments of the present invention .

Claims (22)

A method of operating an electronic device,
Confirming a position of at least one other party included in the video call screen;
Determining an audio output level for each sound source output module based on the position of the at least one counterpart;
And outputting the sound source to each sound source output module based on the audio output level.
The method according to claim 1,
The operation of confirming the position may include:
And checking the position of at least one party included in the video call screen through face recognition of the video call screen.
The method according to claim 1,
Wherein the determining of the audio output level comprises:
The audio output level of at least one sound source output module relatively adjacent to the position of the other party included in the video call screen is set higher than the audio output level of at least one other sound source output module ≪ / RTI >
The method according to claim 1,
Wherein the sound source output module comprises at least one of at least one speaker and an earphone.
The method according to claim 1,
Further comprising dividing the video call screen into a plurality of areas,
The operation of confirming the position may include:
And checking at least one region of the plurality of regions included in the video call screen through face recognition of the video call screen.
6. The method of claim 5,
Wherein the determining of the audio output level comprises:
Detecting a change in mouth shape of the other party included in the video call screen;
Identifying at least one area including a calling party whose change in mouth shape is detected among the plurality of areas;
Determining an audio output level for each sound source output module based on an audio output level mapped to the at least one region.
The method according to claim 1,
Wherein the determining of the audio output level comprises:
Comparing the face sizes of the parties included in the video call screen when the video call screen includes a plurality of opponents;
The audio output level of at least one sound output module relatively adjacent to a position of the other party with a relatively large face size in the video call screen is set to an audio output level of at least one sound output module ≪ / RTI >
A method of operating an electronic device,
Confirming a location of a user of the electronic device when providing a call service;
Determining reception sensitivity for each microphone based on the location of the user;
And collecting sound sources via respective microphones based on the received sensitivity.
9. The method of claim 8,
The operation of confirming the position may include:
And using the sensor module to verify the location of the user of the electronic device.
9. The method of claim 8,
The operation of confirming the position may include:
Identifying the location of the user of the electronic device based on at least one of the size of the sound source and the time of detecting the sound source collected through each microphone when the device includes a plurality of microphones.
9. The method of claim 8,
The operation of determining the reception sensitivity includes:
And setting the reception sensitivity of the at least one microphone relatively close to the position of the user to be higher than the reception sensitivity of the remaining at least one microphone when the microphone includes a plurality of microphones.
The electronic device comprises:
A communication interface for transmitting and receiving signals with at least one counterpart electronic device;
At least one sound source output module for outputting an audio signal;
A processor for determining an audio output level for each sound output module based on the position of at least one other party included in the video call screen and outputting the sound source to each sound output module based on the audio output level Device.
13. The method of claim 12,
Wherein the processor is configured to determine a position of at least one counter party included in the video call screen through face recognition of the video call screen.
13. The method of claim 12,
Wherein the processor is configured to convert an audio output level of at least one sound source output module relatively adjacent to a position of a counterpart included in the video call screen to an audio output level of at least one sound source output module Lt; / RTI >
13. The method of claim 12,
Wherein the sound source output module comprises at least one of at least one speaker and an earphone.
13. The method of claim 12,
The processor is configured to divide the video call screen into a plurality of areas and to display at least one area of the plurality of areas included in the video call screen through the face recognition of the video call screen, Devices configured to verify.
17. The method of claim 16,
Wherein when the change in the mouth shape of the other party included in the video call screen is sensed, the processor outputs the audio output mapped to at least one area including the call partner, And to determine an audio output level for each sound source output module based on the level.
13. The method of claim 12,
Wherein the processor compares face sizes of the parties included in the video call screen when the video call screen includes a plurality of opponents and includes a plurality of sound source output modules, And to determine an audio output level of at least one sound source output module relatively adjacent to a relatively large counterpart position to be higher than an audio output level of at least one other sound source output module.
The electronic device comprises:
A communication interface for transmitting and receiving signals with at least one counterpart electronic device;
At least one sound source output module for outputting an audio signal;
At least one microphone for collecting audio signals;
And a processor for determining a reception sensitivity for each microphone based on a location of a user of the electronic device when providing a call service and collecting sound sources via respective microphones based on the reception sensitivity.
20. The method of claim 19,
Further comprising at least one sensor module,
Wherein the processor is configured to use the sensor module to determine a location of a user of the electronic device.
20. The method of claim 19,
Wherein the processor is configured to determine a location of a user of the electronic device based on at least one of a size of a sound source collected through each microphone and a sound source sensing time when the microphones are included.
20. The method of claim 19,
Wherein the processor is configured to determine a reception sensitivity of at least one microphone relatively adjacent to the user's position to be higher than a reception sensitivity of the remaining at least one microphone when the microphone includes a plurality of microphones.
KR1020140080997A 2014-06-30 2014-06-30 Electronic device and method for providing sound effects KR20160002132A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020140080997A KR20160002132A (en) 2014-06-30 2014-06-30 Electronic device and method for providing sound effects

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140080997A KR20160002132A (en) 2014-06-30 2014-06-30 Electronic device and method for providing sound effects

Publications (1)

Publication Number Publication Date
KR20160002132A true KR20160002132A (en) 2016-01-07

Family

ID=55168840

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140080997A KR20160002132A (en) 2014-06-30 2014-06-30 Electronic device and method for providing sound effects

Country Status (1)

Country Link
KR (1) KR20160002132A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110944139A (en) * 2019-11-29 2020-03-31 维沃移动通信有限公司 Display control method and electronic equipment
US11066483B2 (en) 2010-11-30 2021-07-20 Chugai Seiyaku Kabushiki Kaisha Cytotoxicity-inducing therapeutic agent
WO2022186599A1 (en) * 2021-03-02 2022-09-09 삼성전자 주식회사 Electronic device for applying directionality to audio signal, and method therefor
WO2024043514A1 (en) * 2022-08-22 2024-02-29 삼성전자 주식회사 Electronic device for controlling audio device on basis of image context, and method for operating same

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11066483B2 (en) 2010-11-30 2021-07-20 Chugai Seiyaku Kabushiki Kaisha Cytotoxicity-inducing therapeutic agent
CN110944139A (en) * 2019-11-29 2020-03-31 维沃移动通信有限公司 Display control method and electronic equipment
CN110944139B (en) * 2019-11-29 2022-04-22 维沃移动通信有限公司 Display control method and electronic equipment
WO2022186599A1 (en) * 2021-03-02 2022-09-09 삼성전자 주식회사 Electronic device for applying directionality to audio signal, and method therefor
WO2024043514A1 (en) * 2022-08-22 2024-02-29 삼성전자 주식회사 Electronic device for controlling audio device on basis of image context, and method for operating same

Similar Documents

Publication Publication Date Title
CN106060378B (en) Apparatus and method for setting photographing module
US10096301B2 (en) Method for controlling function and electronic device thereof
KR102031874B1 (en) Electronic Device Using Composition Information of Picture and Shooting Method of Using the Same
US10539525B2 (en) Apparatus and method for preventing malfunction in an electronic device
KR20160024168A (en) Method for controlling display in electronic device and the electronic device
KR20150127989A (en) Apparatus and method for providing user interface
KR20160064842A (en) Method for confirming a foreign substance in earjack and electronic device thereof
KR20160011392A (en) Method and device for identifying external device
KR102144588B1 (en) Sensor module and device therewith
KR20150100394A (en) Image displaying method and apparatus
KR20150106719A (en) Method for informing shooting location of electronic device and electronic device implementing the same
KR20160055337A (en) Method for displaying text and electronic device thereof
KR20150082043A (en) Electronic device having waterproof structure
KR20150122476A (en) Method and apparatus for controlling gesture sensor
US20150365573A1 (en) Electronic device case and electronic device having the same
KR20150125464A (en) Method for displaying message and electronic device
KR20160100674A (en) Method for recognizing flip cover of electronic device, electronic device, and flip cover
KR102267534B1 (en) Electronic device having waterproof structure
KR20150110202A (en) Electronic device, audio device, and method for supplying power to the audio deivce
KR102226817B1 (en) Method for reproducing contents and an electronic device thereof
KR20160002132A (en) Electronic device and method for providing sound effects
KR20160035846A (en) Apparatus and method for user based sensor data acquiring
KR20160004712A (en) Method for communicating wireless in accordance with an unauthorized frequency band and a electronic device implementing the same
KR20160045441A (en) Method and apparatus for playing video
KR20150136391A (en) Method for providing service and an electronic device thereof

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination