US20130232282A1 - Electronic device and method of controlling the same - Google Patents

Electronic device and method of controlling the same Download PDF

Info

Publication number
US20130232282A1
US20130232282A1 US13/462,573 US201213462573A US2013232282A1 US 20130232282 A1 US20130232282 A1 US 20130232282A1 US 201213462573 A US201213462573 A US 201213462573A US 2013232282 A1 US2013232282 A1 US 2013232282A1
Authority
US
United States
Prior art keywords
electronic device
audio data
sound output
external
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US13/462,573
Inventor
Jihwan Kim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Priority to US13/462,573 priority Critical patent/US20130232282A1/en
Assigned to LG ELECTRONICS INC. reassignment LG ELECTRONICS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KIM, JIHWAN
Publication of US20130232282A1 publication Critical patent/US20130232282A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72442User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Definitions

  • Embodiments of the present invention are directed to an electronic device connected to at least one other electronic device, which allows a user to easily notice audio data generated from the electronic device and the other electronic device and a method of controlling the electronic device.
  • UI user interface
  • various methods are needed to allow a user to efficiently control an electronic device so that he/she can enjoy various contents through multiple electronic devices (for example, 3-screen play or 5-screen play).
  • Embodiments of the present invention provide an electronic device that can more efficiently output audio data generated from multiple electronic devices connected to one another to a user and a method of controlling the electronic device.
  • an electronic device connected to at least one external electronic device, the electronic device including a communication unit configured to perform data communication with the at least one external electronic device, an interface unit configured to connect to a sound output device, and a controller configured, when the sound output device is connected to the electronic device through the interface unit, to receive audio data from the at least one external electronic device and to output the received audio data through the sound output device.
  • the controller is configured to select at least some of the at least one external electronic device when the sound output device is connected to the electronic device.
  • the controller is configured to select at least some of the at least one external electronic device based on at least one of a touch stroke, a voice command, a motion of the electronic device, or a selective input for a list of provided electronic devices.
  • the controller is configured, when the sound output device is connected to the electronic device, to transmit a first message to the at least one external electronic device to indicate the connection.
  • the received audio data includes encoded audio data.
  • the controller is configured to decode the received audio data and then output the decoded audio data through the sound output device.
  • the controller is configured, when the sound output device is disconnected from the electronic device, to transmit a second message to the at least one external electronic device to indicate the disconnection.
  • an electronic device connected to at least one external electronic device, the electronic device including a communication unit configured to perform data communication with the at least one external electronic device, a sound output module, and a controller configured, when sensing connection of a sound output device to one of the at least one external electronic device while outputting particular audio data associated with the electronic device through the sound output module, to transmit the particular audio data to the external electronic device connected to the sound output device through the communication unit.
  • the controller is configured, when sensing connection of the sound output device to one of the at least one external electronic device, to stop outputting the particular audio data through the sound output module.
  • the controller is configured to sense connection of the sound output device to one of the at least one external electronic device based on a first message transmitted from the external electronic device connected to the sound output device.
  • the audio data transmitted to the external electronic device connected to the sound output device is encoded audio data.
  • the controller is configured to display an indicator through a display module to indicate that the particular audio data is transmitted to the external electronic device connected to the sound output device.
  • an electronic device connected to at least one first electronic device, the electronic device including a communication unit configured to perform data communication with the at least one first electronic device and a controller configured to sense a predetermined event occurring at the electronic device, to determine one of the electronic device or the at least one first electronic device based on the predetermined event, and to transmit a first message including information on the determined electronic device to the at least one first electronic device.
  • the predetermined event includes at least one of input of a predetermined touch stroke, input of a predetermined voice command, or a connection of an external sound output device.
  • the first message includes a request that the at least one first electronic device transmit audio data associated with the at least one first electronic device to the determined electronic device.
  • the first message further includes network information for accessing the determined electronic device.
  • the controller is configured, when the determined electronic device is not the electronic device, to stop outputting the audio data associated with the electronic device and to transmit the audio data to the determined electronic device.
  • a user who simultaneously uses a plurality of electronic devices may easily obtain the audio data associated with the plurality of electronic devices through a sound output device (e.g., earphone) connected to one electronic device (e.g., smartphone).
  • a sound output device e.g., earphone
  • a user may receive the audio data from all the electronic devices through an earphone connected to one of the electronic devices, thus preventing other users from being annoyed by the audio data generated from the electronic devices.
  • a user may connect the earphone to a portable electronic device, such as a smartphone, which is physically or wirelessly connected to the TV or PC, to receive audio data generated from the television or PC.
  • a portable electronic device such as a smartphone
  • FIG. 1 is a block diagram illustrating an electronic device according to an embodiment of the present invention
  • FIGS. 2 to 4 illustrate an environment of an electronic device according to an embodiment of the present invention
  • FIGS. 5 and 6 are views illustrating an embodiment of the present invention.
  • FIG. 7 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention.
  • FIGS. 8 and 9 illustrate an operating state of an electronic device according to an embodiment of the present invention
  • FIGS. 10 to 12 illustrate the type of a predetermined event according to an embodiment of the present invention
  • FIGS. 13 to 16 illustrate determining non-selected electronic devices according to an embodiment of the present invention
  • FIG. 17 illustrates determining a target electronic device according to an embodiment of the present invention
  • FIG. 18 illustrates a delay occurring upon transmission of audio data according to an embodiment of the present invention
  • FIG. 19 illustrates a method of recovering sync distortion that may occur according to an embodiment of the present invention.
  • FIG. 20 illustrates an indicator displayed when audio data is transmitted to other electronic devices according to an embodiment of the present invention.
  • the electronic device may include a stationary type terminal, such as a digital TV or a desktop computer, as well as a mobile terminal, such as a cellular phone, a smart phone, a laptop computer, a digital broadcast terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), or a navigation system.
  • a stationary type terminal such as a digital TV or a desktop computer
  • a mobile terminal such as a cellular phone, a smart phone, a laptop computer, a digital broadcast terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), or a navigation system.
  • PDA Personal Digital Assistant
  • PMP Portable Multimedia Player
  • FIG. 1 is a block diagram illustrating an electronic device according to an embodiment of the present invention.
  • the electronic device 100 includes a wireless communication unit 110 , an A/V (AudioNideo) input unit 120 , a user input unit 130 , a sensing unit 140 , an output unit 150 , a memory 160 , an interface unit 170 , a control unit 180 , and a power supply 190 .
  • the components shown in FIG. 1 are not necessary, and according to an embodiment, more or less components may be included in the electronic device 100 .
  • the wireless communication unit 110 may include one or more modules that enable wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network in which the electronic device 100 is positioned.
  • the electronic device 100 may include a broadcast receiving module 111 , a mobile communication module 112 , a wireless Internet module 113 , a near field communication module 114 , and a location information module 115 .
  • the broadcast receiving module 111 receives broadcast signals and/or broadcast-related information from an external broadcast management server through broadcast channels.
  • the broadcast channels include satellite channels or terrestrial channels.
  • the broadcast management server may include a server that generates and transmits broadcast signals and/or broadcast-related information or receives pre-generated broadcast signals and/or broadcast-related information and transmits the signals and information to a terminal.
  • the broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals, as well as broadcast signals including combinations of TV broadcast signals or radio broadcast signals and data broadcast signals.
  • the broadcast-related information may include information relating to broadcast channels, broadcast programs or broadcast service providers.
  • the broadcast-related information may be provided through a mobile communication network and may be received through the mobile communication module 112 .
  • broadcast-related information may be provided, such as EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or ESG (Electronic Service Guide) of DVBH (Digital Video Broadcast Handheld).
  • EPG Electronic Program Guide
  • DMB Digital Multimedia Broadcasting
  • ESG Electronic Service Guide
  • DVBH Digital Video Broadcast Handheld
  • the broadcast receiving module 111 receives broadcast signals (e.g., digital broadcast signals) through various broadcast systems, such as, for example, DMBT (Digital Multimedia Broadcasting Terrestrial), DMBS (Digital Multimedia Broadcasting Satellite), MediaFLO (Media Forward Link Only), DVBH (Digital Video Broadcast Handheld), ISDBT (Integrated Services Digital Broadcast Terrestrial), or other digital broadcast systems.
  • broadcast signals e.g., digital broadcast signals
  • DMBT Digital Multimedia Broadcasting Terrestrial
  • DMBS Digital Multimedia Broadcasting Satellite
  • MediaFLO Media Forward Link Only
  • DVBH Digital Video Broadcast Handheld
  • ISDBT Integrated Services Digital Broadcast Terrestrial
  • the broadcast receiving module 111 may be configured to fit for any other broadcast system providing broadcast signals as well as the above-listed digital broadcast systems.
  • the broadcast signals and/or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160 .
  • the mobile communication module 112 transmits and receives wireless signals to/from at least one of a base station, an external terminal, and a server over a mobile communication network.
  • the wireless signals may include voice call signals, video call signals, various types of data based on transmission/reception of text/multimedia messages.
  • the wireless Internet module 113 may include modules that can access the Internet wirelessly.
  • the wireless Internet module 113 may be provided inside or outside the electronic device 100 .
  • Various types of wireless technologies may be used, such as WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), or HSDPA (High Speed Downlink Packet Access).
  • the near field communication module 114 may include modules for near-field communication.
  • Various near-field communication technologies may be employed, such as Bluetooth, RFID (Radio Frequency Identification), IrDA (infrared Data Association), UWB (Ultra Wideband), ZigBee, or WiHD, WiGig.
  • the location information module 115 may include a module for identifying a position of the electronic device or for obtaining the information on the position.
  • a representative example of the location information module 115 includes a GPS (Global Position System) module.
  • the GPS module 115 may yield three-dimensional location information based on the longitude, latitude, and altitude of one position (object) at one time by obtaining information on distances between the position (object) and three or more satellites and information on time when the distance information is obtained followed by triangulation. Further, the location information module 115 may obtain information on the position and time using three satellites and correct the obtained information using another satellite.
  • the location information module 115 may produce the current position in real time and calculate the speed information using the current position.
  • the A/V input unit 120 may include a camera 121 and a microphone 122 to receive audio or video signals.
  • the camera 121 processes picture frames such as still images or video images obtained by an image sensor in a video call mode or image capturing mode.
  • the processed picture frames may be displayed on the display unit 151 .
  • the picture frames processed by the camera 121 may be stored in the memory 160 or externally transmitted through the wireless communication unit 110 . Two or more cameras 121 may be provided depending on configuration of the terminal.
  • the microphone 122 receives external sound signals in a call mode, recording mode, or voice recognition mode and processes the received signals into electrical sound data.
  • the sound data may be converted into transmittable form and output to a mobile base station through the mobile communication module 112 .
  • the microphone 122 may include various noise cancelling algorithms to eliminate noise that is created while receiving external sound signals.
  • the user input unit 130 generates input data for a user to control the operation of the terminal.
  • the user input unit 130 may include a key pad, a dome switch, a touch pad (resistive/capacitive), jog wheel, or jog switch.
  • the sensing unit 140 may sense the current state of the electronic device 100 , such as the opening/closing state of the electronic device 100 , position of the electronic device 100 , presence or absence of user's contact, orientation of the electronic device 100 , or acceleration/deceleration of the electronic device 100 and generates sensing signals for controlling the operation of the electronic device 100 .
  • the sensing unit 140 may sense whether to open or close the sliding phone. Further, the sensing unit 140 may also sense whether the power supply 190 supplies power or whether the interface unit 170 is coupled with an external device.
  • the sensing unit 140 may include a posture sensor 141 and/or proximity sensor 142 .
  • the output unit 150 is provided to generate visual, audible, or tactile outputs.
  • the output unit 150 may include a display unit 151 , a sound output module 152 , an alarm unit 153 , and a haptic module 154 .
  • the display unit 151 displays information processed by the electronic device 100 .
  • the display unit 151 displays a UI (User Interface) or GUI (Graphic User Interface) relating to call.
  • the display unit 151 displays captured and/or received images or UIs or GUIs.
  • the display unit 151 may include at least one of a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode display, a flexible display, or a 3D display.
  • the display unit 151 may be configured in a transparent or light transmissive type, which may be called a “transparent display” examples of which include transparent LCDs.
  • the display unit 151 may have a light-transmissive rear structure in which a user may view an object positioned behind the terminal body through an area occupied by the display unit 151 in the terminal body.
  • two or more display units 151 may be included in the electronic device 100 .
  • the electronic device 100 may include a plurality of display units 151 that are integrally or separately arranged on a surface of the electronic device 100 or on respective different surfaces of the electronic device 100 .
  • the display unit 151 may be logically divided into two or more regions.
  • the display unit 151 and a sensor sensing a touch are layered (this layered structure is hereinafter referred to as a “touch sensor”), the display unit 151 may be used as an input device as well as an output device.
  • the touch sensor may include, for example, a touch film, a touch sheet, or a touch pad.
  • the touch sensor may be configured to convert a change in pressure or capacitance, which occurs at a certain area of the display unit 151 , into an electrical input signal.
  • the touch sensor may be configured to detect the pressure exerted during a touch as well as the position or area of the touch.
  • a corresponding signal is transferred to a touch controller.
  • the touch controller processes the signal to generate corresponding data and transmits the data to the control unit 180 .
  • the control unit 180 may recognize the area of the display unit 151 where the touch occurred.
  • the proximity sensor 142 may be positioned in an inner area of the electronic device 100 , which is surrounded by the touch screen, or near the touch screen.
  • the proximity sensor 142 refers to a sensor that detects an object approaching a predetermined detection surface or present near the detection surface without physical contact using electromagnetic fields or infrared beams.
  • the proximity sensor 142 has longer lifespan than a contact-type sensor and has more availability.
  • the proximity sensor 142 may include, but not limited to, a transmissive opto-electrical sensor, a direct reflective opto-electrical sensor, a mirror reflective opto-electrical sensor, a high frequency oscillating proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, or an IR proximity sensor.
  • the proximity sensor 142 may detect the approach of a pointer depending on a variation of an electric field that occurs as the point gets close.
  • the touch screen may be classified as the proximity sensor.
  • proximity touch When a point is positioned near the touch screen while not in contact with the touch screen and it may be recognized that the point is positioned on the touch screen, it is represented as “proximity touch”.
  • contact touch When the point actually contacts the touch screen, it is represented as “contact touch”.
  • the position where the proximity touch to the point is done on the touch screen refers to a position where the pointer vertically corresponds to the touch screen when the pointer is subjected to the proximity touch.
  • the “touch” or “touch input” may refer to either an input by the proximity touch or an input by the contact touch.
  • the proximity sensor 142 senses a proximity touch and proximity touch pattern (for example, distance, direction, speed, time, position, or travelling state of the proximity touch). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be displayed on the touch screen.
  • a proximity touch and proximity touch pattern for example, distance, direction, speed, time, position, or travelling state of the proximity touch.
  • the sound output module 152 may output audio data received from the wireless communication unit 110 in a call signal receiving mode, call mode, or recording mode, voice recognition mode, or broadcast receiving mode or stored in the memory 160 .
  • the sound output module 152 outputs sound signals relating to functions performed in the electronic device 100 (for example, signaling call signal reception or message reception).
  • the sound output module 152 may include a receiver, a speaker, or a buzzer.
  • the alarm unit 153 outputs signals for signaling an event occurring in the electronic device 100 .
  • the event may include reception of call signals or messages, entry of key signals, or touch input.
  • the alarm unit 153 may also output signals for signaling occurrence of an event, for example, by vibration which is of other types than video or audio signals.
  • the video or audio signals may be output through the display unit 151 or the sound output module 152 .
  • the haptic module 154 generates various tactile effects that may be sensed by a user.
  • a representative example of a tactile effect generated by the haptic module 154 includes vibration.
  • the strength or pattern of vibration generated by the haptic module 154 may be controlled. For example, different types of vibration may be mixed and output or sequentially output.
  • the haptic module 154 may generate an effect coming from a stimulus made by a pin array moving perpendicular to the contact skin surface, an effect coming from a stimulus by jet or suction force of air through an inlet or suction port, an effect coming from a stimulus created when a skin surface is rubbed, an effect coming from a stimulus made by contact with an electrode, an effect coming from a stimulus by an electrostatic force, or an effect coming from reproduction of warm or cool feeling using a heat absorption or generation element.
  • the haptic module 154 may transfer the tactile effects through a direct contact and may be configured to provide tactile effects through muscle sense of a user's finger or arm. Two or more haptic modules 154 may be provided depending on configuration of the electronic device 100 .
  • the memory 160 may store a program for operation of the control unit 180 and may temporarily store input/output data (for example, phone books, messages, still images, or videos).
  • the memory 160 may store data relating to various patterns of vibration and sounds that are output when touch input is made on the touch screen.
  • the memory 160 may include at least one storage medium of flash memory types, hard disk types, multimedia card micro types, card type memories (e.g., SD or XD memories), RAMs (Random Access Memories), SRAM (Static Random Access Memories), ROMs (Read-Only Memories), EEPROMs (Electrically Erasable Programmable Read-Only Memories), PROM (Programmable Read-Only Memories), magnetic memories, magnetic discs, and optical discs.
  • the electronic device 100 may operate in association with a web storage performing a storage function of the memory 160 over the Internet.
  • the interface unit 170 functions as a path between the electronic device 100 and any external device connected to the electronic device 100 .
  • the interface unit 170 receives data or power from an external device and transfers the data or power to each component of the electronic device 100 or enables data to be transferred from the electronic device 100 to the external device.
  • the interface unit 170 may include a wired/wireless headset port, an external recharger port, a wired/wireless data port, a memory card port, a port connecting a device having an identification module, an audio I/O (Input/Output) port, a video I/O port, and an earphone port.
  • the identity module is a chip storing various types of information to authenticate the authority for using the electronic device 100 and may include a user identity module (UIM), a subscriber identity module (SIM), a universal subscriber identity module (USIM), or the like.
  • a device having the identity module (hereinafter, “identity device”) may be implemented as a smart card so that the identity device may be connected to the electronic device 100 through a port.
  • the interface unit may serve as a path through which power is supplied from an external cradle to the electronic device 100 when the cradle is connected to the electronic device 100 or a path through which various command signals are supplied from the cradle to the electronic device 100 by a user.
  • the various command signals and he power from the cradle may function as signals that allow the user to notice that the electronic device 100 is correctly coupled with the cradle.
  • the control unit 180 controls the overall operation of the electronic device 100 .
  • the control unit 180 performs control and process relating to voice call, data communication, or video call.
  • the control unit 180 may include a multimedia module 181 for playing multimedia.
  • the multimedia module 181 may be implemented in the control unit 180 or may be provided separately from the control unit 180 .
  • the control unit 180 may perform pattern recognition process that allows handwriting or drawing on the touch screen to be recognized as text or images.
  • the power supply 190 receives external/internal power under the control of the control unit 180 and feeds the power to other components.
  • the embodiments herein may be implemented in software, hardware, or a combination thereof, and may be recorded in a recording medium that may be read b a computer or its similar device.
  • the embodiments may be implemented as at least one of ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays, processors, controllers, microcontrollers, microprocessors, or electrical units for performing the functions.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays, processors, controllers, microcontrollers, microprocessors, or electrical units for performing the functions.
  • the processes, functions, or the embodiments may be implemented together with a separate software module that may perform at least one function or operation.
  • the software code may be implemented as a software application that has been written in proper program language.
  • the software code may be stored in the memory 160 and executed by the control unit 180 .
  • FIGS. 2 to 4 illustrate an environment where an electronic device applies according to an embodiment of the present invention.
  • first electronic device second electronic device
  • third electronic device may be used, each of which may include the same or substantially the same configuration as the electronic device 100 described in connection with FIG. 1 .
  • each of the first to third electronic devices may include more or less components than the components of the electronic device 100 illustrated in FIG. 1 .
  • electronic devices 100 A, 100 B, and 100 C may be directly connected to each other.
  • the first electronic device 100 A may be directly connected to the second or third electronic devices 100 B and 100 C
  • the second electronic device 100 B may be directly connected to the third electronic device 100 C.
  • the connections between the electronic devices 100 A, 100 B, and 100 C may be made physically or wirelessly.
  • a wired LAN or USB cable may be used for connection between the electronic devices 100 A, 100 B, and 100 C.
  • wireless interfaces such as WiFi, WiGig, WiHD, or ZigBee, may be used for such connection.
  • FIG. 2 when the electronic devices 100 A, 100 B, and 100 C are directly connected to each other, at least one of the devices 100 A, 100 B, and 100 C may function as a network manager that manages a network established by the devices 100 A, 100 B, and 100 C.
  • the electronic devices 100 A, 100 B, and 100 C may be connected to each other via a server 200 .
  • the first electronic device 100 A is indirectly connected to the electronic devices 100 A and 100 B through the server 200
  • the second electronic device 100 B is indirectly connected to the third electronic device 100 C through the server 200 .
  • Connection between the server and the electronic devices 100 A, 100 B, and 100 C may be made physically or wirelessly as shown in FIG. 2 .
  • the server 200 may function as a network manager that manages a network established by the electronic devices 100 A, 100 B, and 100 C.
  • the electronic devices 100 A, 100 B, and 100 C may be connected to a remote server 300 via a wired/wireless communication network that is established for remote communication, so that the first electronic device 100 A may be indirectly connected to the second and third electronic devices 100 B and 100 C, and the second electronic device 100 B may be indirectly connected to the third electronic device 100 C.
  • the electronic devices 100 A, 100 B, and 100 C and the server 300 may be connected to each other through the Internet, a mobile network, or other known communication networks.
  • FIGS. 2 to 4 Although three electronic devices 100 A, 100 B, and 100 C are connected to each other as shown in FIGS. 2 to 4 , the embodiments of the present invention are not limited thereto. According to an embodiment, two, or four or more electronic devices may be connected to each other.
  • one of the electronic devices 100 A, 100 B, and 100 C is selected (hereinafter, the selected one is also referred to as “selected device” or “selected electronic device”) and the other electronic devices (which are also referred to as “non-selected devices” or “non-selected electronic devices”) than the selected device transmit audio data generated from the non-selected devices to the selected device, so that the selected device plays both the audio data generated by the selected device and the audio data transmitted from the non-selected devices.
  • the output of the audio data from the sound output modules 152 of the non-selected devices and/or external sound output devices connected to the non-selected devices are stopped and the non-selected devices transfer the audio data generated from the non-selected devices to the selected device.
  • FIGS. 5 and 6 illustrate an embodiment of the present invention.
  • the first electronic device 100 A outputs a sound SA corresponding to audio data generated from the first electronic device 100 A
  • the second electronic device 100 B outputs a sound SB corresponding to audio data generated from the second electronic device 100 B
  • the third electronic device 100 C outputs a sound SC corresponding to audio data generated from the third electronic device 100 C.
  • the second and third electronic devices 100 B and 100 C transmit second and third audio data AD 2 and AD 3 respectively generated from the second and third electronic devices 100 B and 100 C to the first electronic device 100 A outputs both the audio data AD 1 generated from the first electronic device 100 A and the audio data AD 2 and AD 3 transmitted from the devices 100 B and 100 C.
  • the predetermined event may be one of various events.
  • the predetermined event may include connection between an external sound output device and one of the electronic devices 100 A, 100 B, and 100 C or a user's request through key entry or touching.
  • FIG. 6 illustrates an example where the predetermined event is connection to an external sound output device.
  • the sound output device 400 is connected to the first electronic device 100 A
  • the second and third audio data AD 2 and AD 3 generated from the second and third devices 100 B and 100 C is transmitted from the devices 100 B and 100 C to the first electronic device 100 A
  • the first electronic device 100 A outputs the second and third sounds SB and SC respectively corresponding to the second and third audio data AD 2 and AD 3 as well as the first sound SA corresponding to the first audio data AD 1 generated from the first electronic device 100 A.
  • the external sound output device may be any type of device, such as an earphone, speaker, or Bluetooth headset, which may audibly transfer sounds to a user.
  • the selected device may be determined in consideration of the predetermined event. For example, the selected device may be determined as one of the electronic devices 100 A, 100 B, and 100 C, which causes the predetermined event. For example, an electronic device connected to the external sound output device may be determined as the selected device. Alternatively, when the predetermined event is a user's request, the selected device may be determined in response to the user's request.
  • the “audio data generated from electronic device(s)” collectively refers to overall audio data to be output through the sound output module(s) 152 of the electronic device(s) and/or sound output device(s) connected to the electronic device(s) by a system of the electronic device(s) and/or an application executed in the electronic device(s).
  • the audio data includes audio data (system alarm/alert sound, etc.) generated by the operation of the system of the electronic device or audio data (sound of content played by an application, such as media player, or message receipt sound output by a message application) generated by the operation of an application in execution by the electronic device.
  • the “audio data generated from electronic device(s)” may be also referred to as “audio data associated with electronic device(s)”.
  • output audio data refers to externally outputting a sound corresponding to sound data stored in an analog or digital format through the sound output module 152 of the electronic device and/or a sound output device connected to the electronic device so that the sound can be audibly recognized.
  • FIG. 7 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention.
  • FIGS. 8 and 9 illustrate specific examples of the operation of an electronic device according to an embodiment of the present invention.
  • the first electronic device 100 A is connected to the second electronic device 100 B and/or the third electronic device 100 C (S 100 ). As described in connection with FIGS. 2 to 4 , various methods of connecting the first electronic device 100 A to the devices 100 B and/or 100 C may be adopted.
  • the first electronic device 100 A may output first audio data AD 1 associated with the first electronic device 100 A (S 110 ).
  • the second electronic device 100 B and/or the third electronic device 100 C may respectively output second audio data AD 2 associated with the second electronic device 100 B and/or third audio data AD 3 associated with the third electronic device 100 C (S 120 ).
  • FIG. 8 which illustrates an example where the first electronic device 100 A, a smartphone, is connected to the second electronic device 100 B, a TV, via a wireless link, when a user views a movie on the TV 100 B, the TV 100 B may output a sound SB corresponding to the movie through the sound output module 152 included in the TV 100 B.
  • the first electronic device 100 A may sense a connection between the first electronic device 100 A and an external sound output device 400 (S 130 ).
  • the first electronic device 100 A may sense such connection by various methods.
  • the electronic device may detect the connection to the earphone and/or speaker via the output port. For example, the moment the earphone and/or speaker is connected to the output port, an interrupt occurs which causes audio data generated from the electronic device to be output through the earphone and/or speaker connected to the output port.
  • the first electronic device 100 A may sense connection of the external sound output device 400 based on occurrence of an interrupt (S 130 ).
  • a Bluetooth technology may be used for wireless connection with the external sound output device.
  • the operation of an electronic device attempting to connect with a sound output device is called “pairing” through which the electronic device may identify the type of another electronic device connected to the electronic device.
  • an electronic device may obtain information on whether the other electronic device connected to the electronic device based on a Bluetooth technology is a desktop computer, a mobile terminal, such as a smartphone, or a sound output device, such as a Bluetooth headset.
  • the first electronic device 100 A may sense connection of the external sound output device 400 based on the pairing operation (S 130 ).
  • the first electronic device 100 A may transmit a first message to the non-selected devices 100 B and 100 C connected to the first electronic device 100 A (S 140 ).
  • the first message may simply notify the non-selected devices 100 B and 100 C that the external sound output device 400 is connected to the first electronic device 100 A.
  • the first message may include a control signal requesting that the non-selected devices 100 B and 100 C send to the first electronic device 100 A audio data generated after receiving the first message.
  • the second electronic device 100 B may stop outputting the second audio data AD 2 generated from the second electronic device 100 B through the sound output module 152 of the second electronic device 100 B (S 150 ) and may transmit the second audio data AD 2 associated with the second electronic device 100 B to the first electronic device 100 A (S 160 ).
  • FIG. 9 which illustrates an example where the external sound output device 400 is connected to the first electronic device 100 A in the circumstance shown in FIG. 8 , a sound SB corresponding to the audio data AD 2 of a movie output from the second electronic device 100 B, e.g., a TV, is not output through the sound output module 152 of the device 100 B any longer, but may be transmitted to the first electronic device 100 A, e.g., a smartphone.
  • the second audio data AD 2 transmitted from the second electronic device 100 B to the third electronic device 100 C is not limited to the audio data that is being output from the second electronic device 100 B at the time of receiving the first message and may rather include all of other types of audio data that may be later generated from the second electronic device 100 B.
  • audio data such as a user warning sound and/or alarming sound generated by the operation of an application and/or system of the second electronic device 100 B may be also transmitted to the first electronic device 100 A.
  • the third electronic device 100 C may transmit the third audio data AD 3 associated with the third electronic device 100 C to the first electronic device 100 A as described above in relation to the operation of the second electronic device 100 B.
  • the audio data transmitted from the second and/or third electronic device 100 B and/or 100 C may be encoded audio data. Since the encoded audio data remains further compressed by a data compressing technology compared to when the data is decoded, data size deceases, thus resulting in more efficient data transmission. Unlike the general sound output devices, the second and/or third electronic device 100 B or 100 C can generally decode the encoded audio data on its own. Accordingly, transmission of such encoded audio data does not cause any technical problems. However, the transmitted audio data is not inevitably limited to the encoded audio data.
  • the first electronic device 100 A may output a sound corresponding to the second or third audio data AD 2 or AD 3 through the sound output device connected to the first electronic device 100 A so that a user may audibly notice the sound (S 170 ).
  • the sound SB corresponding to the second audio data AD 2 finally transmitted from the second electronic device 100 B may be output through the sound output device 400 (for example, an earphone) connected to the first electronic device 100 A so that the user U may audibly notice the sound SB.
  • the first electronic device 100 A may decompress (or decode) the second and/or third audio data AD 2 or AD 3 so that the audio data AD 2 or AD 3 may be normally output through the external sound output device 400 .
  • the first electronic device 100 A may also output a sound corresponding to the first audio data AD 1 associated with the first electronic device 100 A.
  • the first electronic device 100 A When the first electronic device 100 A is disconnected from the external sound output device 400 while the audio data AD 1 , AD 2 , and AD 3 associated with the first to third electronic devices 100 A, 100 B, and 100 C is output through the external sound output device 400 connected to the first electronic device 100 A, e.g., under the control of the first electronic device 100 A (S 180 ), the first electronic device 100 A may transmit a second message to the second and/or third electronic device 100 B or 100 C (S 190 ).
  • the second message may simply notify the other electronic devices 100 B and 100 C that the external sound output device 400 is disconnected from the first electronic device 100 A.
  • the second message may include a control signal requesting that the other electronic devices 100 B and 100 C output audio data generated after receiving the second message through the sound output module of the second or third electronic device 100 B or 100 C.
  • the first to third electronic devices 100 A, 100 B, and 100 C return to step S 110 and/or S 120 so that the first to third electronic devices 100 A, 100 B, and 100 C respectively output the first audio data AD 1 associated with the first electronic device 100 A, the second audio data AD 2 associated with the second electronic device, and the third audio data AD 3 associated with the third electronic device.
  • a user who simultaneously uses a plurality of electronic devices may easily obtain the audio data associated with the plurality of electronic devices through a sound output device (e.g., earphone) connected to one electronic device (e.g., the smartphone shown in FIGS. 8 and 9 ).
  • a sound output device e.g., earphone
  • a user may receive the audio data from all the electronic devices through an earphone connected to one of the electronic devices, thus preventing other users from being annoyed by the audio data generated from the electronic devices.
  • a user may connect the earphone to a portable electronic device, such as a smartphone, which is physically or wirelessly connected to the TV or PC, to receive audio data generated from the television or PC.
  • a portable electronic device such as a smartphone
  • predetermined events are described. Although it has been illustrated in FIGS. 7 to 9 that the predetermined event is connection between one electronic device and an external sound output device. However, the predetermined event is not limited thereto.
  • FIGS. 10 to 12 which illustrate the type of a predetermined event according to an embodiment of the present invention, the predetermined event is described below.
  • one electronic device may recognize or sense a user's active input and/or its passive state through various user interfaces including a menu interface, a touch interface, a voice interface, or a motion interface, and may determine that a predetermined event occurs when a sensed result is identical to a predetermined input value or state value.
  • a corresponding electronic device may determine that a predetermined event occurs.
  • an electronic device may predefine a voice command (e.g. pulling audio) designated for “pulling function for audio data of other electronic devices,” and when the designated voice command is input, may determine that a predetermined event occurs.
  • a voice command e.g. pulling audio
  • an electronic device may predefine a particular touch stroke TS corresponding to “pulling function for audio data of other electronic devices” as shown in FIG. 11 , and when the predetermined touch stroke TS is input, may determine that a predetermined event occurs. Subsequently, for example, as shown in FIG. 12 , an electronic device may predetermine a motion (e.g., shaking as shown in FIG. 12 ) corresponding to “pulling function for audio data of other electronic devices,” and when a user makes the predetermined motion with the electronic device, may determine that a predetermined event occurs.
  • a predetermined event may be designated by various methods.
  • the predetermined event may also be designated by one or more combinations of the above-described or any other methods of designating a predetermined event. For example, when a user inputs a voice command, “pulling audio”, to an electronic device and then shakes the electronic device, the electronic device may determine that a predetermined event occurs. As another example, when a user connects an external sound output device 400 to an electronic device and then selects “yes” in response to an inquiry asking “Do you want to perform a pulling function for audio data of other electronic devices?” on a confirmation window of the electronic device, the electronic device may determine that a predetermined event occurs.
  • electronic devices of transmitting audio data are determined as all of the other electronic devices than an electronic device connected to the sound output device
  • the other electronic devices may be selectively determined by various methods.
  • FIGS. 13 to 16 which illustrate determining the other electronic devices according to embodiments of the present invention, various methods of determining the other electronic devices are described below.
  • one electronic device (e.g., the first electronic device 100 A) where the predetermined event occurs may display a window W 1 allowing a user to select non-selected electronic devices among other electronic devices connected to the first electronic device 100 A. Accordingly, the user may select at least one of the second and third electronic devices 100 B and 100 C, and based on the user's selection, the first electronic device 100 A may determine at least one of the second and third electronic devices 100 B and 100 C as the non-selected electronic device(s).
  • the selected electronic device when sensing the predetermined event, may determine the non-selected electronic devices of other electronic devices connected to the selected electronic device by recognizing a user's voice command as shown in FIG. 14 .
  • the first electronic device 100 A may determine all of the second and third electronic devices 100 B and 100 C connected to the first electronic device 100 A as the non-selected electronic devices, and as shown in image (b) of FIG. 14 , when the user inputs a voice command saying “television”, the first electronic device 100 A may determine a TV (e.g., the second electronic device) as the non-selected electronic device. As shown in image (c) of FIG. 14 , when the user inputs a voice command saying “PC”, the first electronic device 100 A may determine a PC (e.g., the third electronic device) as the non-selected electronic device.
  • a PC e.g., the third electronic device
  • a voice command designated as the predetermined event described in connection with FIG. 10 may be combined with a voice command for determining the non-selected electronic device. For example, when a user inputs a voice command saying “pull television audio”, among a plurality of electronic devices, the first electronic device 100 A may determine a television as a non-selected electronic device so that only audio data generated from the television may be pulled.
  • the selected electronic device e.g., the first electronic device 100 A
  • the predetermined event may determine the non-selected electronic device(s) of other electronic devices connected to the selected electronic device by recognizing a user's touch stroke as shown in FIGS. 15 and 16 .
  • the plurality of electronic devices connected to the first electronic device 100 A may respectively correspond to touch strokes with different attributes. For example, when receiving a first touch stroke TS 1 as shown in image (a) of FIG. 15 , the first electronic device 100 A may determine the second electronic device 100 B corresponding to the first touch stroke TS 1 as the non-selected electronic device, and when receiving a second touch stroke TS 2 as shown in image (b) of FIG. 15 , the first electronic device 100 A may determine the third electronic device 100 C corresponding to the second touch stroke TS 2 as the non-selected electronic device. When receiving a third touch stroke TS 3 as shown in image (c) of FIG. 15 , the first electronic device 100 A may determine all of the electronic devices connected to the first electronic device 100 A as the non-selected electronic devices.
  • the attributes of the touch strokes may include at least one of speed, trajectory, direction, or length. Although it has been illustrated in FIG. 15 that the touch strokes respectively corresponding to the second and third electronic devices 100 B and 100 C have different trajectories, the touch strokes may be distinguished from each other by different directions while having the same trajectory as shown in FIG. 16 .
  • third to sixth touch strokes have straight trajectories with different directions.
  • the first electronic device 100 A may make different electronic devices correspond to the third to sixth touch strokes TS 3 , TS 4 , TS 5 , and TS 6 , respectively.
  • the predetermined strokes may correspond to the trajectories of initials of English names of the plurality of electronic devices, thereby resulting in provision of an easier or more user-friendly user interface.
  • the user may select the non-selected electronic device by inputting a touch stroke corresponding to the English initial, T, of television, and when desiring to select a PC as the non-selected electronic device, the user my select the non-selected electronic device by inputting a touch stroke corresponding to the English initial, P, of PC.
  • the user may be provided an intuitive, user-friendly user interface with no inconvenience.
  • a selected electronic device (e.g., the first electronic device 100 A) where the predetermined event occurs may determine the non-selected electronic device(s) among the plurality of electronic devices by analyzing the pattern of a motion made by the user while grabbing the first electronic device 100 A.
  • the electronic device 100 may determine the non-selected electronic device(s) based on a user's motion by making the electronic devices correspond to motions having at least one attribute different from the other attributes.
  • the first message may be transmitted to only the non-selected electronic device(s) determined by the methods described above. Accordingly, the steps (e.g., steps S 150 and S 160 ) described in connection with FIG. 7 are performed by only the electronic devices which receive the first message. Even when the first electronic device 100 A is disconnected from the sound output device, the transmission may be conducted by only the determined non-selected electronic devices.
  • an electronic device e.g., a target electronic device
  • the target electronic device may be determined by various methods.
  • FIG. 17 which illustrates determining a target electronic device
  • various methods of determining a target electronic device are described.
  • the predetermined event is connection of a sound output device to an electronic device, in which situation, a user's intention may be shown that pulls audio data to the electronic device connected to the sound output device (for example, an earphone or Bluetooth headset).
  • the electronic device pulling audio data may be an electronic device sensing the predetermined event, but not limited thereto.
  • the electronic device sensing the predetermined event may provide a user with an interface to allow the user to determine an electronic device to which audio data is to be transmitted.
  • the first electronic device 100 A may display a window W 2 through which the user may select electronic device(s) of a plurality of electronic devices through which to send audio data, and the user may select one electronic device through the window provided by the first electronic device 100 A.
  • the first electronic device 100 A may determine an electronic device to which audio data is to be pulled based on a result of recognizing a user's particular motion, touch stroke, or voice command by a method similar to the method of determining the non-selected electronic device(s) as shown in FIGS. 14 to 16 .
  • the first message may include information on an electronic device to which audio data is to be pulled as determined by the above-described methods.
  • the first message may include identification information on the electronic device, network address of the electronic device, or any other information necessary for the non-selected electronic devices to transmit audio data to the electronic device.
  • the non-selected electronic devices may receive the first message and then transmit the audio data to the electronic device indicated by the first message while performing step S 160 shown in FIG. 7 .
  • the first electronic device 100 A when the first electronic device 100 A receives a voice command as a predetermined event and determines the second electronic device 100 B as an electronic device to which the audio data is pulled, the first electronic device 100 A transmits the first message to the second and/or third electronic device 100 B or 100 C so that the third electronic device 100 C transmits the third audio data AD 3 associated with the third electronic device 100 C to the second electronic device 100 B, but not to the first electronic device 100 A.
  • the first electronic device 100 A may perform steps S 150 and S 160 described in connection with FIG. 7 . For example, after transmission of the first message, the first electronic device 100 A stops outputting the first audio data AD 1 associated with the first electronic device 100 A through the sound output module 152 of the first electronic device 100 A and transmits the first audio data AD 1 to the above-determined 100 B.
  • the second electronic device 100 B outputs the first and third audio data AD 1 and AD 3 as received.
  • the first and third audio data may be output through the external sound output device 400 .
  • the first and third audio data may be output through the sound output module 152 of the second electronic device 100 B.
  • the audio data associated with non-selected electronic devices is transmitted to a selected electronic device (e.g., the first electronic device 100 A), and the audio data processed by the selected electronic device (e.g., the first electronic device 100 A) may be output through the external sound output device 400 connected to the selected electronic device or the sound output module 152 of the selected electronic device.
  • the audio data associated with the second electronic device 100 B may be associated with video data that is displayed in synchronization with the audio data.
  • audio and video data should be output while associated and synchronized with each other.
  • audible feedback an audible feedback and/or notice
  • visual feedback a visual feedback and/or notice
  • a time of displaying the video data output through the second electronic device 100 B may differ from a time of outputting the audio data associated with the video data through the first electronic device 100 A (hereinafter, “audio output time”) since there may be a delay for transmission of the audio data to the first electronic device 100 A.
  • FIG. 18 illustrates a delay created upon transmission of audio data according to an embodiment of the present invention.
  • Image (a) of FIG. 18 illustrates audio and video data associated with each other.
  • audio and video data needed to be output while synchronized with each other as shown in image (a) of FIG. 18 is generated from the second electronic device 100 B (e.g., audio and video data associated with the second electronic device 100 B)
  • the video data is output through the second electronic device 100 B
  • the audio data is transmitted to the first electronic device 100 A and then output through the external sound output device 400 and/or the sound output module 152 of the first electronic device 100 A.
  • Synchronization between the audio and video data may be distorted by a time (D, hereinafter, delay time by transmission) taken for the audio data to be transmitted to the first electronic device 100 A.
  • D delay time by transmission
  • audio data may be output the delay time D by transmission after a time when the video data starts to be output.
  • the second electronic device 100 B may delay a time of displaying the video data by the delay time D by transmission.
  • the second electronic device 100 B may obtain a state of a network connected to the first electronic device 100 A and a data transmission rate of the network to calculate a time taken for the audio data to be transmitted to the first electronic device 100 A.
  • the second electronic device 100 B may keep sensing the state of the network and data transmission rate of the network. According to an embodiment, when receiving the first message, the second electronic device 100 B may transmit a particular message to the first electronic device 100 A to identify the state of connection with the first electronic device 100 A and may receive a response message for the particular message transmitted from the first electronic device 100 A. The second electronic device 100 B may calculate the connection state and/or data transmission rate in consideration with a time of transmitting the particular message and a time of receiving the response message.
  • the second electronic device 100 B may receive a predetermined input from the second electronic device 100 B and gradually delay the time of displaying the video data based on the predetermined input.
  • the first electronic device 100 A may output the video data with the video data delayed by a predetermined time interval according to the particular input.
  • the second electronic device 100 B may output the video data with the video data delayed by double the predetermined time interval.
  • FIG. 19 illustrates a method of recovering a sync distortion according to an embodiment of the present invention.
  • Image (a) of FIG. 19 illustrates that a sync distortion occurs between video and audio data according to an embodiment.
  • the second electronic device 100 B may output the video data with the video data delayed by a predetermined time interval G (image (b) of FIG. 19 ), and when the user makes the particular input again under the above situation (e.g., when the user makes the particular input twice), the second electronic device 100 B delays further by the time interval G in the state shown in image (b) of FIG. 19 , outputting the video data (image (c) of FIG. 19 ).
  • the distorted sync between the video and audio data may be recovered.
  • the particular input is done two times to recover the distorted sync
  • the distorted sync may be recovered by making the particular once or three times or more.
  • the second electronic device 100 B and/or the third electronic device 100 C may display an indicator which includes a symbol or a combination of symbols to indicate that the audio data associated with the second electronic device 100 B and/or the third electronic device 100 C is being transmitted to the first electronic device 100 A.
  • FIG. 20 illustrates an indicator which is displayed when audio data is transmitted to another electronic device according to an embodiment of the present invention.
  • the second electronic device 100 B and/or the third electronic device 100 C may display the indicator S through the display module 151 of the second electronic device 100 B or the third electronic device 100 C.
  • other users may easily notice that the audio data associated with the second electronic device 100 B and/or the third electronic device 100 C is being transmitted to “JW's Phone”.
  • the indicator S allows other users to be able to easily notice transmission of audio data to other electronic devices.
  • the indicator S may remain displayed when the second and/or third electronic device 100 B or 100 C transmits audio data to the first electronic device 100 A.
  • the indicator S may be displayed only when a user's control request (e.g., the user's input for adjusting sound volume of the second and/or third electronic device) occurs on the second and/or third electronic device 100 B or 100 C.
  • a user's control request e.g., the user's input for adjusting sound volume of the second and/or third electronic device
  • the second and/or the third electronic device 100 B or 100 C may display the indicator S only for a predetermined time so that other users may notice transmission of the audio data of the second and/or third electronic device 100 B or 100 C.
  • FIG. 20 illustrates that information is also displayed to indicate transmission of the audio data of the second and/or third electronic device 100 B or 100 C as well as to allow an electronic device receiving the audio data to be identified.
  • the information for identifying an electronic device receiving the audio data may be excluded from the information that may be provided by the indicator. Alternatively, more information may be included in the information that may be provided by the indicator.
  • each step in each embodiment is not inevitable, and each embodiment may selectively include the steps therein.
  • the steps in each embodiment are not necessarily performed in the order described above, and for example, a later step may be performed earlier than an earlier step.
  • the control method may be stored in a computer readable recording medium in the form of a code or program.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Telephone Function (AREA)

Abstract

There is provided an electronic device connected to at least one external electronic device, the electronic device including a communication unit configured to perform data communication with the at least one external electronic device, an interface unit configured to connect to a sound output device, and a controller configured, when the sound output device is connected to the electronic device through the interface unit, to receive audio data from the at least one external electronic device and to output the received audio data through the sound output device.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • Embodiments of the present invention are directed to an electronic device connected to at least one other electronic device, which allows a user to easily notice audio data generated from the electronic device and the other electronic device and a method of controlling the electronic device.
  • 2. Discussion of the Background Art
  • The advancement of hardware and software technologies and combination of networks enable various communications between electronic devices while diversifying the use of the electronic devices.
  • Accordingly, a need exists for a more user-friendly user interface (UI) for electronic devices that may perform communication with external electronic devices. Also, various methods are needed to allow a user to efficiently control an electronic device so that he/she can enjoy various contents through multiple electronic devices (for example, 3-screen play or 5-screen play).
  • SUMMARY OF THE INVENTION
  • Embodiments of the present invention provide an electronic device that can more efficiently output audio data generated from multiple electronic devices connected to one another to a user and a method of controlling the electronic device.
  • According to an embodiment, there is provided an electronic device connected to at least one external electronic device, the electronic device including a communication unit configured to perform data communication with the at least one external electronic device, an interface unit configured to connect to a sound output device, and a controller configured, when the sound output device is connected to the electronic device through the interface unit, to receive audio data from the at least one external electronic device and to output the received audio data through the sound output device.
  • The controller is configured to select at least some of the at least one external electronic device when the sound output device is connected to the electronic device.
  • The controller is configured to select at least some of the at least one external electronic device based on at least one of a touch stroke, a voice command, a motion of the electronic device, or a selective input for a list of provided electronic devices.
  • The controller is configured, when the sound output device is connected to the electronic device, to transmit a first message to the at least one external electronic device to indicate the connection.
  • The received audio data includes encoded audio data.
  • The controller is configured to decode the received audio data and then output the decoded audio data through the sound output device.
  • The controller is configured, when the sound output device is disconnected from the electronic device, to transmit a second message to the at least one external electronic device to indicate the disconnection.
  • According to an embodiment, there is provided an electronic device connected to at least one external electronic device, the electronic device including a communication unit configured to perform data communication with the at least one external electronic device, a sound output module, and a controller configured, when sensing connection of a sound output device to one of the at least one external electronic device while outputting particular audio data associated with the electronic device through the sound output module, to transmit the particular audio data to the external electronic device connected to the sound output device through the communication unit.
  • The controller is configured, when sensing connection of the sound output device to one of the at least one external electronic device, to stop outputting the particular audio data through the sound output module.
  • The controller is configured to sense connection of the sound output device to one of the at least one external electronic device based on a first message transmitted from the external electronic device connected to the sound output device.
  • The audio data transmitted to the external electronic device connected to the sound output device is encoded audio data.
  • The controller is configured to display an indicator through a display module to indicate that the particular audio data is transmitted to the external electronic device connected to the sound output device.
  • According to an embodiment, there is provided an electronic device connected to at least one first electronic device, the electronic device including a communication unit configured to perform data communication with the at least one first electronic device and a controller configured to sense a predetermined event occurring at the electronic device, to determine one of the electronic device or the at least one first electronic device based on the predetermined event, and to transmit a first message including information on the determined electronic device to the at least one first electronic device.
  • The predetermined event includes at least one of input of a predetermined touch stroke, input of a predetermined voice command, or a connection of an external sound output device.
  • The first message includes a request that the at least one first electronic device transmit audio data associated with the at least one first electronic device to the determined electronic device.
  • The first message further includes network information for accessing the determined electronic device.
  • The controller is configured, when the determined electronic device is not the electronic device, to stop outputting the audio data associated with the electronic device and to transmit the audio data to the determined electronic device.
  • The embodiments of the present invention provide the following effects.
  • A user who simultaneously uses a plurality of electronic devices (for example, smartphone and TV) may easily obtain the audio data associated with the plurality of electronic devices through a sound output device (e.g., earphone) connected to one electronic device (e.g., smartphone).
  • Without the need for switching on all of the electronic devices to obtain audio data from the electronic devices, a user may receive the audio data from all the electronic devices through an earphone connected to one of the electronic devices, thus preventing other users from being annoyed by the audio data generated from the electronic devices.
  • Rather than connecting an earphone to a television or PC, a user may connect the earphone to a portable electronic device, such as a smartphone, which is physically or wirelessly connected to the TV or PC, to receive audio data generated from the television or PC.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The embodiments of the present invention will become readily apparent by reference to the following detailed description when considered in conjunction with the accompanying drawings wherein:
  • FIG. 1 is a block diagram illustrating an electronic device according to an embodiment of the present invention;
  • FIGS. 2 to 4 illustrate an environment of an electronic device according to an embodiment of the present invention;
  • FIGS. 5 and 6 are views illustrating an embodiment of the present invention;
  • FIG. 7 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention;
  • FIGS. 8 and 9 illustrate an operating state of an electronic device according to an embodiment of the present invention;
  • FIGS. 10 to 12 illustrate the type of a predetermined event according to an embodiment of the present invention;
  • FIGS. 13 to 16 illustrate determining non-selected electronic devices according to an embodiment of the present invention;
  • FIG. 17 illustrates determining a target electronic device according to an embodiment of the present invention;
  • FIG. 18 illustrates a delay occurring upon transmission of audio data according to an embodiment of the present invention;
  • FIG. 19 illustrates a method of recovering sync distortion that may occur according to an embodiment of the present invention; and
  • FIG. 20 illustrates an indicator displayed when audio data is transmitted to other electronic devices according to an embodiment of the present invention.
  • DESCRIPTION OF THE EMBODIMENTS
  • The embodiments of the present invention will be apparent from the detailed description with reference to the accompanying drawings. However, the embodiments of the present invention are not limited thereto, and diverse variations or modifications to the embodiments may be made.
  • In the drawings, the thickness of the layer or region may be exaggerated for clarity. It will be understood that when an element or layer is referred to as being “on” another element or layer, it can be directly on the other element or layer or intervening elements or layers may be present. Like numbers may refer to like or similar elements throughout the specification and the drawings.
  • When determined to render the gist of the present invention unnecessarily unclear, the specific description on known functions or configurations will be omitted. As used herein, the number (for example, first, second, . . . ) is used only to distinguish one component from another.
  • In the following description, suffixes “module” and “unit” are given to components of the mobile terminal in consideration of only facilitation of description and do not have meanings or functions discriminated from each other.
  • As used herein, the electronic device may include a stationary type terminal, such as a digital TV or a desktop computer, as well as a mobile terminal, such as a cellular phone, a smart phone, a laptop computer, a digital broadcast terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), or a navigation system.
  • FIG. 1 is a block diagram illustrating an electronic device according to an embodiment of the present invention.
  • The electronic device 100 includes a wireless communication unit 110, an A/V (AudioNideo) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a control unit 180, and a power supply 190. The components shown in FIG. 1 are not necessary, and according to an embodiment, more or less components may be included in the electronic device 100.
  • Hereinafter, each component is described more specifically.
  • The wireless communication unit 110 may include one or more modules that enable wireless communication between the electronic device 100 and a wireless communication system or between the electronic device 100 and a network in which the electronic device 100 is positioned. For instance, the electronic device 100 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a near field communication module 114, and a location information module 115.
  • The broadcast receiving module 111 receives broadcast signals and/or broadcast-related information from an external broadcast management server through broadcast channels.
  • The broadcast channels include satellite channels or terrestrial channels. The broadcast management server may include a server that generates and transmits broadcast signals and/or broadcast-related information or receives pre-generated broadcast signals and/or broadcast-related information and transmits the signals and information to a terminal. The broadcast signals may include TV broadcast signals, radio broadcast signals, and data broadcast signals, as well as broadcast signals including combinations of TV broadcast signals or radio broadcast signals and data broadcast signals.
  • The broadcast-related information may include information relating to broadcast channels, broadcast programs or broadcast service providers. The broadcast-related information may be provided through a mobile communication network and may be received through the mobile communication module 112.
  • Various types of broadcast-related information may be provided, such as EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or ESG (Electronic Service Guide) of DVBH (Digital Video Broadcast Handheld).
  • The broadcast receiving module 111 receives broadcast signals (e.g., digital broadcast signals) through various broadcast systems, such as, for example, DMBT (Digital Multimedia Broadcasting Terrestrial), DMBS (Digital Multimedia Broadcasting Satellite), MediaFLO (Media Forward Link Only), DVBH (Digital Video Broadcast Handheld), ISDBT (Integrated Services Digital Broadcast Terrestrial), or other digital broadcast systems. The broadcast receiving module 111 may be configured to fit for any other broadcast system providing broadcast signals as well as the above-listed digital broadcast systems.
  • The broadcast signals and/or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.
  • The mobile communication module 112 transmits and receives wireless signals to/from at least one of a base station, an external terminal, and a server over a mobile communication network. The wireless signals may include voice call signals, video call signals, various types of data based on transmission/reception of text/multimedia messages.
  • The wireless Internet module 113 may include modules that can access the Internet wirelessly. The wireless Internet module 113 may be provided inside or outside the electronic device 100. Various types of wireless technologies may be used, such as WLAN (Wireless LAN) (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), or HSDPA (High Speed Downlink Packet Access).
  • The near field communication module 114 may include modules for near-field communication. Various near-field communication technologies may be employed, such as Bluetooth, RFID (Radio Frequency Identification), IrDA (infrared Data Association), UWB (Ultra Wideband), ZigBee, or WiHD, WiGig.
  • The location information module 115 may include a module for identifying a position of the electronic device or for obtaining the information on the position. A representative example of the location information module 115 includes a GPS (Global Position System) module. The GPS module 115 may yield three-dimensional location information based on the longitude, latitude, and altitude of one position (object) at one time by obtaining information on distances between the position (object) and three or more satellites and information on time when the distance information is obtained followed by triangulation. Further, the location information module 115 may obtain information on the position and time using three satellites and correct the obtained information using another satellite. The location information module 115 may produce the current position in real time and calculate the speed information using the current position.
  • Referring to FIG. 1, the A/V input unit 120 may include a camera 121 and a microphone 122 to receive audio or video signals. The camera 121 processes picture frames such as still images or video images obtained by an image sensor in a video call mode or image capturing mode. The processed picture frames may be displayed on the display unit 151.
  • The picture frames processed by the camera 121 may be stored in the memory 160 or externally transmitted through the wireless communication unit 110. Two or more cameras 121 may be provided depending on configuration of the terminal.
  • The microphone 122 receives external sound signals in a call mode, recording mode, or voice recognition mode and processes the received signals into electrical sound data. In the case of the call mode, the sound data may be converted into transmittable form and output to a mobile base station through the mobile communication module 112. The microphone 122 may include various noise cancelling algorithms to eliminate noise that is created while receiving external sound signals.
  • The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (resistive/capacitive), jog wheel, or jog switch.
  • The sensing unit 140 may sense the current state of the electronic device 100, such as the opening/closing state of the electronic device 100, position of the electronic device 100, presence or absence of user's contact, orientation of the electronic device 100, or acceleration/deceleration of the electronic device 100 and generates sensing signals for controlling the operation of the electronic device 100. For instance, in the case that the electronic device 100 is a sliding phone, the sensing unit 140 may sense whether to open or close the sliding phone. Further, the sensing unit 140 may also sense whether the power supply 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a posture sensor 141 and/or proximity sensor 142.
  • The output unit 150 is provided to generate visual, audible, or tactile outputs. The output unit 150 may include a display unit 151, a sound output module 152, an alarm unit 153, and a haptic module 154.
  • The display unit 151 displays information processed by the electronic device 100. For example, in the case that the electronic device 100 is subjected to the call mode, the display unit 151 displays a UI (User Interface) or GUI (Graphic User Interface) relating to call. In the case that the electronic device 100 is in the video call mode or image capturing mode, the display unit 151 displays captured and/or received images or UIs or GUIs.
  • The display unit 151 may include at least one of a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode display, a flexible display, or a 3D display.
  • The display unit 151 may be configured in a transparent or light transmissive type, which may be called a “transparent display” examples of which include transparent LCDs. The display unit 151 may have a light-transmissive rear structure in which a user may view an object positioned behind the terminal body through an area occupied by the display unit 151 in the terminal body.
  • According to an embodiment, two or more display units 151 may be included in the electronic device 100. For instance, the electronic device 100 may include a plurality of display units 151 that are integrally or separately arranged on a surface of the electronic device 100 or on respective different surfaces of the electronic device 100.
  • The display unit 151 may be logically divided into two or more regions.
  • When the display unit 151 and a sensor sensing a touch (hereinafter, referred to as a “touch sensor”) are layered (this layered structure is hereinafter referred to as a “touch sensor”), the display unit 151 may be used as an input device as well as an output device. The touch sensor may include, for example, a touch film, a touch sheet, or a touch pad.
  • The touch sensor may be configured to convert a change in pressure or capacitance, which occurs at a certain area of the display unit 151, into an electrical input signal. The touch sensor may be configured to detect the pressure exerted during a touch as well as the position or area of the touch.
  • Upon touch on the touch sensor, a corresponding signal is transferred to a touch controller. The touch controller processes the signal to generate corresponding data and transmits the data to the control unit 180. By doing so, the control unit 180 may recognize the area of the display unit 151 where the touch occurred.
  • The proximity sensor 142 may be positioned in an inner area of the electronic device 100, which is surrounded by the touch screen, or near the touch screen. The proximity sensor 142 refers to a sensor that detects an object approaching a predetermined detection surface or present near the detection surface without physical contact using electromagnetic fields or infrared beams. The proximity sensor 142 has longer lifespan than a contact-type sensor and has more availability.
  • The proximity sensor 142 may include, but not limited to, a transmissive opto-electrical sensor, a direct reflective opto-electrical sensor, a mirror reflective opto-electrical sensor, a high frequency oscillating proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, or an IR proximity sensor.
  • If the touch screen is of a capacitive type, the proximity sensor 142 may detect the approach of a pointer depending on a variation of an electric field that occurs as the point gets close. The touch screen (touch sensor) may be classified as the proximity sensor.
  • Hereinafter, for ease of description, when a point is positioned near the touch screen while not in contact with the touch screen and it may be recognized that the point is positioned on the touch screen, it is represented as “proximity touch”. When the point actually contacts the touch screen, it is represented as “contact touch”. The position where the proximity touch to the point is done on the touch screen refers to a position where the pointer vertically corresponds to the touch screen when the pointer is subjected to the proximity touch. However, when the proximity touch need not be distinguished from the contact touch, the “touch” or “touch input” may refer to either an input by the proximity touch or an input by the contact touch.
  • The proximity sensor 142 senses a proximity touch and proximity touch pattern (for example, distance, direction, speed, time, position, or travelling state of the proximity touch). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be displayed on the touch screen.
  • The sound output module 152 may output audio data received from the wireless communication unit 110 in a call signal receiving mode, call mode, or recording mode, voice recognition mode, or broadcast receiving mode or stored in the memory 160. The sound output module 152 outputs sound signals relating to functions performed in the electronic device 100 (for example, signaling call signal reception or message reception). The sound output module 152 may include a receiver, a speaker, or a buzzer.
  • The alarm unit 153 outputs signals for signaling an event occurring in the electronic device 100. The event may include reception of call signals or messages, entry of key signals, or touch input. The alarm unit 153 may also output signals for signaling occurrence of an event, for example, by vibration which is of other types than video or audio signals. The video or audio signals may be output through the display unit 151 or the sound output module 152.
  • The haptic module 154 generates various tactile effects that may be sensed by a user. A representative example of a tactile effect generated by the haptic module 154 includes vibration. The strength or pattern of vibration generated by the haptic module 154 may be controlled. For example, different types of vibration may be mixed and output or sequentially output.
  • The haptic module 154 may generate an effect coming from a stimulus made by a pin array moving perpendicular to the contact skin surface, an effect coming from a stimulus by jet or suction force of air through an inlet or suction port, an effect coming from a stimulus created when a skin surface is rubbed, an effect coming from a stimulus made by contact with an electrode, an effect coming from a stimulus by an electrostatic force, or an effect coming from reproduction of warm or cool feeling using a heat absorption or generation element.
  • The haptic module 154 may transfer the tactile effects through a direct contact and may be configured to provide tactile effects through muscle sense of a user's finger or arm. Two or more haptic modules 154 may be provided depending on configuration of the electronic device 100.
  • The memory 160 may store a program for operation of the control unit 180 and may temporarily store input/output data (for example, phone books, messages, still images, or videos). The memory 160 may store data relating to various patterns of vibration and sounds that are output when touch input is made on the touch screen.
  • The memory 160 may include at least one storage medium of flash memory types, hard disk types, multimedia card micro types, card type memories (e.g., SD or XD memories), RAMs (Random Access Memories), SRAM (Static Random Access Memories), ROMs (Read-Only Memories), EEPROMs (Electrically Erasable Programmable Read-Only Memories), PROM (Programmable Read-Only Memories), magnetic memories, magnetic discs, and optical discs. The electronic device 100 may operate in association with a web storage performing a storage function of the memory 160 over the Internet.
  • The interface unit 170 functions as a path between the electronic device 100 and any external device connected to the electronic device 100. The interface unit 170 receives data or power from an external device and transfers the data or power to each component of the electronic device 100 or enables data to be transferred from the electronic device 100 to the external device. For instance, the interface unit 170 may include a wired/wireless headset port, an external recharger port, a wired/wireless data port, a memory card port, a port connecting a device having an identification module, an audio I/O (Input/Output) port, a video I/O port, and an earphone port.
  • The identity module is a chip storing various types of information to authenticate the authority for using the electronic device 100 and may include a user identity module (UIM), a subscriber identity module (SIM), a universal subscriber identity module (USIM), or the like. A device having the identity module (hereinafter, “identity device”) may be implemented as a smart card so that the identity device may be connected to the electronic device 100 through a port.
  • The interface unit may serve as a path through which power is supplied from an external cradle to the electronic device 100 when the cradle is connected to the electronic device 100 or a path through which various command signals are supplied from the cradle to the electronic device 100 by a user. The various command signals and he power from the cradle may function as signals that allow the user to notice that the electronic device 100 is correctly coupled with the cradle.
  • The control unit 180 controls the overall operation of the electronic device 100. For example, the control unit 180 performs control and process relating to voice call, data communication, or video call. The control unit 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the control unit 180 or may be provided separately from the control unit 180.
  • The control unit 180 may perform pattern recognition process that allows handwriting or drawing on the touch screen to be recognized as text or images.
  • The power supply 190 receives external/internal power under the control of the control unit 180 and feeds the power to other components.
  • The embodiments herein may be implemented in software, hardware, or a combination thereof, and may be recorded in a recording medium that may be read b a computer or its similar device.
  • When implemented in hardware, the embodiments may be implemented as at least one of ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays, processors, controllers, microcontrollers, microprocessors, or electrical units for performing the functions.
  • When implemented in software, the processes, functions, or the embodiments may be implemented together with a separate software module that may perform at least one function or operation. The software code may be implemented as a software application that has been written in proper program language. The software code may be stored in the memory 160 and executed by the control unit 180.
  • An environment where an electronic device applies according to an embodiment of the present invention is now described.
  • FIGS. 2 to 4 illustrate an environment where an electronic device applies according to an embodiment of the present invention. For convenience of description, the terms “first electronic device”, “second electronic device”, and/or “third electronic device” may be used, each of which may include the same or substantially the same configuration as the electronic device 100 described in connection with FIG. 1. According to an embodiment, each of the first to third electronic devices may include more or less components than the components of the electronic device 100 illustrated in FIG. 1.
  • Referring to FIG. 2, electronic devices 100A, 100B, and 100C may be directly connected to each other. For example, the first electronic device 100A may be directly connected to the second or third electronic devices 100B and 100C, and the second electronic device 100B may be directly connected to the third electronic device 100C.
  • The connections between the electronic devices 100A, 100B, and 100C may be made physically or wirelessly. For example, a wired LAN or USB cable may be used for connection between the electronic devices 100A, 100B, and 100C. Also, wireless interfaces, such as WiFi, WiGig, WiHD, or ZigBee, may be used for such connection. As shown in FIG. 2, when the electronic devices 100A, 100B, and 100C are directly connected to each other, at least one of the devices 100A, 100B, and 100C may function as a network manager that manages a network established by the devices 100A, 100B, and 100C.
  • Referring to FIG. 3, the electronic devices 100A, 100B, and 100C may be connected to each other via a server 200. For example, the first electronic device 100A is indirectly connected to the electronic devices 100A and 100B through the server 200, and the second electronic device 100B is indirectly connected to the third electronic device 100C through the server 200.
  • Connection between the server and the electronic devices 100A, 100B, and 100C may be made physically or wirelessly as shown in FIG. 2. As shown in FIG. 3, when the electronic devices 100A, 100B, and 100C are connected to each other via the server 200, the server 200 may function as a network manager that manages a network established by the electronic devices 100A, 100B, and 100C.
  • Referring to FIG. 4, the electronic devices 100A, 100B, and 100C may be connected to a remote server 300 via a wired/wireless communication network that is established for remote communication, so that the first electronic device 100A may be indirectly connected to the second and third electronic devices 100B and 100C, and the second electronic device 100B may be indirectly connected to the third electronic device 100C. The electronic devices 100A, 100B, and 100C and the server 300 may be connected to each other through the Internet, a mobile network, or other known communication networks.
  • Although three electronic devices 100A, 100B, and 100C are connected to each other as shown in FIGS. 2 to 4, the embodiments of the present invention are not limited thereto. According to an embodiment, two, or four or more electronic devices may be connected to each other.
  • According to an embodiment, when a predetermined event occurs while audio data is played through the sound output module 152 of each of the electronic device 100A, 100B, or 100C connected to each other, one of the electronic devices 100A, 100B, and 100C is selected (hereinafter, the selected one is also referred to as “selected device” or “selected electronic device”) and the other electronic devices (which are also referred to as “non-selected devices” or “non-selected electronic devices”) than the selected device transmit audio data generated from the non-selected devices to the selected device, so that the selected device plays both the audio data generated by the selected device and the audio data transmitted from the non-selected devices.
  • When the predetermined event occurs, the output of the audio data from the sound output modules 152 of the non-selected devices and/or external sound output devices connected to the non-selected devices are stopped and the non-selected devices transfer the audio data generated from the non-selected devices to the selected device.
  • FIGS. 5 and 6 illustrate an embodiment of the present invention. Referring to FIG. 5, the first electronic device 100A outputs a sound SA corresponding to audio data generated from the first electronic device 100A, the second electronic device 100B outputs a sound SB corresponding to audio data generated from the second electronic device 100B, and the third electronic device 100C outputs a sound SC corresponding to audio data generated from the third electronic device 100C.
  • When a predetermined event takes place while the devices 100A, 100B, and 100C output the respective audio data generated from the devices 100A, 100B, and 100C and the first electronic device 100A is accordingly selected, the second and third electronic devices 100B and 100C transmit second and third audio data AD2 and AD3 respectively generated from the second and third electronic devices 100B and 100C to the first electronic device 100A outputs both the audio data AD1 generated from the first electronic device 100A and the audio data AD2 and AD3 transmitted from the devices 100B and 100C.
  • The predetermined event may be one of various events. For example, the predetermined event may include connection between an external sound output device and one of the electronic devices 100A, 100B, and 100C or a user's request through key entry or touching.
  • FIG. 6 illustrates an example where the predetermined event is connection to an external sound output device. For example, when the sound output device 400 is connected to the first electronic device 100A, the second and third audio data AD2 and AD3 generated from the second and third devices 100B and 100C is transmitted from the devices 100B and 100C to the first electronic device 100A, and the first electronic device 100A outputs the second and third sounds SB and SC respectively corresponding to the second and third audio data AD2 and AD3 as well as the first sound SA corresponding to the first audio data AD 1 generated from the first electronic device 100A.
  • The external sound output device may be any type of device, such as an earphone, speaker, or Bluetooth headset, which may audibly transfer sounds to a user.
  • Various methods of determining the selected device may be employed when the predetermined event occurs. The selected device may be determined in consideration of the predetermined event. For example, the selected device may be determined as one of the electronic devices 100A, 100B, and 100C, which causes the predetermined event. For example, an electronic device connected to the external sound output device may be determined as the selected device. Alternatively, when the predetermined event is a user's request, the selected device may be determined in response to the user's request.
  • As used herein, the “audio data generated from electronic device(s)” collectively refers to overall audio data to be output through the sound output module(s) 152 of the electronic device(s) and/or sound output device(s) connected to the electronic device(s) by a system of the electronic device(s) and/or an application executed in the electronic device(s). For example, the audio data includes audio data (system alarm/alert sound, etc.) generated by the operation of the system of the electronic device or audio data (sound of content played by an application, such as media player, or message receipt sound output by a message application) generated by the operation of an application in execution by the electronic device. The “audio data generated from electronic device(s)” may be also referred to as “audio data associated with electronic device(s)”.
  • As used herein, the phrase “output audio data” refers to externally outputting a sound corresponding to sound data stored in an analog or digital format through the sound output module 152 of the electronic device and/or a sound output device connected to the electronic device so that the sound can be audibly recognized.
  • FIG. 7 is a flowchart illustrating a method of controlling an electronic device according to an embodiment of the present invention. FIGS. 8 and 9 illustrate specific examples of the operation of an electronic device according to an embodiment of the present invention.
  • Referring to FIG. 7, the first electronic device 100A is connected to the second electronic device 100B and/or the third electronic device 100C (S 100). As described in connection with FIGS. 2 to 4, various methods of connecting the first electronic device 100A to the devices 100B and/or 100C may be adopted.
  • Subsequently, the first electronic device 100A may output first audio data AD 1 associated with the first electronic device 100A (S110). The second electronic device 100B and/or the third electronic device 100C may respectively output second audio data AD2 associated with the second electronic device 100B and/or third audio data AD3 associated with the third electronic device 100C (S 120). For example, as shown in FIG. 8, which illustrates an example where the first electronic device 100A, a smartphone, is connected to the second electronic device 100B, a TV, via a wireless link, when a user views a movie on the TV 100B, the TV 100B may output a sound SB corresponding to the movie through the sound output module 152 included in the TV 100B.
  • Subsequently, the first electronic device 100A may sense a connection between the first electronic device 100A and an external sound output device 400 (S130). The first electronic device 100A may sense such connection by various methods.
  • When an earphone and/or speaker are connected through an output port of an electronic device to the electronic device, the electronic device may detect the connection to the earphone and/or speaker via the output port. For example, the moment the earphone and/or speaker is connected to the output port, an interrupt occurs which causes audio data generated from the electronic device to be output through the earphone and/or speaker connected to the output port. The first electronic device 100A may sense connection of the external sound output device 400 based on occurrence of an interrupt (S130).
  • For example, a Bluetooth technology may be used for wireless connection with the external sound output device. In the Bluetooth technology, the operation of an electronic device attempting to connect with a sound output device is called “pairing” through which the electronic device may identify the type of another electronic device connected to the electronic device. For example, an electronic device may obtain information on whether the other electronic device connected to the electronic device based on a Bluetooth technology is a desktop computer, a mobile terminal, such as a smartphone, or a sound output device, such as a Bluetooth headset. Accordingly, the first electronic device 100A may sense connection of the external sound output device 400 based on the pairing operation (S 130).
  • When sensing the connection with the external sound output device 400, the first electronic device 100A may transmit a first message to the non-selected devices 100B and 100C connected to the first electronic device 100A (S140).
  • According to an embodiment, the first message may simply notify the non-selected devices 100B and 100C that the external sound output device 400 is connected to the first electronic device 100A. Alternatively, the first message may include a control signal requesting that the non-selected devices 100B and 100C send to the first electronic device 100A audio data generated after receiving the first message.
  • In response, after receiving the first message, the second electronic device 100B may stop outputting the second audio data AD2 generated from the second electronic device 100B through the sound output module 152 of the second electronic device 100B (S150) and may transmit the second audio data AD2 associated with the second electronic device 100B to the first electronic device 100A (S160).
  • For example, referring to FIG. 9 which illustrates an example where the external sound output device 400 is connected to the first electronic device 100A in the circumstance shown in FIG. 8, a sound SB corresponding to the audio data AD2 of a movie output from the second electronic device 100B, e.g., a TV, is not output through the sound output module 152 of the device 100B any longer, but may be transmitted to the first electronic device 100A, e.g., a smartphone.
  • The second audio data AD2 transmitted from the second electronic device 100B to the third electronic device 100C is not limited to the audio data that is being output from the second electronic device 100B at the time of receiving the first message and may rather include all of other types of audio data that may be later generated from the second electronic device 100B. For example, audio data such as a user warning sound and/or alarming sound generated by the operation of an application and/or system of the second electronic device 100B may be also transmitted to the first electronic device 100A.
  • When receiving the first message, the third electronic device 100C may transmit the third audio data AD3 associated with the third electronic device 100C to the first electronic device 100A as described above in relation to the operation of the second electronic device 100B.
  • The audio data transmitted from the second and/or third electronic device 100B and/or 100C may be encoded audio data. Since the encoded audio data remains further compressed by a data compressing technology compared to when the data is decoded, data size deceases, thus resulting in more efficient data transmission. Unlike the general sound output devices, the second and/or third electronic device 100B or 100C can generally decode the encoded audio data on its own. Accordingly, transmission of such encoded audio data does not cause any technical problems. However, the transmitted audio data is not inevitably limited to the encoded audio data.
  • When receiving the second audio data AD2 from the second electronic device 100B and/or the third audio data AD3 from the third electronic device 100C, the first electronic device 100A may output a sound corresponding to the second or third audio data AD2 or AD3 through the sound output device connected to the first electronic device 100A so that a user may audibly notice the sound (S 170). For example, turning back to FIG. 9, the sound SB corresponding to the second audio data AD2 finally transmitted from the second electronic device 100B may be output through the sound output device 400 (for example, an earphone) connected to the first electronic device 100A so that the user U may audibly notice the sound SB.
  • When the second and/or third audio data AD2 or AD3 is compressed (or encoded) digital audio data, the first electronic device 100A may decompress (or decode) the second and/or third audio data AD2 or AD3 so that the audio data AD2 or AD3 may be normally output through the external sound output device 400.
  • Rather than outputting only the sounds corresponding to the second and/or third audio data AD2 or AD3, the first electronic device 100A may also output a sound corresponding to the first audio data AD1 associated with the first electronic device 100A.
  • When the first electronic device 100A is disconnected from the external sound output device 400 while the audio data AD1, AD2, and AD3 associated with the first to third electronic devices 100A, 100B, and 100C is output through the external sound output device 400 connected to the first electronic device 100A, e.g., under the control of the first electronic device 100A (S180), the first electronic device 100A may transmit a second message to the second and/or third electronic device 100B or 100C (S190).
  • The second message may simply notify the other electronic devices 100B and 100C that the external sound output device 400 is disconnected from the first electronic device 100A. The second message may include a control signal requesting that the other electronic devices 100B and 100C output audio data generated after receiving the second message through the sound output module of the second or third electronic device 100B or 100C.
  • Accordingly, the first to third electronic devices 100A, 100B, and 100C return to step S110 and/or S120 so that the first to third electronic devices 100A, 100B, and 100C respectively output the first audio data AD1 associated with the first electronic device 100A, the second audio data AD2 associated with the second electronic device, and the third audio data AD3 associated with the third electronic device.
  • A user who simultaneously uses a plurality of electronic devices (for example, the smartphone and TV shown in FIGS. 8 and 9) may easily obtain the audio data associated with the plurality of electronic devices through a sound output device (e.g., earphone) connected to one electronic device (e.g., the smartphone shown in FIGS. 8 and 9).
  • Without the need for switching on all of the electronic devices to obtain audio data from the electronic devices, a user may receive the audio data from all the electronic devices through an earphone connected to one of the electronic devices, thus preventing other users from being annoyed by the audio data generated from the electronic devices.
  • Rather than connecting an earphone to a television or PC, a user may connect the earphone to a portable electronic device, such as a smartphone, which is physically or wirelessly connected to the TV or PC, to receive audio data generated from the television or PC.
  • Other many effects may be achieved according to the embodiments of the present invention.
  • The embodiments are not limited to those described above and may be rather modified in various forms. Hereinafter, various modifications to the above-described embodiments are described.
  • <Predetermined Event>
  • First, various types of “predetermined events’ are described. Although it has been illustrated in FIGS. 7 to 9 that the predetermined event is connection between one electronic device and an external sound output device. However, the predetermined event is not limited thereto.
  • Referring to FIGS. 10 to 12 which illustrate the type of a predetermined event according to an embodiment of the present invention, the predetermined event is described below.
  • For example, among the electronic devices 100A, 100B, and 100C, one electronic device may recognize or sense a user's active input and/or its passive state through various user interfaces including a menu interface, a touch interface, a voice interface, or a motion interface, and may determine that a predetermined event occurs when a sensed result is identical to a predetermined input value or state value.
  • For example, when a user uses a menu tree structure provided by an electronic device to select “pulling function for audio data of other electronic devices”, a corresponding electronic device may determine that a predetermined event occurs.
  • As another example, as shown in FIG. 10, an electronic device may predefine a voice command (e.g. pulling audio) designated for “pulling function for audio data of other electronic devices,” and when the designated voice command is input, may determine that a predetermined event occurs.
  • As still another example, an electronic device may predefine a particular touch stroke TS corresponding to “pulling function for audio data of other electronic devices” as shown in FIG. 11, and when the predetermined touch stroke TS is input, may determine that a predetermined event occurs. Subsequently, for example, as shown in FIG. 12, an electronic device may predetermine a motion (e.g., shaking as shown in FIG. 12) corresponding to “pulling function for audio data of other electronic devices,” and when a user makes the predetermined motion with the electronic device, may determine that a predetermined event occurs. According to an embodiment, a predetermined event may be designated by various methods.
  • According to an embodiment, the predetermined event may also be designated by one or more combinations of the above-described or any other methods of designating a predetermined event. For example, when a user inputs a voice command, “pulling audio”, to an electronic device and then shakes the electronic device, the electronic device may determine that a predetermined event occurs. As another example, when a user connects an external sound output device 400 to an electronic device and then selects “yes” in response to an inquiry asking “Do you want to perform a pulling function for audio data of other electronic devices?” on a confirmation window of the electronic device, the electronic device may determine that a predetermined event occurs.
  • <Selection of Source Device>
  • Although it has been illustrated in FIGS. 7 to 9 that electronic devices of transmitting audio data (for example, the non-selected electronic devices) are determined as all of the other electronic devices than an electronic device connected to the sound output device, the other electronic devices may be selectively determined by various methods.
  • Referring to FIGS. 13 to 16 which illustrate determining the other electronic devices according to embodiments of the present invention, various methods of determining the other electronic devices are described below.
  • When sensing occurrence of a predetermined event, one electronic device (e.g., the first electronic device 100A) where the predetermined event occurs may display a window W1 allowing a user to select non-selected electronic devices among other electronic devices connected to the first electronic device 100A. Accordingly, the user may select at least one of the second and third electronic devices 100B and 100C, and based on the user's selection, the first electronic device 100A may determine at least one of the second and third electronic devices 100B and 100C as the non-selected electronic device(s).
  • As another example, when sensing the predetermined event, the selected electronic device (e.g., the first electronic device 100A) where the predetermined event occurs may determine the non-selected electronic devices of other electronic devices connected to the selected electronic device by recognizing a user's voice command as shown in FIG. 14.
  • For example, as shown in image (a) of FIG. 14, when a user inputs a voice command saying “all”, the first electronic device 100A may determine all of the second and third electronic devices 100B and 100C connected to the first electronic device 100A as the non-selected electronic devices, and as shown in image (b) of FIG. 14, when the user inputs a voice command saying “television”, the first electronic device 100A may determine a TV (e.g., the second electronic device) as the non-selected electronic device. As shown in image (c) of FIG. 14, when the user inputs a voice command saying “PC”, the first electronic device 100A may determine a PC (e.g., the third electronic device) as the non-selected electronic device.
  • When the non-selected electronic device(s) are determined by a voice command, a voice command designated as the predetermined event described in connection with FIG. 10 may be combined with a voice command for determining the non-selected electronic device. For example, when a user inputs a voice command saying “pull television audio”, among a plurality of electronic devices, the first electronic device 100A may determine a television as a non-selected electronic device so that only audio data generated from the television may be pulled.
  • As another example, when sensing occurrence of the predetermined event, the selected electronic device (e.g., the first electronic device 100A) where the predetermined event occurs may determine the non-selected electronic device(s) of other electronic devices connected to the selected electronic device by recognizing a user's touch stroke as shown in FIGS. 15 and 16.
  • According to an embodiment, the plurality of electronic devices connected to the first electronic device 100A may respectively correspond to touch strokes with different attributes. For example, when receiving a first touch stroke TS1 as shown in image (a) of FIG. 15, the first electronic device 100A may determine the second electronic device 100B corresponding to the first touch stroke TS1 as the non-selected electronic device, and when receiving a second touch stroke TS2 as shown in image (b) of FIG. 15, the first electronic device 100A may determine the third electronic device 100C corresponding to the second touch stroke TS2 as the non-selected electronic device. When receiving a third touch stroke TS3 as shown in image (c) of FIG. 15, the first electronic device 100A may determine all of the electronic devices connected to the first electronic device 100A as the non-selected electronic devices.
  • The attributes of the touch strokes may include at least one of speed, trajectory, direction, or length. Although it has been illustrated in FIG. 15 that the touch strokes respectively corresponding to the second and third electronic devices 100B and 100C have different trajectories, the touch strokes may be distinguished from each other by different directions while having the same trajectory as shown in FIG. 16.
  • For example, as shown in FIG. 16, third to sixth touch strokes have straight trajectories with different directions. The first electronic device 100A may make different electronic devices correspond to the third to sixth touch strokes TS3, TS4, TS5, and TS6, respectively.
  • When the non-selected electronic device(s) are determined based on the trajectory shape of a user's touch stroke as shown in FIG. 15, the predetermined strokes may correspond to the trajectories of initials of English names of the plurality of electronic devices, thereby resulting in provision of an easier or more user-friendly user interface. For example, when desiring to select a television as the non-selected electronic device, the user may select the non-selected electronic device by inputting a touch stroke corresponding to the English initial, T, of television, and when desiring to select a PC as the non-selected electronic device, the user my select the non-selected electronic device by inputting a touch stroke corresponding to the English initial, P, of PC. As a consequence, the user may be provided an intuitive, user-friendly user interface with no inconvenience.
  • As another example, when sensing occurrence of a predetermined event, a selected electronic device (e.g., the first electronic device 100A) where the predetermined event occurs may determine the non-selected electronic device(s) among the plurality of electronic devices by analyzing the pattern of a motion made by the user while grabbing the first electronic device 100A. According to an embodiment, similar to what has been described in FIGS. 15 and 16, the electronic device 100 may determine the non-selected electronic device(s) based on a user's motion by making the electronic devices correspond to motions having at least one attribute different from the other attributes.
  • When the non-selected electronic device(s) are selectively determined as described above, rather than being transmitted to the whole electronic devices 100B and 100C connected to the first electronic device 100A, the first message may be transmitted to only the non-selected electronic device(s) determined by the methods described above. Accordingly, the steps (e.g., steps S150 and S160) described in connection with FIG. 7 are performed by only the electronic devices which receive the first message. Even when the first electronic device 100A is disconnected from the sound output device, the transmission may be conducted by only the determined non-selected electronic devices.
  • <Selection of Sync Device>
  • Although it has been illustrated in FIGS. 7 to 9 that an electronic device (e.g., a target electronic device) of receiving and outputting audio data is determined as an electronic device connected to the sound output device, the target electronic device may be determined by various methods.
  • Referring to FIG. 17 which illustrates determining a target electronic device, various methods of determining a target electronic device are described.
  • Referring to FIGS. 7 to 9, for purposes of illustration, the predetermined event is connection of a sound output device to an electronic device, in which situation, a user's intention may be shown that pulls audio data to the electronic device connected to the sound output device (for example, an earphone or Bluetooth headset). However, as is often case, a user's intention may not be clearly shown depending on the type of predetermined event. For example, according to an embodiment, the electronic device pulling audio data may be an electronic device sensing the predetermined event, but not limited thereto.
  • According to an embodiment, the electronic device sensing the predetermined event (e.g., the first electronic device 100A) may provide a user with an interface to allow the user to determine an electronic device to which audio data is to be transmitted. For example, as shown in FIG. 17, the first electronic device 100A may display a window W2 through which the user may select electronic device(s) of a plurality of electronic devices through which to send audio data, and the user may select one electronic device through the window provided by the first electronic device 100A.
  • According to an embodiment, the first electronic device 100A may determine an electronic device to which audio data is to be pulled based on a result of recognizing a user's particular motion, touch stroke, or voice command by a method similar to the method of determining the non-selected electronic device(s) as shown in FIGS. 14 to 16.
  • According to an embodiment, the first message may include information on an electronic device to which audio data is to be pulled as determined by the above-described methods. For example, the first message may include identification information on the electronic device, network address of the electronic device, or any other information necessary for the non-selected electronic devices to transmit audio data to the electronic device. When the electronic device sensing the predetermined event does not conform to the electronic device to which audio data is to be pulled as determined by the methods described above, the non-selected electronic devices may receive the first message and then transmit the audio data to the electronic device indicated by the first message while performing step S160 shown in FIG. 7.
  • For example, when the first electronic device 100A receives a voice command as a predetermined event and determines the second electronic device 100B as an electronic device to which the audio data is pulled, the first electronic device 100A transmits the first message to the second and/or third electronic device 100B or 100C so that the third electronic device 100C transmits the third audio data AD3 associated with the third electronic device 100C to the second electronic device 100B, but not to the first electronic device 100A.
  • After transmitting the first message, the first electronic device 100A may perform steps S150 and S160 described in connection with FIG. 7. For example, after transmission of the first message, the first electronic device 100A stops outputting the first audio data AD 1 associated with the first electronic device 100A through the sound output module 152 of the first electronic device 100A and transmits the first audio data AD1 to the above-determined 100B.
  • Accordingly, the second electronic device 100B outputs the first and third audio data AD1 and AD3 as received. When the external sound output device 400 is connected to the second electronic device 100B, the first and third audio data may be output through the external sound output device 400. When no sound output device is connected to the second electronic device 100B, the first and third audio data may be output through the sound output module 152 of the second electronic device 100B.
  • <Solve Sync Problem Between Video and Audio Output Through Earphone of Second Electronic Device>
  • The audio data associated with non-selected electronic devices (e.g., second and third electronic devices 100B and 100C) is transmitted to a selected electronic device (e.g., the first electronic device 100A), and the audio data processed by the selected electronic device (e.g., the first electronic device 100A) may be output through the external sound output device 400 connected to the selected electronic device or the sound output module 152 of the selected electronic device.
  • According to an embodiment, the audio data associated with the second electronic device 100B may be associated with video data that is displayed in synchronization with the audio data. For example, in the case of a movie, audio and video data should be output while associated and synchronized with each other. When a system generates an alarming sound and/or warning sound and gives an audible feedback and/or notice (hereinafter, collectively “audible feedback”) to a user or the system gives the user a visual feedback and/or notice (hereinafter, collectively “visual feedback”) together with the alarming sound and/or warning sound, the audible feedback and the visual feedback may be output while synchronized with each other.
  • When audio data needed to be output while synchronized with video data is transmitted from the second electronic device 100B to the first electronic device 100A and output through the external sound output device 400 connected to the first electronic device 100A, a time of displaying the video data output through the second electronic device 100B (hereinafter, “video output time”) may differ from a time of outputting the audio data associated with the video data through the first electronic device 100A (hereinafter, “audio output time”) since there may be a delay for transmission of the audio data to the first electronic device 100A.
  • As a result, the video data output through the second electronic device 100B may be unsynchronized with the audio data output through the first electronic device 100A. FIG. 18 illustrates a delay created upon transmission of audio data according to an embodiment of the present invention. Image (a) of FIG. 18 illustrates audio and video data associated with each other.
  • For purposes of illustration, when audio and video data needed to be output while synchronized with each other as shown in image (a) of FIG. 18 is generated from the second electronic device 100B (e.g., audio and video data associated with the second electronic device 100B), the video data is output through the second electronic device 100B, and the audio data is transmitted to the first electronic device 100A and then output through the external sound output device 400 and/or the sound output module 152 of the first electronic device 100A.
  • Synchronization between the audio and video data may be distorted by a time (D, hereinafter, delay time by transmission) taken for the audio data to be transmitted to the first electronic device 100A. For example, as shown in image (b) of FIG. 18, audio data may be output the delay time D by transmission after a time when the video data starts to be output.
  • To establish sync between the video data displayed by the second electronic device 100B and the audio data output through the first electronic device 100A, the second electronic device 100B may delay a time of displaying the video data by the delay time D by transmission.
  • A method of obtaining the delay time D by transmission by the second electronic device 100B is briefly described. The second electronic device 100B may obtain a state of a network connected to the first electronic device 100A and a data transmission rate of the network to calculate a time taken for the audio data to be transmitted to the first electronic device 100A.
  • The second electronic device 100B may keep sensing the state of the network and data transmission rate of the network. According to an embodiment, when receiving the first message, the second electronic device 100B may transmit a particular message to the first electronic device 100A to identify the state of connection with the first electronic device 100A and may receive a response message for the particular message transmitted from the first electronic device 100A. The second electronic device 100B may calculate the connection state and/or data transmission rate in consideration with a time of transmitting the particular message and a time of receiving the response message.
  • To readjust sync between the video data displayed through the second electronic device 100B and the audio data output through the first electronic device 100A, the second electronic device 100B may receive a predetermined input from the second electronic device 100B and gradually delay the time of displaying the video data based on the predetermined input.
  • For example, when a user makes a particular input, the first electronic device 100A may output the video data with the video data delayed by a predetermined time interval according to the particular input. When the user makes the particular input twice, the second electronic device 100B may output the video data with the video data delayed by double the predetermined time interval.
  • FIG. 19 illustrates a method of recovering a sync distortion according to an embodiment of the present invention. Image (a) of FIG. 19 illustrates that a sync distortion occurs between video and audio data according to an embodiment. When a user makes a particular input once, the second electronic device 100B may output the video data with the video data delayed by a predetermined time interval G (image (b) of FIG. 19), and when the user makes the particular input again under the above situation (e.g., when the user makes the particular input twice), the second electronic device 100B delays further by the time interval G in the state shown in image (b) of FIG. 19, outputting the video data (image (c) of FIG. 19).
  • Based on the above-described method, the distorted sync between the video and audio data may be recovered. Although it is illustrated in FIG. 19 that the particular input is done two times to recover the distorted sync, according to an embodiment, the distorted sync may be recovered by making the particular once or three times or more.
  • <Solve Problem Occurring when Another User Controls TV; e.g., Display of Indicator>
  • When audio data associated with the second and/or third electronic device 100B and/or 100C is output through the external sound output device 400 connected to the first electronic device 100A, e.g., under the control of the first electronic device 100A, or the sound output module 152 of the first electronic device 100A, the second electronic device 100B and/or the third electronic device 100C may display an indicator which includes a symbol or a combination of symbols to indicate that the audio data associated with the second electronic device 100B and/or the third electronic device 100C is being transmitted to the first electronic device 100A.
  • FIG. 20 illustrates an indicator which is displayed when audio data is transmitted to another electronic device according to an embodiment of the present invention. As shown in FIG. 20, the second electronic device 100B and/or the third electronic device 100C may display the indicator S through the display module 151 of the second electronic device 100B or the third electronic device 100C. Referring to FIG. 20, other users may easily notice that the audio data associated with the second electronic device 100B and/or the third electronic device 100C is being transmitted to “JW's Phone”.
  • As such, the indicator S allows other users to be able to easily notice transmission of audio data to other electronic devices.
  • According to an embodiment, the indicator S may remain displayed when the second and/or third electronic device 100B or 100C transmits audio data to the first electronic device 100A. Alternatively, the indicator S may be displayed only when a user's control request (e.g., the user's input for adjusting sound volume of the second and/or third electronic device) occurs on the second and/or third electronic device 100B or 100C. For example, when the user performs user's input for adjustment of sound volume through various user interfaces of the second and/or third electronic device 100B or 100C, the second and/or the third electronic device 100B or 100C may display the indicator S only for a predetermined time so that other users may notice transmission of the audio data of the second and/or third electronic device 100B or 100C.
  • FIG. 20 illustrates that information is also displayed to indicate transmission of the audio data of the second and/or third electronic device 100B or 100C as well as to allow an electronic device receiving the audio data to be identified. According to an embodiment, the information for identifying an electronic device receiving the audio data may be excluded from the information that may be provided by the indicator. Alternatively, more information may be included in the information that may be provided by the indicator.
  • In the method of controlling an electronic device according to the present invention, each step in each embodiment is not inevitable, and each embodiment may selectively include the steps therein. The steps in each embodiment are not necessarily performed in the order described above, and for example, a later step may be performed earlier than an earlier step.
  • The control method may be stored in a computer readable recording medium in the form of a code or program.
  • The invention has been explained above with reference to exemplary embodiments. It will be evident to those skilled in the art that various modifications may be made thereto without departing from the broader spirit and scope of the invention. Further, although the invention has been described in the context its implementation in particular environments and for particular applications, those skilled in the art will recognize that the present invention's usefulness is not limited thereto and that the invention can be beneficially utilized in any number of environments and implementations. The foregoing description and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.

Claims (19)

What is claimed is:
1. An electronic device connected to at least one external electronic device, the electronic device comprising:
a communication unit configured to perform data communication with the at least one external electronic device;
an interface unit configured to connect to a sound output device; and
a controller operatively connected to the communication unit and the interface unit, wherein the controller is configured to
sense a connection of a sound output device to the electronic device,
upon sensing the connection of the sound output device to the electronic device, receive audio data from the at least one external electronic device, and
output the received audio data through the sound output device.
2. The electronic device of claim 1, wherein, upon sensing the connection of the sound output device to the electronic device, the controller is configured to select at least some of the at least one external electronic device to be a source of the audio data.
3. The electronic device of claim 2, wherein the controller is configured to select the at least some of the at least one external electronic device based on at least one of a touch stroke, a voice command, a motion of the electronic device, or a selective input to a list of the at least one external electronic device.
4. The electronic device of claim 1, wherein, upon sensing the connection of the sound output device to the electronic device, the controller is configured to transmit a first message to the at least one external electronic device to indicate the connection of the sound output device to the electronic device.
5. The electronic device of claim 1, wherein the received audio data includes encoded audio data.
6. The electronic device of claim 5, wherein the controller is configured to decode the received encoded audio data and then output the decoded audio data through the sound output device.
7. The electronic device of claim 1, wherein, when the sound output device is disconnected from the electronic device, the controller is configured to transmit a second message to the at least one external electronic device to indicate that the sound output device is disconnected.
8. An electronic device connected to at least one external electronic device, the electronic device comprising:
a communication unit configured to perform data communication with the at least one external electronic device;
a sound output module; and
a controller operatively connected to the communication unit and the sound output module,
wherein the controller is configured to
receive an indication of a connection of a sound output device to the at least one external electronic device while outputting particular audio data associated with the electronic device through the sound output module, and
upon receiving the indication, transmit the particular audio data to the at least one external electronic device connected to the sound output device through the communication unit.
9. The electronic device of claim 8, wherein, upon receiving the indication, the controller is configured to stop outputting the particular audio data through the sound output module.
10. The electronic device of claim 8, wherein the controller is configured to receive the indication based on a first message transmitted from the at least one external electronic device connected to the sound output device.
11. The electronic device of claim 8, wherein the audio data transmitted to the at least one external electronic device connected to the sound output device is encoded audio data.
12. The electronic device of claim 8, further comprising:
a display module,
wherein the controller is configured to display an indicator through the display module to indicate that the particular audio data is transmitted to the at least one external electronic device connected to the sound output device.
13. An electronic device connected to at least one first electronic device, the electronic device comprising:
a communication unit configured to perform data communication with the at least one first electronic device; and
a controller operatively connected to the communication unit and configured to
sense a predetermined event occurring at the electronic device,
select one of the electronic device or the at least one first electronic device based on the predetermined event, and
transmit a first message to the at least one first electronic device, the first message including information on the selected electronic device.
14. The electronic device of claim 13, wherein the predetermined event includes at least one of an input of a predetermined touch stroke, an input of a predetermined voice command, or a connection of an external sound output device.
15. The electronic device of claim 13, wherein the first message includes a request that the at least one first electronic device transmit audio data associated with the at least one first electronic device to the selected electronic device.
16. The electronic device of claim 15, wherein the first message further includes network information for accessing the selected electronic device.
17. The electronic device of claim 13, wherein, when the selected electronic device is not the electronic device, the controller is configured to stop outputting audio data associated with the electronic device and to transmit the audio data to the selected electronic device.
18. A method of controlling an electronic device connected to at least one external electronic device, the method comprising:
sensing by the electronic device a connection of a sound output device to the electronic device;
upon sensing the connection of the sound output device to the electronic device, receiving by the electronic device audio data from the at least one external electronic device; and
outputting the received audio data by the electronic device through the sound output device.
19. A method of controlling an electronic device connected to at least one external electronic device, the method comprising:
receiving by the electronic device an indication of a connection of a sound output device to the at least one external electronic device while outputting particular audio data associated with the electronic device through a sound output module of the electronic device; and
upon receiving the indication, transmitting by the electronic device the particular audio data to the at least one external electronic device connected to the sound output device.
US13/462,573 2012-03-05 2012-05-02 Electronic device and method of controlling the same Abandoned US20130232282A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/462,573 US20130232282A1 (en) 2012-03-05 2012-05-02 Electronic device and method of controlling the same

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261606475P 2012-03-05 2012-03-05
US13/462,573 US20130232282A1 (en) 2012-03-05 2012-05-02 Electronic device and method of controlling the same

Publications (1)

Publication Number Publication Date
US20130232282A1 true US20130232282A1 (en) 2013-09-05

Family

ID=49043282

Family Applications (4)

Application Number Title Priority Date Filing Date
US13/462,530 Active 2033-02-06 US8843226B2 (en) 2012-03-05 2012-05-02 Electronic device and method of controlling the same
US13/462,573 Abandoned US20130232282A1 (en) 2012-03-05 2012-05-02 Electronic device and method of controlling the same
US13/857,901 Active US8706279B2 (en) 2012-03-05 2013-04-05 Electronic device and method of controlling the same
US14/203,048 Active US9239701B2 (en) 2012-03-05 2014-03-10 Electronic device and method of controlling the same

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/462,530 Active 2033-02-06 US8843226B2 (en) 2012-03-05 2012-05-02 Electronic device and method of controlling the same

Family Applications After (2)

Application Number Title Priority Date Filing Date
US13/857,901 Active US8706279B2 (en) 2012-03-05 2013-04-05 Electronic device and method of controlling the same
US14/203,048 Active US9239701B2 (en) 2012-03-05 2014-03-10 Electronic device and method of controlling the same

Country Status (2)

Country Link
US (4) US8843226B2 (en)
WO (1) WO2013133480A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160278091A1 (en) * 2015-03-17 2016-09-22 Noodoe Corporation Sound generation and transmission systems and methods using a radio transmitter
US9524252B2 (en) * 2015-04-24 2016-12-20 Primax Electronics Ltd. Input system and method
US9692860B2 (en) * 2014-05-15 2017-06-27 Apple Inc. One layer metal trace strain gauge
US20220030505A1 (en) * 2019-01-17 2022-01-27 Lg Electronics Inc. Method and device for providing audio service using bluetooth technology

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2961924A1 (en) * 2010-06-29 2011-12-30 France Telecom MANAGING THE PLACE OF DATA STORAGE IN A DISTRIBUTED STORAGE SYSTEM
US8843226B2 (en) * 2012-03-05 2014-09-23 Lg Electronics Inc. Electronic device and method of controlling the same
US20130308063A1 (en) * 2012-05-17 2013-11-21 Synchear, Llc Method, system, and device for relaying information through a mobile phone or personal display device
EP2818985B1 (en) * 2013-06-28 2021-05-12 Nokia Technologies Oy A hovering input field
KR20150027891A (en) * 2013-08-30 2015-03-13 삼성전자주식회사 Method and apparatus for presenting content using electronic devices
US20150173116A1 (en) * 2013-12-13 2015-06-18 Mediatek Inc. Communications method, device and system
US9916839B1 (en) * 2014-03-27 2018-03-13 Amazon Technologies, Inc. Shared audio functionality based on device grouping
US9584852B2 (en) * 2014-08-28 2017-02-28 International Business Machines Corporation Synchronizing two or more display devices to augment user experience
US9338391B1 (en) 2014-11-06 2016-05-10 Echostar Technologies L.L.C. Apparatus, systems and methods for synchronization of multiple headsets
KR102498351B1 (en) * 2015-04-08 2023-02-10 삼성전자주식회사 Method and apparatus for transmitting and receiving data in wireless communication system
US10080139B2 (en) * 2015-06-15 2018-09-18 Huawei Technologies Co., Ltd. Information sending method and apparatus, terminal device, and system
KR102546212B1 (en) * 2016-01-05 2023-06-22 삼성전자주식회사 Method for Outputting Sound and Electronic Device supporting the same
CN106303019A (en) * 2016-08-12 2017-01-04 乐视控股(北京)有限公司 A kind of headset control method and device
US20210374806A1 (en) * 2020-05-27 2021-12-02 David Hazzard Apparatus and Method for Implementing a Communication from a Premises Display Apparatus to a Personal Display Apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060143327A1 (en) * 2004-12-28 2006-06-29 Ulead Systems, Inc. System for synchronously controlling multiple devices
US20100178036A1 (en) * 2009-01-12 2010-07-15 At&T Intellectual Property I, L.P. Method and Device for Transmitting Audio and Video for Playback

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5867223A (en) 1995-07-17 1999-02-02 Gateway 2000, Inc. System for assigning multichannel audio signals to independent wireless audio output devices
US20020102949A1 (en) 2001-01-17 2002-08-01 Sherman Langer Remote control having an audio port
KR100606060B1 (en) 2004-02-21 2006-07-26 삼성전자주식회사 Method and device for outputting data of wireless terminal to external device
US20070004472A1 (en) 2005-06-30 2007-01-04 Gitzinger Thomas E Method and apparatus for wireless audio management
KR20070044527A (en) 2005-10-25 2007-04-30 (주)케이티에프테크놀로지스 Mobile terminal having blue tooth module
KR100709986B1 (en) 2005-10-26 2007-04-23 주식회사 엘지텔레콤 Method for transmitting voice data for picture information to at least one communication terminal via network, method for outputting the voice data in communication terminal, and system of enabling the method
KR20090120712A (en) 2008-05-20 2009-11-25 주식회사 지팡이 Apparatus and method to display advertizement data linked to contents
US8290537B2 (en) 2008-09-15 2012-10-16 Apple Inc. Sidetone adjustment based on headset or earphone type
KR101519407B1 (en) 2008-12-08 2015-05-21 엘지전자 주식회사 Mobile termianl and information processing method thereof
KR101608650B1 (en) 2009-07-24 2016-04-04 엘지전자 주식회사 Mobile terminal and control method thereof
CN102143262B (en) 2010-02-03 2014-03-26 深圳富泰宏精密工业有限公司 Electronic device and method for switching audio input channel thereof
US8370878B2 (en) 2010-03-17 2013-02-05 Verizon Patent And Licensing Inc. Mobile interface for accessing interactive television applications associated with displayed content
US8843226B2 (en) * 2012-03-05 2014-09-23 Lg Electronics Inc. Electronic device and method of controlling the same

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060143327A1 (en) * 2004-12-28 2006-06-29 Ulead Systems, Inc. System for synchronously controlling multiple devices
US20100178036A1 (en) * 2009-01-12 2010-07-15 At&T Intellectual Property I, L.P. Method and Device for Transmitting Audio and Video for Playback

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9692860B2 (en) * 2014-05-15 2017-06-27 Apple Inc. One layer metal trace strain gauge
US20160278091A1 (en) * 2015-03-17 2016-09-22 Noodoe Corporation Sound generation and transmission systems and methods using a radio transmitter
US9612793B2 (en) * 2015-03-17 2017-04-04 Noodoe Corporation Wireless communication system and method for converting specific data between a network interface communication standard and an incompatible radio broadcasting communication standard
US9524252B2 (en) * 2015-04-24 2016-12-20 Primax Electronics Ltd. Input system and method
US20220030505A1 (en) * 2019-01-17 2022-01-27 Lg Electronics Inc. Method and device for providing audio service using bluetooth technology

Also Published As

Publication number Publication date
US20130231762A1 (en) 2013-09-05
US20130231764A1 (en) 2013-09-05
US8706279B2 (en) 2014-04-22
US20140195027A1 (en) 2014-07-10
US8843226B2 (en) 2014-09-23
WO2013133480A1 (en) 2013-09-12
US9239701B2 (en) 2016-01-19

Similar Documents

Publication Publication Date Title
US9239701B2 (en) Electronic device and method of controlling the same
US9553972B2 (en) Method and system for reproducing contents, and computer-readable recording medium thereof
KR101750898B1 (en) Mobile terminal and control method therof
US10674219B2 (en) Method and system for reproducing contents, and computer-readable recording medium thereof
KR101952170B1 (en) Mobile device using the searching method
US8565741B2 (en) Mobile terminal and information processing method thereof
EP3343412B1 (en) Method and system for reproducing contents, and computer-readable recording medium thereof
US8539531B2 (en) Mobile terminal, method of participating in interactive service therein, internet protocol television terminal and communication system including the same
KR20140075997A (en) Mobile terminal and method for controlling of the same
KR20140049290A (en) Mobile termina, broadcasting terminal and controlling method thereof
KR101875744B1 (en) Electonic device and method for controlling of the same
KR101987463B1 (en) Mobile terminal and method for controlling of the same
KR101973641B1 (en) Mobile terminal and control method for mobile terminal
KR20140074498A (en) Mobile terminal and method for controlling of the same
KR101851295B1 (en) Mobile terminal and control method for mobile terminal
KR101899814B1 (en) Mobile terminal and method for controlling the same
KR101735517B1 (en) Mobile terminal and control method therof
KR20140060003A (en) Mobile terminal and method for controlling of the same
KR20150020932A (en) Mobile terminal and method for controlling of the same
KR20130033654A (en) Nfc module and mobile terminal having contact terminal unit

Legal Events

Date Code Title Description
AS Assignment

Owner name: LG ELECTRONICS INC., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KIM, JIHWAN;REEL/FRAME:028187/0086

Effective date: 20120424

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION