CN107667342B

CN107667342B - Electronic device and method for controlling sound of electronic device

Info

Publication number: CN107667342B
Application number: CN201680030743.0A
Authority: CN
Inventors: 朴多惠; 梁必承; 闵瓒泓; 白盛旭; 成玲妸; 张世二
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2015-05-27
Filing date: 2016-04-20
Publication date: 2021-04-06
Anticipated expiration: 2036-04-20
Also published as: CN107667342A; KR102428271B1; KR20160140298A

Abstract

An electronic device and a method for controlling sound of the electronic device are provided. The electronic device includes: a display configured to display content; a speaker configured to output sound; a communicator configured to receive information from an external remote control apparatus; and a controller configured to control the display, the speaker, and the communicator, wherein the controller is configured to control the display to display the second content and to control the speaker to continuously output the first sound in response to the communicator receiving the first control information from the remote controlling apparatus while the display displays the first content and the speaker outputs the first sound corresponding to the first content.

Description

Electronic device and method for controlling sound of electronic device

Technical Field

Apparatuses and methods consistent with exemplary embodiments relate to controlling sound of an electronic apparatus, and more particularly, to an electronic apparatus configured to display a second channel on a screen and output a first sound corresponding to a first channel displayed before the second channel through a speaker, and a method for controlling sound of the electronic apparatus.

Background

With the development of technology, the functions of electronic devices become complex and diversified. In particular, the electronic device can output externally downloaded content (e.g., video), and can perform internet browsing.

The electronic device frequently displays an in-program commercial break during the broadcast of a broadcast channel (e.g., a sports program). When displaying advertisement slots in a program, a user may change the current channel of the electronic device to another channel. However, the user cannot know when the advertisement slot in the program ends, even if the user still wants to watch the previously viewed broadcast channel.

Disclosure of Invention

Technical problem

Therefore, a user who does not want to view the advertisement slots in the program in the previous channel needs to see whether the advertisement slots in the program are over by repeatedly changing between the new channel and the previous channel (e.g., the advertisement slots in the program).

Technical scheme

According to an aspect of an exemplary embodiment, there is provided an electronic apparatus including: a display configured to display content; a speaker configured to output sound; a communicator configured to receive information from an external remote control apparatus; and a controller configured to control the display, the speaker, and the communicator, wherein the controller is configured to control the display to display the second content and to control the speaker to continuously output the first sound in response to the communicator receiving the first control information from the remote controlling apparatus while the display displays the first content and the speaker outputs the first sound corresponding to the first content.

The communicator may include an optical receiver, and the controller may be configured to control the optical receiver to receive the first control information.

The controller may be configured to control the display to display a pop-up window together with the second content in response to the communicator receiving the first control information.

The controller may be configured to control the display to display a pop-up window overlapping with the second content in response to the communicator receiving the first control information.

The controller may be configured to control the display to display a pointer movable on the display in accordance with movement of the remote control device in response to the communicator receiving second control information from the remote control device.

The communicator may include an optical receiver, and the controller may be configured to control the optical receiver to receive the second control information.

The second control information may include control information corresponding to movement of the remote controlling apparatus.

The controller may be configured to control the display to display the first content and the speaker to continuously output the first sound in response to the communicator receiving third control information received from the remote control device.

The controller may be configured to control, in response to the communicator receiving fourth control information received from the remote controlling apparatus, to control the display to continuously display the second content and to control the speaker to output a second sound corresponding to the second content.

The controller may be configured to control an external speaker connected to the electronic device in a wired or wireless manner to output the first sound.

According to an aspect of another exemplary embodiment, there is provided a remote control apparatus including: a button; a sensor configured to detect movement of a remote control device; a communicator configured to transmit information to an electronic apparatus; and a controller configured to control the sensor and the communicator, wherein the controller is configured to control the transmitter to transmit first control information corresponding to a selection of the button and second control information corresponding to a movement of the remote controlling apparatus detected by the sensor to the electronic apparatus so as to control content displayed by the electronic apparatus and a sound output by the electronic apparatus, and wherein at least one of the first control information and the second control information instructs the electronic apparatus to switch from displaying the first content to displaying the second content and continuously output the first sound corresponding to the first content.

The communicator may include an optical transmitter, and the controller may be configured to control the optical transmitter to transmit at least one of the first control information and the second control information to the electronic device.

The button may comprise a dedicated button or a combination of buttons.

According to an aspect of another exemplary embodiment, there is provided an electronic apparatus including: a display configured to display content; a speaker configured to output sound; an input/output interface connected to an audio device; a communicator configured to receive information from a remote control apparatus; and a controller configured to control the display, the speaker, the input/output interface, and the receiver, wherein the controller is configured to control the display to display the second content, control the speaker to output a second sound corresponding to the second content, and control the audio apparatus to continuously output the first sound in response to receiving the first control information from the audio apparatus and receiving the second control information from the remote control device while the display displays the first content and the speaker and the audio apparatus output the first sound corresponding to the first content.

The first control information may correspond to a first input detected by a sensor of the audio device, and the controller may be configured to control one of the input/output interface and the communicator to receive the first control information.

The communicator may include an optical receiver, the second control information may correspond to a second input received through a button of the remote control device, and the controller may be configured to control the optical receiver to receive the first control information.

The controller may be configured to control the display to display the first content, control the speaker to continuously output the first sound corresponding to the first content, and control the audio device to continuously output the first sound, in response to third control information received from the audio device.

Advantageous effects of the invention

According to various embodiments, an electronic apparatus capable of controlling a screen and a speaker of the electronic apparatus by using a remote control device and a method for controlling sound of the electronic apparatus may be provided.

Drawings

The above and/or other aspects of the present disclosure will become more apparent by describing some exemplary embodiments thereof with reference to the attached drawings, in which:

fig. 1 is a diagram schematically illustrating operations among an electronic apparatus, a remote control device, and an audio apparatus according to an exemplary embodiment;

fig. 2A and 2B are block diagrams illustrating an electronic apparatus, a remote control device, and an audio apparatus according to an exemplary embodiment;

fig. 3A is a flowchart schematically illustrating a method for controlling sound of an electronic device according to an exemplary embodiment;

fig. 3B is a flowchart schematically illustrating a method for controlling sound of an electronic device according to an exemplary embodiment;

fig. 3C is a flowchart schematically illustrating a method for controlling sound of an electronic device according to an exemplary embodiment;

fig. 3D is a flowchart schematically illustrating a method for controlling sound of an electronic device according to an exemplary embodiment;

fig. 4A to 4G are diagrams schematically illustrating an example regarding a method for controlling a sound of an electronic device according to an exemplary embodiment;

fig. 5A to 5D are diagrams schematically illustrating an example of a method for controlling sound of an electronic device according to an exemplary embodiment;

fig. 6A to 6H are diagrams schematically illustrating an example of a method for controlling sound of an electronic device according to an exemplary embodiment; and

fig. 7A to 7D are diagrams schematically illustrating an example of a method for controlling sound of an electronic device according to an exemplary embodiment.

Detailed Description

Modes for carrying out the invention

Some exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings.

In the following description, the same reference numerals are used for the same elements even in different drawings. The matters defined in the description such as a detailed construction and elements are provided to assist in a comprehensive understanding of the disclosure. It is therefore evident that the exemplary embodiments of the disclosure may be practiced without those specifically defined matters. Also, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

The exemplary embodiments of the present disclosure may be variously modified. Accordingly, specific exemplary embodiments are shown in the drawings and described in the detailed description. It should be understood, however, that the present disclosure is not limited to the particular exemplary embodiments, but includes all modifications, equivalents, and alternatives without departing from the scope and spirit of the present disclosure. Also, well-known functions or constructions are not described in detail since they would obscure the disclosure in unnecessary detail.

Terms including ordinal numbers such as "first", "second", etc., may be used to describe various constituent elements, but the elements are not limited by the terms. These terms are only used to distinguish one element from another. For example, a first element may be named a "second element," or, similarly, a second element may be named a "first element," without departing from the scope of the present disclosure. The expression "and/or" includes any one of a combination of a plurality of related items or a plurality of related items.

Throughout the description, the expression of the remote controller 200 "(being) select a key (or button)" as used herein may mean that the key (or button) "is being pressed or touched (being) pressed.

The expression "user input" as used herein may refer to concepts including, for example: the user selects a key (or button), presses a key (or button), touches a key, or makes a touch gesture, voice, or motion. Further, with respect to the remote controller 200, a "touch" (including a touch gesture) may be input through a user's body or a stylus (e.g., a stylus pen).

According to an exemplary embodiment, a "screen" of an electronic device as used herein may include a display of the electronic device.

According to an exemplary embodiment, the expression "sound" or "audio" as used herein may indicate sound data (e.g., music data, voice data, etc.) corresponding to the sound or audio. Further, the expression "sound" or "audio" as used herein may indicate a sound file (e.g., music file, voice file, etc.) corresponding to the sound or audio.

According to an exemplary embodiment, a "sound hold" function may be a function that changes a first broadcast channel displayed on a screen of an electronic device to a second broadcast channel, but maintains output of a sound corresponding to the first broadcast channel, not a sound corresponding to the second broadcast channel. For example, an advertisement slot in a program may be displayed while a first broadcast channel (e.g., a boxing match for a sports channel) is displayed on a screen of the electronic device. When an advertisement slot in a program is displayed on the electronic device, a user may change the first broadcast channel to a second broadcast channel (e.g., to a news channel). When changing to the second broadcast channel, the electronic device may output a sound corresponding to the first broadcast channel (e.g., an advertisement slot in a program) through the speaker instead of the sound corresponding to the second broadcast channel.

The "content" may be displayed on an electronic device (e.g., including a display device). For example, the content may include a video file or an audio file reproduced by a video player, which is one of the applications, a music file reproduced by a music player, a photo file displayed by a photo album (photo gallery), or a web page file displayed by a web browser. Further, the content may include a received broadcast.

The terminology used herein is for the purpose of describing exemplary embodiments and is not intended to be limiting and/or limiting of the disclosure. Furthermore, the singular reference does not limit the present disclosure to having a single component or step. Rather, the disclosure may include a plurality of components or steps, even if described in the singular. Expressions such as "including" or "having" as used herein are intended to indicate the presence of the features, numbers, steps, operations, elements, components or combinations thereof specified in the description, and should not be interpreted as excluding the possible presence or addition of one or more other features, numbers, steps, operations, elements, components or combinations thereof.

In the drawings, like reference numerals refer to elements having substantially the same function.

Fig. 1 is a diagram schematically illustrating operations among an electronic apparatus, a remote control device, and an audio apparatus according to an exemplary embodiment.

Referring to fig. 1, an electronic apparatus 100, a remote controlling device 200, and an audio apparatus 300 are shown.

The electronic device 100 may display content (e.g., broadcasts, videos, etc.). The nearby remote controlling apparatus 200 may control the electronic device 100 by transmitting a control command according to a user input through infrared or near field communication. The user may control functions of the electronic apparatus 100 (e.g., power on/off, channel change, volume adjustment, or content playback) by using voice recognition via a button 261 (fig. 2A), a touch pad 262 (fig. 2A), and a microphone 263 (fig. 2A) provided on the remote controlling device 200 and/or motion recognition via a sensor 264 (fig. 2A).

The user may control functions of the electronic device 100 (e.g., power on/off, channel change, volume adjustment, or content playback) with motion recognition by a camera 145 (fig. 2A) provided on the electronic device 100.

The electronic apparatus 100 and the audio apparatus 300 may be wirelessly connected to each other via their

communicators

130 and 330. For example, the electronic apparatus 100 and the audio apparatus 300 may be connected to each other in an ad-hoc (ad-hoc) mode or an infrastructure (infra-structure) mode that is wirelessly connected through the access point 50.

The wireless communication may be wireless LAN, bluetooth low energy, Zigbee, WFD (Wi-Fi direct), UWB (ultra wide band), IrDA (infrared data association), and NFC (near field communication), but is not limited thereto.

In addition, the audio device 300 may be connected to the electronic device 100 in a wired manner by a cable.

The electronic device 100 may output audio (e.g., audio data corresponding to a music file) to the audio device 300 through the wireless LAN and near field communication (e.g., bluetooth communication, NFC communication, etc.).

The electronic device 100 may transmit audio (e.g., audio data corresponding to a music file) to an access point accessed through the wireless LAN, so that the audio device 300 outputs the audio. The audio device 300 may receive audio (e.g., audio data corresponding to a music file) from an access point and output the audio.

The audio device 300 may include a soundbar (which may include a woofer) and one or more speakers. Audio devices (e.g., a sound bar including woofers, and one or more speakers) may be located within the same space (e.g., a living room in a home, an office, etc.) that allows access to one access point.

The audio device 300 may be implemented as a 2-channel, 2.1-channel, 4-channel, 4.1-channel, 5.1-channel, 6.1-channel, 7.1-channel, 9.1-channel, or 11.2-channel, but those skilled in the art may easily understand that the exemplary embodiments may not be limited thereto.

Fig. 2A and 2B are block diagrams illustrating an electronic apparatus, a remote control device, and an audio apparatus according to an embodiment.

Referring to fig. 2A, the electronic apparatus 100 may be connected to an external device in a wired or wireless manner by using the communicator 230 or the input/output interface 160. The external devices may include a mobile phone, a smart phone, a tablet PC, the remote controlling apparatus 200, the audio device 300, and a server. Further, the electronic device 100 may receive control information from the remote controlling apparatus 200.

The electronic device 100 may include the display 170, and may externally download an application and install the application.

Electronic device 100 may include display 170 and additionally include one of tuner 120, communicator 130, and input/output interface 160. Electronic device 100 may include display 170 and, in addition, a combination of tuner 120, communicator 130, and input/output interface 160. Alternatively, the electronic device 100 including the display 170 may be electrically connected to another external electronic device including a tuner.

Fig. 2A illustrates an example of an electronic device implemented to include a tuner and a display.

Electronic device 100 may include a tuner 120, a communicator 130, a microphone 140, a camera 145, an input/output interface 160, a display 170, an audio output interface 175, a storage 180, and a power supply 190. The electronic device 100 may include a sensor (e.g., an illuminance sensor, a temperature sensor, etc.) that detects an internal state or an external state of the electronic device 100.

The controller 110 may control the general operation of the electronic device 100 and the flow of signals between the

components

120 and 190 within the electronic device 100 and process data. In addition, the controller 110 may control the power provided to the elements 120 and 180 from the power source 190.

The controller 110 may include: a processor 111; a Read Only Memory (ROM)112 (or a nonvolatile memory) that stores a control program for controlling the electronic apparatus 100; and a Random Access Memory (RAM)113 (or a volatile memory) that stores externally input signals or data and serves as a storage area corresponding to various operations performed in the electronic device 100. Further, the controller 110 may include an embedded processor including ROM and/or RAM.

The processor 111 may include a graphics processing unit for graphics processing corresponding to video or images. The processor 111 may be configured as a system on chip (SoC) including a core (core) and a Graphics Processing Unit (GPU). Processor 111 may include a single core, a dual core, a triple core, a quad core, or multiple cores.

The processor 111 may include a plurality of processors, for example, a main processor, and sub-processors operating in a sleep mode and/or a sensor processor controlling a sensor.

The processor 111, the ROM 112, and the RAM 113 may be connected to each other by a bus.

According to an exemplary embodiment, the term "controller 110 of an electronic device" as used herein may include a processor 111, a ROM 112, and a RAM 113 of the electronic device 100.

The construction and operation of the controller 110 may be variously embodied according to embodiments that can be easily understood by those skilled in the art.

The tuner 120 may tune only to a frequency of a channel desired to be received by the electronic device 100 among various wave components (wave components) of the externally received broadcast signal by signal amplification, mixing, or resonance. The broadcast signal may include video, audio, and additional data (e.g., an Electronic Program Guide (EPG)).

The tuner 120 may receive video, audio, and data from a frequency bandwidth corresponding to a channel (e.g., cable broadcast #24) according to a user input (e.g., control information received from the remote controlling apparatus 200, a channel number input, a channel up-down input, etc.).

Tuner 120 may include multiple tuners (e.g., a first tuner, a second tuner, not shown). Further, the tuner 120 may operate as a first tuner module and a second tuner module implemented as software programs under the control of the controller 110.

The tuner 120 may receive a broadcast signal from various sources such as terrestrial wave broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, and the like. In addition, the tuner 120 may receive a broadcast signal from a source such as analog broadcasting or digital broadcasting.

Tuner 120 may be embedded in electronic apparatus 100 or implemented as a separate device (e.g., a set-top box) that includes a tuner unit electrically connected to electronic apparatus 100. Further, the tuner 120 may be configured as a tuner connected to the input/output interface 160.

The communicator 130 may connect the electronic apparatus 100 to an external device (e.g., a remote control device, an audio device, or a server) under the control of the controller 110. The controller 110 may download an application from another electronic device through the communicator 130 or perform web browsing. Further, the communicator 130 may receive control information from the remote controlling apparatus 200 under the control of the controller 110.

Depending on the capabilities and composition of the electronic device 100, the communicator 130 may include a wired ethernet 131, a wireless Local Area Network (LAN) communicator 132, a near field communicator 133, and/or an optical receiver 150.

The microphone 140 may receive speech spoken by the user. The microphone 140 may change the received voice into an electric signal and output the electric signal to the controller 110. The user speech may include speech corresponding to a menu or function controlling the electronic device 100.

The microphone 140 may be incorporated into the electronic device 100 or separate from the electronic device 100. The separate microphone 140 may be electrically connected to the electronic device 100 through the communicator 130 or the input/output interface 160.

The camera 145 may receive video (e.g., consecutive frames) corresponding to a user action including a gesture within a recognition range of the camera. The user actions may include actions of a user's body parts (e.g., face, look (look), hands, fist and fingers) or user body parts.

The camera 145 may convert the received video into an electrical signal under the control of the controller 110 and output the electrical signal to the controller 110. The controller 110 may display a menu on the electronic device 100 by using the motion recognition result, or perform a control (e.g., channel adjustment or volume adjustment) corresponding to the motion recognition result.

When the camera 145 is implemented as a plurality of cameras, a three-dimensional still image or a three-dimensional motion may be received by using a first camera and an adjacent second camera in front of the electronic device 100 (e.g., a separation between an optical axis of the first camera and an optical axis of the second camera is greater than 1 cm and less than 8 cm).

The camera 145 may be configured separately from the electronic device 100 and integrally (all-in-one) with the electronic device 100. The separate camera may be electrically connected to the electronic device 100 through the communicator 130 or the input/output interface 160.

The optical receiver 150 may receive an optical signal including control information output from the remote controlling apparatus 200 through an optical window (optical window). The optical receiver 150 may receive optical signals corresponding to user input (e.g., touch, press, touch gesture, voice, or motion) from the remote control device 200. Control information may be detected from the received optical signal. Control information detected from the received optical signal may be sent to the controller 110.

The input/output interface 160 may transmit or receive content from the electronic device 100 externally under the control of the controller 110. The input/output interface 160 may include one of a high-definition multimedia interface (HDMI) input port 261, a component input jack 262, a PC input port 263, and a Universal Serial Bus (USB) input jack 264. The input/output interface 160 may include a combination of an HDMI input port 261, a component input jack 262, a PC input port 263, and a USB input jack 264.

Input/output interface 160 may include buttons 165. The buttons 165 may include a power button, a volume removal button, a volume adjustment button, or a channel change button. Buttons 165 may include a home button 165a, a previously implemented applications button 165b, and/or a back button 165 c.

Those skilled in the art will readily appreciate that the above-described elements included in the input/output interface 160 may be modified, added, and/or deleted corresponding to the electronic device 100.

The display 170 may display video included in the broadcast signal received through the tuner 120 under the control of the controller 110. The display 170 may display video input through the communicator 130 or the input/output interface 160.

The display 170 may output video stored in the storage device 180 under the control of the controller 110. Further, the display 170 may display a voice UI (user interface, which will be referred to as UI hereinafter, including a voice command guide, for example) to perform a voice recognition task corresponding to voice recognition or an action UI (including a user action guide for action recognition, for example) to perform an action recognition task corresponding to action recognition.

The screen of the electronic device 100 according to an embodiment may include the display 170 of the electronic device 100.

The audio output interface 175 may output audio (e.g., audio data corresponding to the audio) included in the broadcast signal received through the tuner 120 under the control of the controller 110. The audio output interface 175 may output audio (e.g., audio data corresponding to the audio) input through the communicator 130 or the input/output interface 160. In addition, the audio output interface 175 may output audio (e.g., audio data corresponding to the audio) stored in the storage device 180 under the control of the controller 110.

Audio output interface 175 may include one of a speaker 176, a headphone output component 177, or an S/PDIF (sony/philips digital interface format) output component 178. Additionally, audio output interface 175 may include a combination of speakers 176, headphone output component 177, and S/PDIF output component 178.

The storage device 180 may store various data, programs, or applications to drive and control the electronic device 100 under the control of the controller 110.

The storage device 180 may store signals or data input/output according to driving of the tuner 120, the communicator 130, the microphone 140, the camera 145, the optical receiver 150, the input/output interface 160, the display 170, the audio output interface 175, and the power supply 190. The storage device 180 may store a control program for controlling the electronic device 100 and the controller 110, an application initially provided by a manufacturer or externally downloaded, a Graphical User Interface (GUI) related to the application, an object providing the GUI (e.g., an image, text, an icon, and a button), user information, a document, a database, or related data.

According to an exemplary embodiment, the term "storage" may include the storage 180 of the electronic device 100, the ROM 112 and the RAM 113 of the controller 110, and a memory card (e.g., a micro SD card or a USB memory) attached to the electronic device 100. Further, the storage device may include a nonvolatile memory, a volatile memory, a Hard Disk Drive (HDD), or a solid state drive (SDD).

The storage device 180 may include a broadcast receiving module, a channel control module, a volume control module, a communication control module, a voice recognition module, an action recognition module, an optical receiving module, a display control module, an audio control module, an external input control module, a power control module, a voice database, or an action database, which are not shown herein. The modules and databases of the storage device 180 may be configured in a software format so as to perform a control function of broadcast reception, a channel control function, a volume control function, a communication control function, a voice recognition function, a motion recognition function, an optical reception function, a display control function, an audio control function, an external input control function, or a power control function. The controller 110 may perform the functions of the electronic device 100 by executing the above-described software stored in the storage device 180.

The storage 180 may store electronic device information, remote control apparatus information, and/or audio device information.

The storage 180 may store the first control information, the second control information, the third control information, the fourth control information, and/or the #12 control information received from the remote control apparatus.

The storage device 180 may store control information received from the audio device 300.

According to an exemplary embodiment, the term "storage device" as used herein may include the storage device 180, the ROM 112 and the RAM 113 of the controller 110, a storage device configured as an SoC, and/or a memory card (e.g., a micro SD card or a USB memory, not shown) attached to the electronic device 100. Also, the storage device may include a nonvolatile memory, a volatile memory, an HDD, or an SDD.

The power supply 190 may supply power input from an external power source to the internal elements 120 to 180 of the electronic device 100 under the control of the controller 110. Also, the power supply 190 may supply power input from one or more batteries located within the electronic device 100 to the internal elements 120 to 180 under the control of the controller 110.

At least one of the elements (e.g., 120 through 190) shown in the electronic device 100 of fig. 1 and 2A may be modified, added, or omitted depending on the actual implementation of the electronic device 100. Also, the location of the elements (e.g., 120 through 190) may be modified depending on the actual implementation of the capabilities or composition of the electronic device 100.

Referring to fig. 2A, the remote controlling apparatus 200 of the remote controlling electronic device 100 may include a controller 210, a communicator 230, an input interface 260, a storage 280, and a power supply 290. Also, the remote controlling apparatus 200 may not include the storage 280.

The remote controlling apparatus 200 may be another electronic apparatus capable of controlling the electronic device 100. The remote controlling apparatus 200 may be a device that installs an application for controlling the electronic device 100 to control the electronic device 100. The remote controlling apparatus 200, in which an application for controlling the electronic device 100 may be installed, may include a display (e.g., a touch screen or a display panel without a touch panel) and a storage device.

The remote control device including the display may include a cellular phone, a smart phone, a tablet PC, a laptop PC, another electronic apparatus, or a home appliance (e.g., a refrigerator, a washing machine, or a cleaning device).

The user may select a function key (e.g., a channel key) on the GUI provided from the application and control the electronic apparatus 100.

The controller 210 may control the general operation of the remote controlling apparatus 200 and the flow of signals between the internal elements 210 to 290, and perform data processing. The controller 210 may control the supply of power to the internal elements 210 to 280 by using the power supply 290.

The controller 210 may include: a processor 211; a ROM 112 (or nonvolatile memory) that stores a control program for controlling the remote controlling apparatus 200; and a RAM 113 (or a volatile memory) that stores signals or data externally input from the remote controlling apparatus 200 or serves as a storage area with respect to various operations performed in the remote controlling apparatus 200. Also, the processor 211, the ROM 212, and the RAM 213 may be connected to each other through an internal bus.

The controller 210 may include an embedded processor including ROM and/or RAM.

According to an exemplary embodiment, the term "controller" may include the processor 211, the ROM 212, and the RAM 213 of the remote controlling apparatus 200.

The communicator 230 may be wirelessly connected to the electronic device 100 under the control of the controller 210. The communicator 230 may transmit control information corresponding to a user input (e.g., a touch, a press, a touch gesture, a voice, or an action) to the electronic device 100 under the control of the controller 210.

Communicator 230 may include a wireless LAN communicator 231, a near field communicator 232, and/or an optical transmitter 250.

The optical transmitter 250 may output an optical signal (e.g., control information) corresponding to a user input (e.g., a touch, a press, a touch gesture, a voice, or a motion) to the optical receiver 150 of the electronic device 100 under the control of the controller 210.

The remote controller code format used in the remote controlling apparatus 200 may be one of a manufacturer-specific remote controller code format and a commercial remote controller code format. The remote controller code format may include a preamble (leader code) and a data word (data word). The output optical signal may be modulated with a carrier wave and output. The control information may be stored in the storage 280 or generated by the controller 210. The remote control device 200 may include an infrared light emitting diode (IR-LED).

The remote controlling apparatus 200 may include at least one of a wireless LAN communicator 231, a near field communicator 232, and an optical transmitter 250 capable of transmitting control information for controlling the electronic device 100 (e.g., channel change or volume adjustment).

The controller 210 may output control information corresponding to the user input to the electronic device 100 through a selected one of the communicator 230 and the optical transmitter 250. Also, the controller 210 may preferentially (with priority) transmit control information corresponding to the user input to the electronic device 100 through one of the communicator 230 and the optical transmitter 250.

Although fig. 2A shows that the remote controlling apparatus 200 includes the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250, only one of the above elements may be included according to an embodiment. For example, the remote control device may include only an IR LED that transmits an IR signal.

The input interface 260 may output an electrical signal (e.g., an analog signal or a digital signal) corresponding to a received user input (e.g., a touch, a press, a touch gesture, a voice, or an action) to the controller 210.

The input interface 260 may include a button 261 or a touch pad 262 that receives a user input (e.g., touching or pressing) for controlling the electronic device 100. The inputter 260 may include a microphone 263 that receives a voice spoken by a user or a sensor 264 that detects an action of the remote controlling apparatus 200. Also, the input interface 260 may include a vibration motor that provides tactile feedback corresponding to user input.

The button 261 may include one or more buttons (or keys) corresponding to functions of the electronic device 100. The one or more buttons (or keys) may include physical buttons or touch buttons.

The touchpad 262 may receive a user touch or a user touch gesture. The touch pad 262 may be located in front of the remote controlling device 200 to be distinguished from the location of the button 261.

The microphone 263 can receive speech spoken by a user.

The sensor 264 may detect the state of the remote controlling apparatus 200. The sensor 264 may transmit a signal corresponding to the state of the remote controlling apparatus 200 to the controller 210.

For example, the sensor 264 may include a near field sensor, an illuminance sensor, a motion sensor, a gyro sensor, an acceleration sensor, or a gravity sensor.

The vibration motor may change an electric signal into mechanical vibration under the control of the controller 210. For example, the vibration motor may include a linear vibration motor, a bar type vibration motor, a coin type vibration motor, or a piezoelectric module vibration motor.

The storage 280 may store various data, programs, and applications under the control of the controller 210 in order to drive and control the remote controlling apparatus 200. The storage device 280 may store signals or data input/output corresponding to driving of the power supply 290.

The storage 280 may store control information corresponding to the received user input (e.g., touch, press, touch gesture, voice, or motion) under the control of the controller 210.

The storage 280 may store remote control apparatus information corresponding to the remote control apparatus 200. The remote control device information may include a model name, a primitive device ID, a memory remaining amount, whether to store object data, a bluetooth version, or a bluetooth profile.

The storage device 280 may store the first control information transmitted to the electronic device 100.

The storage 280 may store the second control information transmitted to the electronic device 100. The second control information may correspond to movement of the remote controlling apparatus 200.

The storage 280 may store haptic pattern information corresponding to one or more haptic patterns. The haptic pattern may be represented as a waveform. The haptic pattern may indicate a vibration time of the vibration motor (e.g., measured in 50 milliseconds) on a horizontal axis and a vibration intensity of the vibration motor (e.g., measured in 500 millivolts) on a vertical axis. The first tactile pattern may be a vibration that gradually increases from 0 volts to 800mV, gradually decreases to 100mV, again repeatedly increasing. Also, the acceleration section and the deceleration section may be symmetrical to each other.

The second haptic mode may be a vibration that gradually increases from 0 volts to 900 millivolts, rapidly decreases to 500 millivolts, gradually decreases to 200 millivolts, and repeatedly increases. Also, the third haptic pattern may be a vibration that repeats a gradual increase from 0 volts to 950 millivolts, a rapid decrease to 100 millivolts, and then an increase.

When there are a plurality of haptic patterns, one pattern may be stored as a preferred haptic pattern by being established among the plurality of haptic patterns. When establishing the preferred haptic pattern, the controller 210 may provide the preferred haptic pattern with the highest priority as haptic feedback through the vibration motor.

The haptic pattern may be added, modified or deleted corresponding to a function or a constitution of the remote controlling apparatus 200.

The power supply 290 may supply power to the elements 210 to 290 of the remote controlling apparatus 200 under the control of the controller 210. Power supply 290 may provide power to elements 210-290 from one or more batteries located in remote control device 200.

At least one element shown in the remote controlling apparatus 200 of fig. 1 and 2A may be modified, added, or deleted according to the performance of the remote controlling apparatus 200. Also, the positions of the elements may be modified according to the performance or composition of the remote controlling apparatus 200.

Referring to fig. 2B, the audio device 300 may be connected to the electronic device 100 through the communicator 230 in a wired or wireless manner. The audio device 300 may output audio data corresponding to audio received from the electronic device 100 or the access point. The audio device 300 may output an audio stream received from the electronic device 100 and/or the access point connected in a wired or wireless manner.

Audio device 300 may include controller 310, communicator 330, input/output interface 360, display 370, speaker 375, storage 380, and/or power supply 390.

The controller 310 may control the general operation of the audio device 300 and the flow of signals between the internal elements 330 through 390 of the audio device 300 and process data. The controller 310 may control power supplied from the power supply 390 to the internal elements 330 to 380.

The controller 310 may include a processor 311. The controller 310 may include a processor 311 and a ROM 312 storing a control program for controlling the audio device 300. In addition, the controller 310 may include a processor 311, a ROM 312, and a RAM 313, and the RAM 313 stores signals or data externally input from the audio device 300 and serves as a storage area corresponding to various operations performed in the audio device 300. The controller 310 may include an audio codec.

The controller 310 may output the received audio through a speaker. In addition, the controller 310 may output the received audio to an additionally connected speaker through the communicator 330 or the input/output interface 360.

The construction and operation of the controller 310 may be variously implemented according to exemplary embodiments.

The communicator 330 may be connected to the electronic device 100 in a wired or wireless manner under the control of the controller 310. The communicator 330 may receive audio data corresponding to audio from the electronic device 100 and/or the access point under the control of the controller 310. Also, the communicator 330 may receive a control signal from the access point or the electronic device 100 under the control of the controller 310.

The communicator 330 may include a wireless LAN communicator 331, a near field communicator 332, a wired ethernet 333, and/or an optical receiver 350.

The optical receiver 350 may receive received optical signals (including control signals) from a dedicated remote control device. The optical receiver 350 may receive optical signals corresponding to user input (e.g., touch, press, touch gesture, voice, or motion) from a dedicated remote control device. The received optical signal may be converted and sent to the controller 310. In addition, a control signal may be detected from the received optical signal using the controller 310.

The input/output interface 360 may receive audio data corresponding to audio (e.g., sound or music) externally under the control of the controller 310. The input/output interface 360 may externally output audio data corresponding to audio (e.g., sound or music) under the control of the controller 310.

The input/output interface 360 may include an HDMI port 361, an S/PDIF port 362, a USB port 363, and/or an audio access jack 364.

Further, the input/output interface 360 may include a sensor 365 that detects a state of the audio device 300. For example, the sensor 365 may include a near field sensor, an illuminance sensor, a motion sensor, a gyroscope sensor, an acceleration sensor, and/or a gravity sensor.

The composition and operation of the input/output interface 360 may be variously implemented according to the embodiments.

The display 370 may display video or text information (e.g., song title, volume, and sound output effect) under the control of the controller 310. For example, the display 370 may be a Liquid Crystal Display (LCD) panel, an Organic Light Emitting Diode (OLED) display, a Plasma Display Panel (PDP), or a Vacuum Fluorescent Display (VFD). The video and/or text information that may be displayed may differ depending on the display method.

The display 370 may be responsive to the controller 310 under control thereofAn external device (e.g., the electronic apparatus 100 or the memory card) connected to the audio apparatus 300 in a wired or wireless manner to display text, icons, or symbols (e.g., corresponding to reproduced ones)

And ■ corresponding to a stop).

When the audio device 300 and the electronic device 100 are wirelessly connected to each other, the display 370 may display the text "BT connection" or "NFC connection" under the control of the controller 310.

When the optical signal output from the dedicated remote control device is received by the optical receiver 350 of the audio apparatus 300, the display 370 may display text, icons, or symbols corresponding to "power on" to turn on the audio apparatus 300, "power off" to turn off the audio apparatus 300, and "Vol +/-" indicating the adjusted volume under the control of the controller 310.

The speaker 375 may output audio received through the control of the controller 310. The speaker 375 may output audio (e.g., voice, music, sound, or audio streams) received through the communicator 330 or the input/output interface 360.

The speaker 375 may be implemented as a 1-channel, 2-channel, or 2.1-channel. Further, the speaker 375 may be implemented as a 4-channel, 4.1-channel, 5.1-channel, 6.1-channel, 7.1-channel, 9.1-channel, or 11.2-channel. However, this may not be limited to the above channels.

The speaker 375 may output audio stored in the storage 380 under the control of the controller 310. In addition, the audio device 300 may output audio to an external electronic device through the input/output interface 360. For example, the controller 310 may output audio to additional speakers or the electronic device 100.

The storage 380 may store various data and control programs to drive and control the audio device 300 under the control of the controller 310. Storage 380 may store input/output signals or data corresponding to the operation of communicator 330, input/output interface 360, display 370, speaker 375, and power supply 390.

The storage 380 may include a nonvolatile memory, a volatile memory, a HDD, or an SDD.

The storage 380 may store audio device name information and/or electronic device information.

Storage 380 may store images, symbols, and/or text that may be displayed on display 370.

The power supply 390 may supply power input from an external power source to the internal elements 330 to 380 of the audio device 300 under the control of the controller 310. Also, the power supply 390 may supply power output from one or two or more batteries located within the audio device 300 to the internal elements 310 to 390 under the control of the controller 310.

At least one element (e.g., 310 to 390) shown in the audio device 300 of fig. 1 and 2B may be added or omitted depending on the actual implementation of the audio device 300. Also, the positions of the elements (e.g., 310 to 390) may be modified according to the performance or structure of the audio device 300.

Fig. 3A is a flowchart illustrating a method for controlling sound of an electronic device according to an exemplary embodiment.

Fig. 4A to 4G are diagrams schematically illustrating an example of a method for controlling sound of an electronic device according to an exemplary embodiment.

In operation S301 of fig. 3A, a first (#1) broadcast channel may be displayed on a screen of an electronic device, and a first sound corresponding to the first broadcast channel may be output through a speaker.

Referring to fig. 4A, the electronic device 100 may display a first broadcast channel 400 (e.g., a boxing match) on the screen 170 under the control of the controller 110 and output a first sound 400a corresponding to the first broadcast channel through the speaker 176. The first broadcast channel 400 displayed on the screen may be selected by a user input inputted through one of the remote controlling apparatus 200 and the electronic device 100.

In response to a user's selection of a first broadcast channel, the controller 110 may receive a broadcast signal corresponding to the first broadcast channel through the first tuner. The controller 110 may output a video 400 corresponding to the first broadcast channel on the display 170. The controller 110 may output audio 400a corresponding to the first broadcast channel from the received broadcast signal through the speaker 176 and/or the audio device 300.

The remote controlling apparatus 200 may include a power button 201a, a volume removal button 201b, a volume adjustment button 201c, a channel change button 201d, a pointer button 201e, a direction button 201f, and/or an input button 201 g. The remote controlling apparatus 200 may further include a sound reservation button corresponding to the sound reservation function. The remote controlling apparatus 200 may include various buttons other than the above-described buttons (e.g., 201a to 201g or sound reservation buttons).

Also, the electronic device 100 may transmit the first sound 400a corresponding to the first broadcast channel to the audio device 300 in a wired or wireless manner under the control of the controller 110.

The controller 310 of the audio device 300 may receive the first sound 400a corresponding to the first broadcast channel transmitted from the electronic device 100 through the communicator 330 and/or one of the input/output interfaces 360. The controller 310 of the audio device 300 may output the received first sound 400a through the speaker 375. Also, the storage 380 may store the received first sound under the control of the controller 110.

According to an embodiment, the term "user" may indicate a person who controls a function or operation of the electronic apparatus 100 by using the remote controlling device 200, and include a user, a manager, or an installer.

In operation S302 of fig. 3A, a sound reservation control command may be received from a remote control apparatus.

Referring to fig. 4B, an in-program advertisement slot 401 may be displayed on the electronic device 100 during the boxing match 400.

When the in-program advertisement slot 401 is displayed on the electronic device 100, the controller 110 of the electronic device 100 may output a sound 401a corresponding to the in-program advertisement slot 401 through the speaker 176 and/or the audio device 300. The sounds corresponding to the

images

400 and 401 displayed at the first broadcast channel may be referred to as

first sounds

400a and 401 a.

When the in-program advertisement slot 401 is displayed on the electronic apparatus 100, the user may input the first input 500 on the

volume removing buttons

201b and 201d of the remote controlling device 200 according to the sound reservation function of the electronic apparatus 100 being implemented. The first input may include a selection 501 of the volume removal button 201b and a selection 502 of the channel change button 201d with respect to the remote controlling apparatus 200. Also, the first input 500 may include a selection 501' of a sound reservation button and a selection 502 of a channel change button 201d with respect to the remote controlling apparatus 200.

The first input 500 may include a user's selection of a key (or button), a user's depression of a key (or button), a user's touch of a key, and a user's touch gesture. Further, the first input 500 may include a user voice input through the microphone 263 or a user action (or movement of the remote controlling apparatus 200) detected by the sensor 264.

The above-described button may be one example of a button corresponding to the sound reservation function, and may not be limited thereto. In addition, the type and number of buttons corresponding to the sound reservation function may be modified.

According to an exemplary embodiment, the sound retention function is a function of: the first broadcast channel displayed on the screen of the electronic device 100 is changed to the second broadcast channel, and the sound corresponding to the first broadcast channel is maintained to be output instead of the sound corresponding to the second broadcast channel. For example, an in-program advertisement slot 401 of a first broadcast channel (e.g., boxing match 400 of a sports channel) may be displayed on the screen of the electronic device 100.

When the in-program advertisement slot 401 is displayed on the electronic device 100, the user may switch the first broadcast channel to a second broadcast channel (e.g., weather forecast 450). When switching to the second broadcast channel 450, the controller 110 of the electronic device 100 may output a sound (e.g., the first sound 401a) corresponding to the first broadcast channel (e.g., the in-program advertisement slot 401) instead of a sound corresponding to the second broadcast channel 450 through the speaker 176 of the electronic device 100.

The controller 210 of the remote controlling apparatus 200 may transmit a first control signal corresponding to the first input 500 to the electronic device 100. The controller 210 of the remote controlling apparatus 200 may transmit a first control signal corresponding to the selection 501 of the volume removing button 201b and the selection 502 of the channel changing button 201d to the electronic device 100 through one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250. Further, the controller 210 of the remote controlling apparatus 200 may transmit the first control information corresponding to the selection 501' of the sound reservation button and the selection 502 of the channel change button 201d to the electronic device 100 through one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250.

The first control information may be control information for displaying the second broadcast channel on the screen of the electronic device 100 and outputting a sound corresponding to the first broadcast channel through a speaker.

When the first control information is transmitted through the optical transmitter 250, the user may maintain the first input 500 for a preset time period. For example, the preset time may be 300 milliseconds, which may be modified by the setup. The preset time corresponding to the first control information may indicate that a period of time for which the user selects the first input 500 is longer than a signal period from a first preamble of the remote controller code format to a consecutive second preamble (e.g., consecutive codes until output to the second preamble). The preset time period may be modified according to the model or manufacturer of the remote controlling apparatus 200.

When the first control information is transmitted through the near field communicator (e.g., bluetooth), the controller 210 of the remote controlling apparatus 200 may transmit the first control information to the electronic device 100 in a bluetooth packet.

The bluetooth packet may include an access code (72 bits), a header (54 bits), and a payload (0-2745 bits) for determining the validity of the packet. The access code may be used to determine the validity of the packet. The header may include a Media Access Control (MAC) address and a packet type. The payload may include the transmitted data and the size is modified according to the type of packet transmitted. The transmitted first control information may be included in a payload of the packet.

When the remote controlling apparatus 200 and the electronic device 100 are initially connected to each other, the controller 210 of the remote controlling apparatus 200 may search for the electronic device 100 by using a near field communicator (e.g., bluetooth). The controller 210 may request a query and connection page from the electronic device 100. Further, when the remote controlling apparatus 200 and the electronic device 100 are initially connected to each other, the controller 210 of the remote controlling apparatus 200 may be connected to the electronic device 100 by using a near field communicator (e.g., bluetooth low energy).

The storage 280 may store electronic device connection information corresponding to the electronic device 100 connected to the remote controlling apparatus 200 under the control of the controller 210. The stored electronic device connection information may include an electronic device name (SSID), a MAC address, operational information (e.g., busy or standby), or context information.

The controller 210 of the remote controlling apparatus 200 may transmit the first control information to the electronic device 100 by using the stored electronic device connection information.

The items included in the electronic device connection information may be modified, added, or deleted corresponding to functions (capabilities or structures) of the electronic device.

In operation S303 of fig. 3A, the second (#2) broadcast channel may be displayed on the screen, and the second sound corresponding to the second broadcast channel may be removed.

Referring to fig. 4C, the communicator 130 of the electronic device 100 may receive first control information from the remote controlling apparatus 200 under the control of the controller 110. The electronic apparatus 100 may receive the first control information output from the remote controlling device 200 through the communicator 130. Also, the electronic device 100 may receive the first control information output from the remote controlling apparatus 200 through the optical receiver 150.

The received first control information may be stored in the storage device 180 under the control of the controller 110.

The controller 110 of the electronic device 100 may display the second broadcast channel 450 on the screen according to the received first control information.

When the first control information is received, the controller 110 may receive a broadcast signal corresponding to the second broadcast channel through the first tuner. The controller 110 may output video corresponding to the second broadcast channel in the received broadcast signal on the display 170.

The controller 110 may display a second broadcast channel (e.g., a weather forecast 450) on the screen in response to the first control information. In response to the first control information (mute), the controller 110 may not output the second sound corresponding to the second broadcast channel through the speaker 176. Also, in response to the first control information, the controller 110 may not output a second sound corresponding to the second broadcast channel through the audio device 300.

In operation S304 of fig. 3A, a first sound corresponding to a first broadcast channel may be output through a speaker of the electronic device 100 and/or the audio device 300.

Referring to fig. 4C, the controller 110 may output a first sound 401a corresponding to a first broadcast channel (e.g., an advertisement slot in a program) through the speaker 176 using the second tuner in response to the first control information. Further, the controller 110 may output a first sound 401a corresponding to a first broadcast channel (e.g., an advertisement slot in a program) through the audio device 300 in response to the first control information.

Upon receiving the first control information, the controller 110 may receive a broadcast signal corresponding to a first broadcast channel (e.g., an advertisement slot in a program) through the second tuner. The controller 110 may not output the video corresponding to the first broadcast channel in the received broadcast signal. In addition, the controller 110 may store the video corresponding to the received first broadcast channel in the storage device 180.

While viewing the second broadcast channel, the user may confirm the status of the first broadcast channel 400 (e.g., check whether an advertisement slot in a program is being broadcast or a boxing match) from the first sound 400a output through the speaker 176.

The controller 110 may display a pop-up window 451 on the screen in response to the first control information. The pop-up window 451 may be displayed on one side (e.g., one of upper, lower, right, and left) of the screen. Further, the pop-up window 451 may be displayed at a corner of the screen (e.g., upper left, upper right, lower left, and lower right).

The size of the pop-up window 451 is smaller than the size of the screen. The size of the pop-up window 451 may be greater than 10% of the screen size and less than 50% of the screen size.

The pop-up window 451 may contain two buttons, "switch to channel" and "cancel," which allow the user to select to switch channel 451a (switch to the previous channel) or to select "cancel" to allow the user to cancel the pop-up window 451 b. The "switch to channel" button 451a may indicate a previous channel number (broadcast channel 400) and a current channel number (second broadcast channel 450) on the screen.

The pop-up window 451 may be displayed for a while when the sound reservation function is performed.

Due to the transparency of the pop-up window 451, the pop-up window 451 may overlap with a broadcast channel displayed on the electronic apparatus 100. The transparency may be established by, for example, the manufacturer or user as 1% to 99%.

Although fig. 4D shows and illustrates that the pop-up window 451 overlaps and is displayed on the image of the second broadcast channel 450, it is not limited thereto. For example, the pop-up windows 451 may be displayed on one side of the second broadcast channel 450 so as not to overlap with each other. Further, instead of the pop-up window 451, a smaller menu bar may be displayed on the lower boundary portion of the second broadcast channel 450.

In operation S305 of fig. 3A, "switch to a first broadcast channel" may be selected.

Referring to fig. 4C and 4D, the user may select "switch to the first broadcast channel".

The user may enter the second input 503 on the pointer button 201e of the remote controlling apparatus 200. The controller 210 of the remote controlling apparatus 200 may transmit second control information corresponding to the selection of the pointer button 201e to the electronic device 100.

The controller 210 of the remote controlling apparatus 200 may transmit the second control information corresponding to the selection of the pointer button 201e to the electronic device 100 through one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250. The second control information may be control information for displaying the pointer 100a on the screen of the electronic device 100.

The electronic device 100 may receive the second control information output from the remote controlling apparatus 200 through the communicator 230. Further, the electronic apparatus 100 may receive the second control information output from the remote controlling device 200 through the optical receiver 150.

The received second control information may be stored in the storage device 180 under the control of the controller 110.

The controller 110 of the electronic device 100 may display the pointer 100a on the screen by using the received second control information. The controller 110 may display the pointer 100a at an established position of the screen in the electronic device 100. For example, the established position may be a center area of a screen or a previous final pointer position in the electronic device 100. The storage device 180 may store the final pointer position under the control of the controller 110.

The size of the pointer 100a may be modified based on electronic device information corresponding to the electronic device 100. For example, the size of the pointer 100a may be modified according to the screen size or screen resolution of the electronic device 100.

The user may perform a first movement of the remote controlling apparatus 200 (e.g., from the first position 100a1 to the second position 100a2) to switch to the channel of the electronic device 100. The user may move the remote controlling apparatus 200 toward two axes or three axes. For example, the user may move the remote control device 200 (e.g., from 100a1 to 100a2) toward the X and Y axes, and/or X, Y and the Z axis. The remote control device 200 may be moved by a user toward three axes (e.g., X, Y and the Z-axis). For example, the remote controlling apparatus 200 may be moved to the lower right side by the user.

The first movement of the remote controlling apparatus 200 may be detected by the sensor 264. The first movement of the remote controlling apparatus 200 may be periodically detected by the sensor 264 (e.g., the sensor may detect a time interval of the first movement of the remote controlling apparatus 200). The sensor 264 may output an analog signal detected in response to a first movement of the remote controlling device 200 (e.g., from the first position 100a1 to the second position 100a2) to the controller 210. In addition, the analog signal detected from the sensor 264 may be converted to a digital signal with a converter. The digital signal may be output to the controller 210.

The storage 280 may store the detected analog signal or the converted digital signal under the control of the controller 210. The stored analog signal or digital signal will be named first movement information hereinafter. The stored first movement information may include a movement information Identifier (ID) for record management, a detected acceleration value (e.g., two axes or three axes) of the remote controlling apparatus 200, a detected movement time of the remote controlling apparatus 200, or a movement distance of the remote controlling apparatus 200.

The first movement information may be periodically stored from a first position 100a1 (e.g., a center region of a screen) to a second position 100a2 (e.g., switching to an inner region of the channel 451 a). The first movement information may be movement information stored according to a time interval when the movement of the remote controlling apparatus 200 can be detected by the resolution of the sensor 264.

The controller 210 may generate the third control information by using the stored first movement information. The controller 210 may generate the third control information by using the periodically stored first movement information. The third control information may be generated from the first position 100a1 to the second position 100a 2. The third control information may be control information that two-dimensionally moves the pointer 100a on the screen of the electronic device 100.

The third control information may include two-dimensional or three-dimensional third control information. The two-dimensional third control information may be third control information generated by excluding one axis from the movement of the remote control device 200.

The three-dimensional third control information may be third control information generated in response to movement of the remote controlling apparatus 200. The controller 210 may transmit at least one of two-dimensional and three-dimensional third control information to the electronic device 100.

The controller 210 may periodically transmit third control information generated from the first position 100a1 to the second position 100a2 to the electronic device 100.

The communicator 130 of the electronic device 100 may receive third control information from the remote controlling apparatus 200 under the control of the controller 110. The electronic apparatus 100 may receive the third control information output from the remote controlling device 200 through at least one of the communicator 130 and the optical receiver 150. The received third control information may be stored in the storage device 180 under the control of the controller 110.

The controller 110 may move the pointer 100a displayed on the screen of the electronic device 100 (e.g., from the first position 100a1 to the second position 100a2) by using the received third control information. The controller 110 may move the pointer 100a displayed on the screen two-dimensionally by using the received third control information.

The controller 110 may modify the moving speed of the pointer 100a in response to the received third control information. For example, when the user quickly moves the remote controlling apparatus 200, the controller 110 may quickly move the pointer 100a in response to the received third control information. Further, when the user slowly moves the remote controlling apparatus 200, the controller 110 may slowly move the pointer 100a in response to the received third control information.

When the pointer 100a is located at the second position 100a2 (e.g., to switch to a channel), the user may select the switch to the channel 451a by entering the third input 504 using the remote control device 200.

The controller 210 of the remote controlling apparatus 200 may transmit fourth control information corresponding to the third input 504 to the electronic device 100. The controller 210 of the remote controlling apparatus 200 may transmit fourth control information (e.g., the selection 504 of the pointer button 201 e) corresponding to the third input 504 to the electronic device 100 through at least one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250. Also, the controller 210 of the remote controlling apparatus 200 may transmit fourth control information (e.g., the selection 504 of the input button 201 g) corresponding to the third input to the electronic device 100 through at least one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250.

The fourth control information may be control information corresponding to switching to a channel on the screen of the electronic apparatus 100.

Although fig. 4D shows and illustrates the menu being selected by using the pointer, it is not limited thereto. For example, when the pop-up window 451 is displayed, one of the

menus

451a and 451b within the pop-up window 451, i.e., a switch to the channel 451a or a switch to the previous channel 451b, may be initially highlighted. When the user manipulates the direction button, another menu may be highlighted according to the direction button (e.g., cancel 451 c). When the user presses the enter button 201g, a highlighted menu may be selected.

When the switching to the first broadcast screen is not selected in operation S305 of fig. 3A, operation S307 of fig. 3A may be performed.

In operation S306 of fig. 3A, the first broadcast channel may be displayed on a screen of the electronic device, and the first sound may be continuously output through the speaker and/or the audio device 300.

Referring to fig. 4E, the communicator 130 of the electronic device 100 may receive fourth control information from the remote controlling apparatus 200 under the control of the controller 110. The electronic apparatus 100 may receive the fourth control information output from the remote controlling device 200 through the communicator 130.

The received fourth control information may be stored in the storage device 180 under the control of the controller 110.

The controller 110 of the electronic device 100 may display the first broadcast channel 402 on the screen by using the received fourth control information. The first broadcast channel 402 may correspond to the same channel (first broadcast channel 400), but to a different image of the first broadcast channel 400. For example, while the first broadcast channel 400 may display a second round of the boxing match, the first broadcast channel 402 may display a third round of the boxing match. The in-program ad slots 401 may be displayed at rest times between the second and third rounds.

When receiving the fourth control information, the controller 110 may receive a broadcast signal corresponding to the first broadcast channel through the first tuner. The controller 110 may output a video 402 corresponding to the first broadcast channel in the received broadcast signal on the display 170.

The controller 110 may continuously output the first sound 402a corresponding to the first broadcast channel through the speaker 176 in response to the fourth control information.

When receiving the fourth control information, the controller 110 may receive a broadcast signal corresponding to the first broadcast channel through one of the first tuner and the second tuner. The controller 110 may output a video 402 corresponding to the first broadcast channel in the received broadcast signal on the display 170.

In response to the fourth control information, the controller 110 may continuously output the first sound corresponding to the first broadcast channel through the speaker 176. Further, the controller 110 may continuously output the first sound 402a corresponding to the first broadcast channel to the audio device 300 in response to the fourth control information.

When receiving the fourth control information, the controller 110 may close the pop-up window 451 from the screen.

In operation S306 of fig. 3A, when a first broadcast channel is displayed on a screen of an electronic device and a first sound is output through a speaker, a method for controlling a sound of the electronic device may be completed.

Returning to operation S305 of fig. 3A, when the first broadcast channel is not selected, operation S307 of fig. 3A may be performed.

In operation S307 of fig. 3A, a reservation (stay) of the second broadcast channel may be selected.

Referring to fig. 4C and 4F, the reservation of the second broadcast channel may be selected by the user.

The user may enter a second input 503' on the pointer button 201e of the remote control device 200. The controller 210 of the remote controlling apparatus 200 may transmit second control information corresponding to the selection of the pointer button 201e to the electronic device 100.

The controller 110 of the electronic device 100 may display the pointer 100a on the screen by using the received second control information. The controller 110 may display the pointer 100a at an established position of the screen of the electronic device 100. For example, the established position may be a screen center area or a previous final pointer position in the electronic device 100. The storage device 180 may store the final pointer position under the control of the controller 110.

The size of the pointer 100a may be modified in response to electronic device information corresponding to the electronic device 100. For example, the size of the pointer 100a may be modified in response to the screen size or screen resolution of the electronic device 100.

The user may perform a second movement of the remote controlling apparatus 200 (e.g., from the first position 100a1 to the third position 100a3) to select the cancel button 451 b. The user may move the remote controlling apparatus 200 toward two axes or three axes. For example, the user may move the remote control device 200 (e.g., from 100a1 to 100a3) toward the X and Y axes, and/or X, Y and the Z axis. The remote controlling apparatus 200 may be moved toward three axes (e.g., X, Y and the Z-axis) opposite to the electronic device 100 by the user. For example, the remote controlling apparatus 200 may be moved toward the lower right side by the user.

The second movement of the remote controlling apparatus 200 may be detected by the sensor 264. The second movement of the remote controlling apparatus 200 may be periodically detected by the sensor 264 (e.g., the sensor may detect a time interval of the second movement of the remote controlling apparatus 200). The sensor 264 may output an analog signal detected in response to the second movement of the remote controlling device 200 (e.g., from the first position 100a1 to the third position 100a3) to the controller 210. Further, the analog signal output from the sensor 264 may be converted to a digital signal by a converter. The converted digital signal may be output to the controller 210.

The storage 280 may store the detected analog signal or the converted digital signal under the control of the controller 210. The stored analog signal or digital signal will be named as second movement information hereinafter. The stored second movement information may include a movement information Identifier (ID) for record management, a detected acceleration value (e.g., two axes or three axes) of the remote controlling apparatus 200, a detected movement time of the remote controlling apparatus 200, or a movement distance of the remote controlling apparatus 200.

The second movement information may be periodically stored from the first position 100a1 (e.g., a central area of the screen) to the third position 100a3 (e.g., an inner area within the cancellation or reservation of the second broadcast channel 451 b) of the remote controlling apparatus 200. The second movement information may be movement information stored in response to a time interval in which the movement of the remote controlling apparatus 200 can be detected with the resolution of the sensor 264.

The controller 210 may generate the fifth control information by using the stored second movement information. The controller 210 may generate the fifth control information by using the periodically stored second movement information. The fifth control information may be generated from the first position 100a1 to the third position 100a 3. The fifth control information may be control information to move the pointer 100a toward the two-dimensional area on the screen of the electronic device 100.

The fifth control information may include two-dimensional or three-dimensional fifth control information. The two-dimensional fifth control information may be fifth control information generated by excluding one axis from the movement of the remote control device 200.

The three-dimensional fifth control information may be fifth control information generated in response to the movement of the remote controlling apparatus 200. The controller 210 may transmit at least one of two-dimensional and three-dimensional fifth control information to the electronic apparatus 100.

The controller 210 may periodically transmit fifth control information generated from the first position 100a1 to the third position 100a3 of the remote controlling apparatus 200 to the electronic device 100.

The communicator 130 of the electronic device 100 may receive fifth control information from the remote controlling apparatus 200 under the control of the controller 110. The electronic apparatus 100 may receive the fifth control information output from the remote controlling device 200 through the communicator 130. The received fifth control information may be stored in the storage device 180 under the control of the controller 110.

The controller 110 may move the pointer 100a displayed on the screen of the electronic device 100 (e.g., from the first position 100a1 to the third position 100a3) by using the received fifth control information. The controller 110 may two-dimensionally move the pointer 100a displayed on the screen by using the received fifth control information.

The controller 100 may modify the moving speed of the pointer 100a in response to the received fifth control information. For example, when the user rapidly moves the remote controlling apparatus 200, the controller 110 may rapidly move the pointer 100a in response to the received fifth control information. Further, when the user slowly moves the remote controlling apparatus 200, the controller 110 may slowly move the pointer 100a in response to the received fifth control information.

When the pointer 100a is located at the third position 100a3 (e.g., cancel), the user may select the cancel 451b by performing the fourth input 505 using the remote control device 200.

The controller 210 of the remote controlling apparatus 200 may transmit a sixth control signal corresponding to the fourth input 505 to the electronic device 100. The controller 210 of the remote controlling apparatus 200 may transmit sixth control information corresponding to a fourth input (e.g., selection 504 of the pointer button 201 e) to the electronic device 100 through at least one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250. Also, the controller 210 of the remote controlling apparatus 200 may transmit sixth control information corresponding to a fourth input (e.g., selection 504 of the input button 201 g) to the electronic device 100 through at least one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250.

The sixth control information may be control information corresponding to a selection of cancellation (or reservation of the second broadcast channel) on the screen of the electronic device 100.

In operation S308 of fig. 3A, the second broadcast channel may be displayed on a screen of the electronic device, and the second sound may be output through the speaker and/or the audio device 300.

Referring to fig. 4G, the communicator 130 of the electronic device 100 may receive sixth control information from the remote controlling apparatus 200 under the control of the controller 110. The electronic apparatus 100 may receive the sixth control information output from the remote controlling device 200 through the communicator 130. The received sixth control information may be stored in the storage device 180 under the control of the controller 110.

The controller 110 of the electronic device 100 may continuously display the second broadcast channel 450 on the screen using the received sixth control information.

When receiving the sixth control information, the controller 110 may receive a broadcast signal corresponding to the second broadcast channel through the second tuner. The controller 110 may continuously output video corresponding to the second broadcast channel in the received broadcast signal on the display 170.

The controller 110 may output a second sound 450a corresponding to the second broadcast channel 450 through the speaker 176 in response to the sixth control information.

When receiving the sixth control information, the controller 110 may receive a broadcast signal corresponding to the second broadcast channel through one of the first tuner and the second tuner. The controller 110 may output a video 450 corresponding to the second broadcast channel in the received broadcast signal on the display 170.

The controller 110 may output a second sound 450a corresponding to the second broadcast channel through the speaker 176 in response to the sixth control information. Further, the controller 110 may output a second sound corresponding to the second broadcast channel to the audio device 300 in response to the sixth control information.

When receiving the sixth control information, the controller 110 may close the pop-up window 451 from the screen.

In operation S308 of fig. 3A, when the second broadcast channel is displayed on the screen of the electronic apparatus and the second sound is output through the speaker, the method for controlling the sound of the electronic apparatus may be completed.

Fig. 3B is a flowchart illustrating a method for controlling sound of an electronic device according to an exemplary embodiment.

Fig. 5A to 5D are diagrams schematically illustrating an example of a method for controlling sound of an electronic device according to an exemplary embodiment.

In operation S311 of fig. 3B, the #11 broadcast channel may be displayed on the screen of the electronic apparatus, and the #11 sound corresponding to the #11 broadcast channel may be output through the internal speaker 176 and the audio apparatus 300.

Referring to fig. 5A, the electronic device 100 may display a #11 broadcast channel 410 (e.g., a boxing match) on the display 170 under the control of the controller 110 and output a #11 sound 410a corresponding to the #11 broadcast channel through the internal speaker 176 and the audio device 300. The #11 broadcast channel 410 displayed on the screen may be selected by a user input inputted through one of the remote controlling apparatus 200 and the electronic device 100. The audio device 300 may be an external speaker.

In response to the selection of the #11 broadcast channel by the user, the controller 110 may receive a broadcast signal corresponding to the #11 broadcast channel through the first tuner. The controller 110 may output video corresponding to the #11 broadcast channel in the received broadcast signal on the display 170. The controller 110 may output audio corresponding to the #11 broadcast channel in the received broadcast signal through the internal speaker 176.

The remote controlling apparatus 200 may include a power button 201a, a volume removal button 201b, a volume adjustment button 201c, a channel change button 201d, a pointer button 201e, a direction button 201f, and/or an input button 201 g. The remote controlling apparatus 200 may include other various buttons than the above-described buttons (e.g., 201a to 201g or sound reservation buttons).

Also, the electronic device 100 may transmit the #11 sound 410a corresponding to the #11 broadcast channel to the audio device 300 in a wired or wireless manner under the control of the controller 110.

The controller 310 of the audio device 300 may receive the #11 sound 410a corresponding to the #11 broadcast channel transmitted from the electronic device 100 through the communicator 330 and/or one of the input/output interfaces 360. The controller 310 of the audio device 300 may output the received #11 sound 410a through the speaker 375. Also, the storage 380 may store the received #11 sound under the control of the controller 310.

In operation S312 of fig. 3B, #11 input may be received from the audio device (external speaker) 300, and #12 input may be received from the remote controlling apparatus 200.

Referring to fig. 5B, an advertisement slot 411 in a program may be displayed on the electronic device 100 during the boxing match 410. When an advertisement slot in a program is displayed, a sound 411a corresponding to the advertisement slot 411 in the program may be output.

When the in-program advertisement slot 411 is displayed on the electronic device 100, the user can perform the #11 input 510 on the audio device 300 and the #12 input 511 on the channel change button 201d of the remote controlling apparatus 200 according to the sound reservation function implemented in the electronic device 100. The #11 input 510 may be detected by the sensor 365 of the audio device 300. For example, #11 input 510 may be detected by a near field sensor or an illuminance sensor as one of sensors 365. In addition, #11 input 510 may be detected by a separate button (e.g., a volume-off button) on the front of audio device 300.

The #12 input 511 may include a selection of the channel change button 201d of the remote controlling apparatus 200. Further, #12 input 511 may include a selection of a number button corresponding to a broadcast channel number on remote control device 200.

According to an exemplary embodiment, the sound reservation function is used to change the #11 broadcast channel displayed on the screen of the electronic device 100 to the #12 broadcast channel and maintain the output of the sound corresponding to the #11 broadcast channel instead of the sound corresponding to the #12 broadcast channel. For example, #11 broadcast channel 410 (e.g., a boxing match for a sports channel) may display in-program advertisement slots 411 on the screen of the electronic device 100.

When the in-program advertisement slot 411 is displayed on the electronic device 100, the user may change the #11 broadcast channel to the #12 broadcast channel 460 (e.g., weather forecast). When changing to the #12 broadcast channel 460, the controller 110 of the electronic device 100 may output a sound corresponding to the #12 broadcast channel 460 through the speaker 176 of the electronic device 100.

The controller 310 of the audio device 300 may transmit a #11 control signal corresponding to the #11 input 510 to the electronic device 100. The controller 210 of the remote controlling apparatus 200 may transmit #12 control information corresponding to the selection of the channel change button 201d through one of the communicator 230 and the optical transmitter 250.

The reception of the #11 and #12 control information may be control information that displays the #12 broadcast channel on the screen of the electronic device 100, outputs the #11 sound corresponding to the #11 broadcast channel through the internal speaker 176, and outputs the sound corresponding to the #11 broadcast channel through the audio device 300.

When the #11 control information is transmitted through the near field communicator (e.g., bluetooth), the controller 210 of the remote controlling apparatus 200 may transmit the #11 control information to the electronic device 100 in a bluetooth packet.

The bluetooth packet may include an access code (72 bits), a header (54 bits), and a payload (0-2745 bits) for determining the validity of the packet. The access code may be used to determine the validity of the packet. The header may include a MAC address and a packet type. The payload may include transmitted data and the size may be modified according to the type of packet transmitted. The transmitted first control information may be included in a payload of the packet.

When the audio device 300 and the electronic device 100 are initially connected to each other, the controller 310 of the audio device 300 may search for the electronic device 100 by using a near field communicator (e.g., bluetooth). The controller 310 may request a query and connection page from the electronic device 100. Further, when the audio device 300 and the electronic device 100 are initially connected to each other, the controller 210 of the remote controlling apparatus 200 may be connected to the electronic device 100 by using an advertisement packet received via a near field communicator (e.g., bluetooth low energy).

The storage 380 may store electronic device connection information corresponding to the electronic device 100 connected to the audio device 300 under the control of the controller 310. The stored electronic device connection information may include an SSID, a MAC address, operational information (e.g., busy or standby), or contextual information.

The controller 310 of the audio device 300 may transmit the #11 control information to the electronic device 100 through one of the communicator 330 and the input/output interface 360 by using the stored electronic device connection information.

The controller 210 of the remote controlling apparatus 200 may transmit the #12 control information to the electronic device 100 through at least one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250.

Operation S312 of fig. 3B is substantially similar to operation S302 of fig. 3A, in operation S312 of fig. 3B, the controller 210 of the remote controlling apparatus 200 transmits #12 control information to the electronic device 100 through at least one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250, and in operation S302 of fig. 3A, the first control information is transmitted through at least one of the wireless LAN communicator 231, the near field communicator 232, and the optical transmitter 250 of the remote controlling apparatus 200.

In operation S313 of fig. 3B, a #12 broadcast channel may be displayed on the screen and a #12 sound corresponding to the #12 broadcast channel may be output.

Referring to fig. 5C, the communicator 130 of the electronic device 100 may receive #11 control information from the audio device 300 under the control of the controller 110. The electronic device 100 may receive #12 control information from the remote controlling apparatus 200 through the communicator 130. The received #11 control information and/or the received #12 control information may be stored in the storage device 180 under the control of the controller 110.

The controller 110 of the electronic device 100 may display the #12 broadcast channel 460 on the screen by using the received #11 and #12 control information.

When receiving the #11 and #12 control information, the controller 110 may receive a broadcast signal corresponding to the #12 broadcast channel through the first tuner. The controller 110 may output video corresponding to the #12 broadcast channel in the received broadcast signal on the display 170.

The controller 110 may display a #12 broadcast channel 460 (e.g., a weather forecast) on the screen in response to the #11 and #12 control information. Further, the controller 110 may output a #12 sound 460a corresponding to a #12 broadcast channel through the internal speaker 176 in response to the #11 and #12 control information.

In operation S314 of fig. 3B, the #11 sound corresponding to the #11 broadcast channel may be continuously output in the audio device 300.

Referring to fig. 5C, when receiving the #11 and #12 control information, the controller 110 may receive a broadcast signal corresponding to the #11 broadcast channel 411 (e.g., an advertisement slot in a program) through the second tuner. The controller 110 may output the #11 sound 411a corresponding to the #11 broadcast channel to the audio device 300 in response to the #11 and #12 control information.

The controller 110 may not output the video corresponding to the #11 broadcast channel in the received broadcast signal. Further, the controller 110 may store the video corresponding to the received #11 broadcast channel in the storage device 180. The controller 110 may store video, audio, and additional data corresponding to the received #11 broadcast channel in the storage device 180.

In operation S315 of fig. 3B, #13 input may be received from the audio device.

Referring to fig. 5C, the user may perform #13 input 512 on the audio device 300.

The #13 input 512 may be detected by the sensor 365 of the audio device 300. For example, the #13 input 512 may be detected by a near field sensor or an illuminance sensor, which is one of the sensors 365. In addition, #13 input 512 may be detected by a button (e.g., a volume-off button) on the front of audio device 300.

The #13 input 512 on the audio device 300 may be a toggle switch function of the #11 input 510. For example, when #11 input 510 is implementing a sound retention function, the #13 input may turn off the sound retention function.

The controller 310 of the audio device 300 may transmit a #13 control signal corresponding to the #13 input 512 to the electronic device 100.

The reception of the #13 control information by the electronic device 100 may be control information corresponding to the turning off of the sound reservation function. For example, it may be that a #11 broadcast channel 412 is displayed on the screen of the electronic device 100, a #11 sound 411a corresponding to the #11 broadcast channel is output through the internal speaker 176, and control information of the #11 sound 411a corresponding to the #11 broadcast channel is output through the audio device 300.

The controller 310 of the audio device 300 may transmit the #13 control information to the electronic device 100 by using the stored electronic device connection information.

Operation S315 of fig. 3B is substantially similar to operation S312 of fig. 3B, and in operation S315 of fig. 3B, the audio device 300 transmits #13 control information to the electronic device 100, and in operation S312 of fig. 3B, the audio device 300 transmits #11 control information to the electronic device 100.

In operation S316 of fig. 3B, the #11 broadcast channel may be displayed on the screen of the electronic device, and the #11 sound corresponding to the #11 broadcast channel may be output through the internal speaker and the audio device.

Referring to fig. 5D, the communicator 130 of the electronic device 100 may receive #13 control information from the audio device 300 under the control of the controller 110. The received #13 control information may be stored in the storage device 180 under the control of the controller 110.

The electronic device 100 may display a #11 broadcast channel 412 (e.g., boxing match) on the display 170 under the control of the controller 110 and output a #11 sound 412a corresponding to the #11 broadcast channel through the internal speaker 176 and the audio device 300. The #11 broadcast channel 412 displayed on the screen may be selected by a user input through one of the remote controlling apparatus 200 and the electronic device 100. When receiving the #13 control signal, the controller 110 may receive a broadcast signal corresponding to the #11 broadcast channel through the first tuner. The controller 110 may output video corresponding to the #11 broadcast channel in the received broadcast signal on the display 170. The controller 110 may output audio corresponding to the #11 broadcast channel in the received broadcast signal through the internal speaker 176. Further, the controller 110 of the electronic device 100 may transmit the #11 sound 412a corresponding to the #11 broadcast channel to the audio device 300 in a wired or wireless manner. The controller 310 of the audio device 300 may continuously output the #11 sound 412 a.

When the first tuner receives video, audio and/or additional data corresponding to the #11 broadcast channel, the controller 110 may stop the operation of the second tuner.

In operation S316 of fig. 3B, when the #11 broadcast channel is displayed on the screen of the electronic device and the #11 sound is output through the internal speaker 176 and the audio device 300, the method for controlling the sound of the electronic device may be completed.

Fig. 3C is a flowchart briefly illustrating a method for controlling a sound of an electronic device according to an exemplary embodiment.

Fig. 6A to 6H are diagrams schematically illustrating an example of a method for controlling sound of an electronic device according to the present embodiment. Fig. 6A to 6H illustrate a case where the electronic apparatus is configured as a portable telephone.

In operation S321 of fig. 3C, the #21 content may be displayed on the screen of the electronic device, and the #21 sound corresponding to the #21 content may be output through the speaker.

Referring to fig. 6A, the electronic device 100' may display a #21 content 420 on a screen (or a display 170) under the control of the controller 110 and output a #21 sound 420a corresponding to the #21 content through the speaker 176. The user can select the #21 content 420 displayed by the video player, which is one of the applications. Content #21 may be a boxing match.

In response to selection of the #21 content 420, the controller 110 may display the #21 content 420 on the screen and output the #21 sound 420a through the speaker 176.

Electronic device 100' may include a home button 165a, a recently implemented applications button 165b, and/or a back button 165 c.

In operation S322 of fig. 3C, a #21 input 520 may be received from the #21 button of the electronic device.

Referring to fig. 6B, a #21 input may be received from the #21 button 165a of the electronic device 100'.

The user may perform the #21 input 520 on the #21 button 165a of the electronic device 100'. The #21 input 520 may be a long touch (long touch). A long touch may indicate that the touch to the #21 button 165a is maintained for a preset time (e.g., more than three seconds, modifiable). Further, the #21 button may include one of the most recently implemented application button 165b and the return button 165c in addition to the home button.

The controller 110 may store #21 input information corresponding to the detected #21 input 520 in the storage device 180. The stored #21 input information may include a touch Identifier (ID), a button name (or a button code), a touch hold time, a touch position, or a touch detection time for record management.

In operation S323 of fig. 3C, a pop-up window may be displayed on the screen of the electronic device.

Referring to fig. 6C, the controller 110 may display a pop-up window 421 according to the #21 input on the screen of the electronic device 100'. The pop-up window 421 may correspond to a sound reservation operation of the electronic device 100'.

The pop-up window 421 may be displayed on one side (e.g., one of upper, lower, right, and left) of the screen. Further, the pop-up window 421 may be displayed at a corner (e.g., upper left corner region, upper right corner region, lower left corner region, and lower right corner region).

The size of the pop-up window 421 may be smaller than the size of the screen. The size of the pop-up window 421 may be greater than 5% of the screen size and less than 50% of the screen size.

The pop-up window 421 may include an implementation 421a of sound reservation and/or a cancellation 421b of sound reservation selectable by the user.

The pop-up window 421 is transparent and thus may overlap with the #21 content 420 displayed on the electronic device 100'. The transparency may be established by, for example, the manufacturer or user as 1% to 99%.

Referring to fig. 6G, the controller 110 may display a floating button (floating button)421 'in response to #21 input on the screen of the electronic device 100', according to an embodiment. The float button 421 'may correspond to a sound reservation of the electronic device 100'. For example, the float button 421' may be a play or reproduction button. When the user selects the float button 421', the controller 110 may continuously output the #21 sound 420a through the speaker 176 in response to the selection of the float button 421'.

The float button 421' may be displayed on one side (e.g., one of upper, lower, right, and left) of the screen. In addition, the float button 421' may be displayed in one of the corner regions (e.g., upper left corner region, upper right corner region, lower left corner region, and lower right corner region).

Due to its transparency, the floating button 421 'may overlap with the #21 content 420 displayed on the electronic device 100'. The transparency may be established by, for example, the manufacturer or user as 1% to 99%.

In operation S324 of fig. 3C, a #22 input may be received through the pop-up window.

Referring to fig. 6C, the user may perform the #22 input 521 (or the #22 touch) on the sound reserved implementation 421a of the pop-up window 421.

The controller 110 may detect the #22 input 521 from the implementation 421a of sound retention through the pop-up window 421 by using a touch screen and a touch screen controller. The controller 110 may calculate the #22 touch position 521a (e.g., X21 coordinates and Y21 coordinates) corresponding to the #22 input 521 detected from the implementation 421a of sound reservation through the pop-up window 421 by using the electrical signal received from the touch screen controller.

The controller 110 may store the #22 touch position information corresponding to the #22 touch position 521a in the storage device 180. The stored #22 touch position information may include a touch Identifier (ID), a touch position, a touch detection time or touch information (e.g., touch pressure, touch direction and touch hold time) for record management.

Referring to fig. 6H, the controller 110 may display a floating button 424 'on the screen of the electronic device 100', according to an embodiment. The float button 424 'may correspond to the sound content switched to the electronic device 100'. For example, the float button 424' may be a stop button. When the user selects 522' float button 424' (e.g., clicks or double-clicks), the controller 110 may display the #21 content 420 on the screen in response to the selection of the float button 424' and continuously output the #21 sound 420a through the speaker 176.

The float button 424' may be displayed on one side (e.g., one of the top, bottom, right, and left sides) of the screen. In addition, the float button 424' may be displayed in one of the corner regions (e.g., upper left corner region, upper right corner region, lower left corner region, and lower right corner region).

Due to its transparency, the float button 424 'may overlap with the #21 content 420 displayed on the electronic device 100'. The transparency may be established by, for example, the manufacturer or user as 1% to 99%.

In operation S325 of fig. 3C, #21 sound may be continuously output through the speaker.

Referring to fig. 6D, the controller 110 may continuously output the #21 sound 420a through the speaker 176 in response to the #22 input 521. The controller 110 may output the #21 sound 420a through the speaker 176 until another user input is received.

In operation S326 of fig. 3C, another application may be displayed on the screen of the electronic device.

Referring to fig. 6D, the controller 110 may display another application (e.g., a web browser 422) on the screen. The user may select web browser 422 in the displayed application using the most recently implemented application button 165 b. Further, the user can select another application among the plurality of applications displayed using the most recently implemented application button 165 b.

The controller 110 may display a web browser 422 (e.g., news site) on the display 170 and continuously output a #21 sound 420a through the speaker 176.

The user can confirm the state of the #21 content 420 corresponding to the #21 sound 420a through the speaker 176 while watching news.

In operation S327 of fig. 3C, a #23 input may be received from the notification bar.

Referring to fig. 6E, the controller 110 may display a notification bar 423. The user may perform a touch gesture (e.g., drag, tap, and slide, not shown) from the upper side of the screen to the screen direction. The controller 110 may display the notification bar 423 in response to the touch gesture. The controller 110 may display the notification bar 423 to overlap with the web browser 422.

On the lower side of the notification bar 423, a notification area 424 corresponding to the sound reservation may be displayed. The notification area 424 may include a switch to a sound content 424a selectable by the user and a cancellation 424b of the sound content.

The controller 110 may detect the #23 input 522 by switching to the sound content 424a of the notification region 424 using the touch screen controller. The controller 110 may calculate a #23 touch position 522a (e.g., X23 coordinates and Y23 coordinates) corresponding to the #23 input 522 detected from the sound content 424a switched to the notification area 424 within the notification bar 423 by using the electrical signal received from the touch screen controller.

The controller 110 may store #23 touch position information corresponding to the #23 touch position 522a in the storage device 180. The stored #23 touch position information may include a touch Identifier (ID), a touch position, a touch detection time or touch information (e.g., touch pressure, touch direction and touch hold time) for record management.

In operation S328 of fig. 3C, the return to #21 content may be output on the screen of the electronic device in response to the #23 input, and the #21 sound corresponding to the #21 content may be output through the speaker.

Referring to fig. 6F, the controller 110 may return the #21 content 420 on the display 170 of the electronic device 100' and output the #21 sound 420a corresponding to the #21 content through the speaker 176 in response to the #23 input 522. The #21 content 420 may be included in the #21 content 420. When the #21 content 420 is reproduced, a new #21 content can be displayed.

When the electronic device 100' stands toward a vertical portrait (portrait), the controller 110 may modify the orientation of the #21 content 420 to a portrait orientation in response to the screen orientation.

In operation S328 of fig. 3C, when the #21 content is displayed on the screen of the electronic device 100' and the #21 sound corresponding to the #21 content is output through the speaker 176, the method for controlling the sound of the electronic device may be completed.

Fig. 3D is a flowchart illustrating a method for controlling sound of an electronic device according to an exemplary embodiment.

In operation S331 of fig. 3D, #31 content may be displayed on a screen of the electronic apparatus, and #31 sound corresponding to the #31 content may be output through a speaker.

Referring to fig. 7A, the electronic device 100' may display a #31 content 430 on a screen (or a display 170) under the control of the controller 110 and output a #31 sound 430a corresponding to the #31 content through a speaker 176. The content list 431 (e.g., a video list) and video sites that can reproduce the selected content may be displayed on the screen of the electronic device 100' through a web browser. The user can select one content (e.g., #31 content 430) on the content list 431. The #31 content 430 may be a concert content.

In response to the user's selection of the #31 content 430, the controller 110 may display the #31 content 430 on one side of the screen and output the #31 sound 430a through the speaker 176.

In operation S332 of fig. 3D, the #31 input may be received by selecting one content of the content list.

Referring to fig. 7B, the #31 input 531 may be received by selecting one content of the content list 431 (e.g., #32 content 432).

The user may perform #31 input 530 on one content (e.g., #32 content 432). For example, #31 input 530 may be a long tap or a double tap. A long touch may correspond to holding the touch to the #32 content 432 for a preset time (e.g., more than three seconds, modifiable).

The controller 110 may detect the #31 input 530 by using a touch screen and a touch screen controller. The controller 110 may calculate the #31 touch position 530a (e.g., X31 coordinates and Y31 coordinates) corresponding to the #31 input 530 by using the electrical signals received from the touchscreen controller.

The controller 110 may store #31 touch position information corresponding to the #31 touch position 530a in the storage device 180. The stored #31 touch position information may include a touch Identifier (ID), a touch position, a touch detection time or touch information (e.g., touch pressure, touch direction and touch hold time) for record management.

In operation S333 of fig. 3D, the #32 content may be reproduced on the screen, and the #31 sound corresponding to the #31 content may be output through the speaker.

Referring to fig. 7C, the controller 110 may reproduce the #32 content 432 instead of the #31 content 430 and output the #31 sound 430a corresponding to the #31 content 430 in response to the #31 input.

In operation S324 of fig. 3D, a pop-up window corresponding to the #31 input may be displayed on the screen of the electronic device.

Referring to fig. 7C, the controller 110 may display a pop-up window 434 in response to the #31 input 530 on the screen of the electronic device 100'. The pop-up window 434 may correspond to a sound reservation of the electronic device 100'.

The pop-up window 434 may be displayed on one side (e.g., one of the top, bottom, right, and left sides) of the screen. Further, the pop-up window 434 may be displayed in one of the corner regions on the screen (e.g., upper left corner region, upper right corner region, lower left corner region, and lower right corner region).

The size of the pop-up window 434 may be smaller than the size of the screen. The size of the pop-up window 434 may be greater than 5% of the screen size and less than 50% of the screen size.

The pop-up window 434 may include a switch to audio content 434a and/or a cancellation of audio retention 434b selectable by the user.

The pop-up window 434 may overlap the content list 431 due to transparency. The transparency may be established by, for example, the manufacturer or user as 1% to 99%.

In operation S335 of fig. 3D, a #32 input may be received through a pop-up window.

Referring to fig. 7C, the user may perform a #32 input 531 (or a #32 touch) on the sound content 434a switched to the pop-up window 434.

The controller 110 can detect the #32 input 531 from the sound content 434a switched to the pop-up window 434 by using the touch screen and the touch screen controller. The controller 110 may calculate a #32 touch position 531a (e.g., X32 coordinates and Y32 coordinates) corresponding to the #32 input 531 detected from the sound content 434a switched to the pop-up window 434 by using the electric signal received from the touch screen controller.

The controller 110 may store the #32 touch information corresponding to the #32 touch position 531a in the storage 180. The stored #32 touch position information may include a touch Identifier (ID), a touch position, a touch detection time or touch information (e.g., touch pressure, touch direction and touch hold time) for record management.

In operation S336 of fig. 3D, the #31 sound may be continuously output through the speaker.

Referring to fig. 7D, the controller 110 may continuously output the #31 sound 430a through the speaker 176 in response to the #32 input 531. The controller 110 may output the #31 sound 430a through the speaker 176 until another user input is received.

In operation S326 of fig. 3D, #31 content may be displayed on the screen.

Referring to fig. 7D, the controller 110 may return the #31 content 430 on the display 170 of the electronic device 100' and continuously output the #31 sound 430a corresponding to the #31 content through the speaker 176 in response to the #32 input 531.

In operation S337 of fig. 3D, when the #31 content is displayed on the screen of the electronic device 100' and the #31 sound corresponding to the #31 content is output through the speaker 176, the method for controlling the sound of the electronic device may be completed.

The method according to the embodiment may be configured as a computer program or a program command format that can be executed via a computer, a processor, an integrated circuit, or the like and stored in a non-transitory computer-readable recording medium.

The non-transitory computer-readable recording medium indicates a medium that semi-permanently stores data and can be read by a device, not a medium that temporarily stores data, such as a register, a cache, or a memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory computer-readable recording medium, such as a CD, a DVD, a hard disk, a blu-ray disc, a USB, a memory card, or a ROM.

Furthermore, the foregoing exemplary embodiments and advantages are merely exemplary and are not to be construed as limiting the exemplary embodiments. The present teachings can be readily applied to other types of apparatuses. Furthermore, the description of the exemplary embodiments of the present disclosure is intended to be illustrative, and not to limit the scope of the claims.

Industrial applicability

-

Free text listing sequence

-

Claims

1. An electronic device, comprising:

a receiver;

a display;

a speaker;

a communicator configured to receive information from a remote control apparatus; and

a controller configured to:

the control receiver receives first content and first sound corresponding to the first content from a first broadcast channel,

controlling the display to display the first content on an entire screen of the display, and controlling the speaker to output the first sound,

receiving first control information from the remote control apparatus through the communicator while displaying the first content and outputting the first sound, controlling the receiver to receive the second content and a second sound corresponding to the second content from the second broadcast channel while maintaining the reception of the first content and the first sound from the first broadcast channel,

the first control information includes a combined control command input through a channel change button and a sound hold button included in the remote controlling apparatus for:

changing the display of the first content of the first broadcast channel to the display of the second content of the second broadcast channel, an

Continuing to output the first sound corresponding to the first broadcast channel, an

Controlling the display to display the second content on the entire screen of the display instead of displaying the first content, and controlling the speaker to output the first sound without outputting the second sound based on the combined control command,

wherein the controller is further configured to:

controlling the display to display a User Interface (UI) for displaying the first content while displaying the second content and outputting the first sound, and

based on a user command to select the UI, the display is controlled to display the first content on the entire screen of the display instead of displaying the second content, and the speaker is controlled to continue outputting the first sound.

2. The electronic device of claim 1, wherein the communicator includes an optical receiver, and

wherein the controller is configured to control the optical receiver to receive the first control information.

3. The electronic device of claim 1, wherein the controller is configured to control the display to display a pop-up window with the second content in response to the communicator receiving the first control information.

4. The electronic device of claim 3, wherein the controller is configured to control the display to display a pop-up window overlapping the second content in response to the communicator receiving the first control information.

5. The electronic apparatus of claim 1, wherein the controller is configured to control the display to display a pointer movable on the display in accordance with movement of the remote control device in response to the communicator receiving second control information from the remote control device.

6. The electronic device of claim 5, wherein the communicator includes an optical receiver, and

wherein the controller is configured to control the optical receiver to receive the second control information.

7. The electronic apparatus of claim 5, wherein the second control information comprises control information corresponding to movement of the remote control device.

8. The electronic apparatus of claim 5, wherein the controller is configured to control the display to display the first content and the speaker to continuously output the first sound in response to the communicator receiving third control information received from the remote control device.

9. The electronic apparatus of claim 5, wherein the controller is configured to control the display to continuously display the second content and the speaker to output the second sound corresponding to the second content in response to the communicator receiving fourth control information received from the remote control device.

10. The electronic device of claim 1, wherein the controller is configured to control an external speaker connected to the electronic device in a wired or wireless manner to output the first sound.