KR102269849B1 - Apparatus and method for controlling the same - Google Patents

Abstract

The electronic device according to the present invention may transmit a sound wave signal in an inaudible frequency region using a microphone and a speaker. More specifically, the electronic device according to the present invention has a function according to the sound wave signal when the speaker, the microphone for receiving the sound wave signal generated by the first device, and identification information corresponding to the sound wave signal match the preset identification information. and, when the identification information corresponding to the sound wave signal does not match the preset identification information, using the speaker so that the function according to the sound wave signal is executed in a second device different from the first device It characterized in that it comprises a control unit for transmitting the sound wave signal to the second device.

Description

Electronic device and its control method {APPARATUS AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to an electronic device capable of performing communication using a sound wave signal and a method for controlling the same.

The terminal may be divided into a mobile/portable terminal and a stationary terminal according to whether the terminal can be moved. Again, the mobile terminal can be divided into a handheld terminal and a vehicle mounted terminal depending on whether the user can carry it directly.

The functions of mobile terminals are diversifying. For example, there are functions for data and voice communication, photo and video shooting through a camera, voice recording, music file playback through a speaker system, and an image or video output to the display unit. Some terminals add an electronic game play function or perform a multimedia player function. In particular, recent mobile terminals can receive multicast signals that provide broadcast and visual content such as video or television programs.

As such a terminal is diversified in functions, for example, in the form of a multimedia player equipped with complex functions such as taking pictures or videos, playing music or video files, playing games, and receiving broadcasts. is being implemented.

In order to support and increase the function of the terminal, it may be considered to improve the structural part and/or the software part of the terminal.

Meanwhile, in addition to performing wireless communication, electronic devices may perform sound wave communication using a microphone and a speaker. As described above, communication using the sound wave signal has the advantage that communication between all electronic devices having a microphone and a speaker is possible in that a separate wireless communication unit is not required, but when the user can hear the sound wave signal, noise There are disadvantages in that there is a problem of occurrence and security problems.

Accordingly, one object of the present invention is to provide an electronic device capable of performing communication using a sound wave signal including an inaudible frequency region and a control method thereof.

In order to achieve the object of the present invention, an electronic device according to an embodiment of the present invention includes a speaker, a microphone for receiving a sound wave signal generated by the first device, and identification information corresponding to the sound wave signal preset identification information In the case of matching with, the function according to the sound wave signal is executed, and when the identification information corresponding to the sound wave signal does not match the preset identification information, the function according to the sound wave signal is different from the first device. and a control unit that transmits the sound wave signal to the second device using the speaker to be executed in the device.

In one embodiment, the control unit, after the sound wave signal is received, a new sound wave signal is received through the microphone, the identification information corresponding to each of the sound wave signal and the new sound wave signal is the preset identification information and In the case of matching, if the function according to the new sound wave signal is the same as the function according to the sound wave signal, execution of the function according to the new sound wave signal may be restricted.

In one embodiment, when the identification information corresponding to the sound wave signal does not match the preset identification information, the control unit processes the sound wave signal so that the preset identification information is included in the sound wave signal, and the The processed sound wave signal may be transmitted to the second device.

In one embodiment, the control unit, when the identification information corresponding to the sound wave signal does not match the preset identification information, analyzes the sound wave signal, the sound wave signal before the sound wave signal is received through the microphone The speaker may be controlled to limit the transmission of the sound wave signal when the information on the signal transmission path is identified, and the preset identification information is included in the transmission path information.

In an embodiment, when a feedback sound wave signal notifying execution of a function according to the sound wave signal is received from the second device through the microphone, the control unit transmits the feedback sound wave signal to the first device You can control the speaker.

An electronic device and a control method thereof according to an embodiment of the present invention are effective in solving a noise problem and a security problem due to communication by controlling a specific electronic device using a sound wave signal in an inaudible frequency region . In addition, based on the fact that long-distance transmission is impossible due to the characteristics of the sound wave signal in the inaudible frequency region, by providing a control method for performing the sound wave communication using a plurality of electronic devices having a microphone and a speaker, It has the effect of successfully controlling the device.

1A is a block diagram illustrating a mobile terminal related to the present invention.
1B and 1C are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.
2A and 2B are diagrams illustrating an example in which an inaudible sound wave signal is transmitted/received between electronic devices.
3A is a flowchart for explaining a control method according to the present invention, and FIGS. 3B and 3C are representative diagrams for explaining an embodiment according to the control method.
4A is a flowchart related to a control method when a plurality of sound wave signals are received by a second device, and FIG. 4B is a view illustrating an embodiment when there are a plurality of electronic devices that transmit sound wave signals to the second device.
5A is a flowchart related to a control method for processing and regenerating a sound wave signal received from a first device, and FIGS. 5B and 5C are views illustrating an embodiment related to processing and transmitting a sound wave signal in each electronic device. .
6 is a diagram illustrating transmission of a feedback sound wave signal from a second device to the first device.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar reference numerals are assigned to the same or similar components, and overlapping description thereof will be omitted. The suffixes "module" and "part" for the components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have a meaning or role distinct from each other by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC. , tablet PCs, ultrabooks, wearable devices, for example, watch-type terminals (smartwatch), glass-type terminals (smart glass), HMD (head mounted display), etc. may be included. have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in this specification may be applied to a fixed terminal such as a digital TV, a desktop computer, and a digital signage, except when applicable only to a mobile terminal. will be.

1A to 1C, FIG. 1A is a block diagram illustrating a mobile terminal related to the present invention, and FIGS. 1B and 1C are conceptual views of an example of the mobile terminal related to the present invention viewed from different directions.

The mobile terminal 100 includes a wireless communication unit 110 , an input unit 120 , a sensing unit 140 , an output unit 150 , an interface unit 160 , a memory 170 , a control unit 180 , and a power supply unit 190 . ) and the like. Since the components shown in FIG. 1A are not essential for implementing the mobile terminal, the mobile terminal described in this specification may have more or fewer components than those listed above.

More specifically, the wireless communication unit 110 among the components is between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and the external server. It may include one or more modules that enable wireless communication between them. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111 , a mobile communication module 112 , a wireless Internet module 113 , a short-range communication module 114 , and a location information module 115 . .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example, , a touch key, a push key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint sensor (finger scan sensor), ultrasonic sensor , optical sensors (eg, cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (eg, barometers, hygrometers, thermometers, radiation detection sensors, It may include at least one of a thermal sensor, a gas sensor, etc.) and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 151 , a sound output unit 152 , a haptip module 153 , and an optical output unit 154 . can do. The display unit 151 may implement a touch screen by forming a layer structure with the touch sensor or being formed integrally with the touch sensor. Such a touch screen may function as the user input unit 123 providing an input interface between the mobile terminal 100 and the user, and may provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100 . This interface unit 160, a wired / wireless headset port (port), an external charger port (port), a wired / wireless data port (port), a memory card (memory card) port, for connecting a device equipped with an identification module It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to the connection of the external device to the interface unit 160 , the mobile terminal 100 may perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100 . The memory 170 may store a plurality of application programs (application programs or applications) driven in the mobile terminal 100 , data for operation of the mobile terminal 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions (eg, incoming calls, outgoing functions, message reception, and outgoing functions) of the mobile terminal 100 . Meanwhile, the application program may be stored in the memory 170 , installed on the mobile terminal 100 , and driven to perform an operation (or function) of the mobile terminal by the controller 180 .

In addition to the operation related to the application program, the controller 180 generally controls the overall operation of the mobile terminal 100 . The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170 .

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1A in order to drive an application program stored in the memory 170 . Furthermore, in order to drive the application program, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 with each other.

The power supply unit 190 receives external power and internal power under the control of the controller 180 to supply power to each component included in the mobile terminal 100 . The power supply 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the respective components may operate cooperatively with each other to implement an operation, control, or control method of a mobile terminal according to various embodiments to be described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170 .

Hereinafter, before looking at various embodiments implemented through the mobile terminal 100 as described above, the above-listed components will be described in more detail with reference to FIG. 1A .

First, referring to the wireless communication unit 110 , the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 includes technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced, etc.) transmits/receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed in accordance with the above.

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100 . The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technologies, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) may be understood as a type of the mobile communication module 112 .

The short-range communication module 114 is for short-range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC. At least one of (Near Field Communication), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The short-distance communication module 114 is, between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or the mobile terminal 100 through wireless area networks (Wireless Area Networks). ) and another mobile terminal (100, or an external server) can support wireless communication between the network located. The local area network may be a local area network (Wireless Personal Area Networks).

Here, the other mobile terminal 100 is a wearable device capable of exchanging data (or interworking) with the mobile terminal 100 according to the present invention, for example, a smart watch, smart glasses. (smart glass), HMD (head mounted display)). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 in the vicinity of the mobile terminal 100 . Furthermore, when the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 transmits at least a portion of data processed by the mobile terminal 100 to the short-range communication module ( 114) to transmit to the wearable device. Accordingly, the user of the wearable device may use data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a call is received in the mobile terminal 100, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 100, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 115 is a module for acquiring a location (or current location) of a mobile terminal, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for input of image information (or signal), audio information (or signal), data, or information input from a user. For input of image information, the mobile terminal 100 has one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 . On the other hand, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the cameras 121 forming the matrix structure as described above, various angles or focal points are applied to the mobile terminal 100 . A plurality of image information having a plurality of images may be input. Also, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes an external sound signal as electrical voice data. The processed voice data may be utilized in various ways according to a function (or a running application program) being performed by the mobile terminal 100 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122 .

The user input unit 123 is for receiving information from a user, and when information is input through the user input unit 123 , the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. It may be made of a touch key (touch key) disposed on the. On the other hand, the virtual key or the visual key, it is possible to be displayed on the touch screen while having various forms, for example, graphics (graphic), text (text), icon (icon), video (video) or these can be made by a combination of

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control the driving or operation of the mobile terminal 100 or perform data processing, functions, or operations related to an application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor 141 may be disposed in an inner region of the mobile terminal covered by the touch screen described above or in the vicinity of the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of an object having conductivity by a change in an electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of approaching an object on the touch screen without contacting it so that the object is recognized that it is located on the touch screen is called “proximity touch”, and the touch The act of actually touching an object on the screen is called "contact touch". The position where the object is touched in proximity on the touch screen means a position where the object is perpendicular to the touch screen when the object is touched in proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) have. Meanwhile, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further, provides visual information corresponding to the processed data. It can be printed on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. do.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or a change in capacitance occurring in a specific part of the touch screen into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of a touch, an electrostatic capacitance at the time of a touch, etc. where a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, or the like.

As such, when there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180 . Accordingly, the controller 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a component separate from the controller 180 , or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or may perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different controls or the same control according to the type of the touch object may be determined according to the current operating state of the mobile terminal 100 or a running application program.

On the other hand, the above-described touch sensor and proximity sensor are independently or in combination, a short (or tap) touch on the touch screen (short touch), long touch (long touch), multi touch (multi touch), drag touch (drag touch) ), flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. It can sense touch.

The ultrasonic sensor may recognize location information of a sensing target by using ultrasonic waves. Meanwhile, the controller 180 may calculate the position of the wave source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source may be calculated using the property that light is much faster than ultrasonic waves, that is, the time for light to reach the optical sensor is much faster than the time for ultrasonic waves to reach the ultrasonic sensor. More specifically, the position of the wave source may be calculated using a time difference between the time that the ultrasonic wave arrives using light as the reference signal.

On the other hand, the camera 121 as seen in the configuration of the input unit 120 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display device, and the photo sensor is configured to scan the movement of the sensing target close to the touch screen. More specifically, the photo sensor mounts photo diodes and transistors (TRs) in rows/columns and scans the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diodes. That is, the photo sensor calculates the coordinates of the sensing target according to the amount of change in light, and through this, location information of the sensing target can be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100 . For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information. .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100 . The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated by the haptic module 153 may be controlled by a user's selection or setting of the controller. For example, the haptic module 153 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 153 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, a brush against the skin surface, contact of an electrode, an electrostatic force, etc. Various tactile effects can be generated, such as an effect caused by heat absorption and an effect by reproducing a feeling of cold and heat using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sensation such as a finger or arm. Two or more haptic modules 153 may be provided according to the configuration of the mobile terminal 100 .

The light output unit 154 outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile terminal 100 . Examples of the event generated in the mobile terminal 100 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the optical output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors toward the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100 . The interface unit 160 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 100 , or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 160 .

On the other hand, the identification module is a chip storing various information for authenticating the usage right of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (subscriber identity module; SIM), universal user authentication It may include a universal subscriber identity module (USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160 .

In addition, the interface unit 160 is a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or is input from the cradle by a user. It may be a path through which various command signals are transmitted to the mobile terminal 100 . Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 , and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving image, etc.). The memory 170 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

The memory 170 is a flash memory type, a hard disk type, a solid state disk type (SSD), a silicon disk drive type (SDD), and a multimedia card micro type. ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The mobile terminal 100 may be operated in relation to a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the general operation of the mobile terminal 100 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state that restricts input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice call, data communication, video call, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. can Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control any one or a plurality of the components described above by combining them.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power necessary for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon or a resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. power can be transmitted.

Meanwhile, various embodiments below may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

1B and 1C , the disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and may be applied to various structures such as a watch type, a clip type, a glass type, or a folder type in which two or more bodies are coupled to be relatively movable, a flip type, a slide type, a swing type, a swivel type, etc. . Although it will relate to a particular type of mobile terminal, descriptions regarding a particular type of mobile terminal are generally applicable to other types of mobile terminals.

Here, the terminal body may be understood as a concept referring to the mobile terminal 100 as at least one aggregate.

The mobile terminal 100 includes a case (eg, a frame, a housing, a cover, etc.) forming an exterior. As shown, the mobile terminal 100 may include a front case 101 and a rear case 102 . Various electronic components are disposed in the inner space formed by the combination of the front case 101 and the rear case 102 . At least one middle case may be additionally disposed between the front case 101 and the rear case 102 .

A display unit 151 is disposed on the front surface of the terminal body to output information. As illustrated, the window 151a of the display unit 151 may be mounted on the front case 101 to form a front surface of the terminal body together with the front case 101 .

In some cases, an electronic component may also be mounted on the rear case 102 . Electronic components that can be mounted on the rear case 102 include a removable battery, an identification module, a memory card, and the like. In this case, the rear cover 103 for covering the mounted electronic component may be detachably coupled to the rear case 102 . Accordingly, when the rear cover 103 is separated from the rear case 102 , the electronic components mounted on the rear case 102 are exposed to the outside.

As shown, when the rear cover 103 is coupled to the rear case 102, a portion of the side of the rear case 102 may be exposed. In some cases, the rear case 102 may be completely covered by the rear cover 103 during the combination. Meanwhile, the rear cover 103 may have an opening for exposing the camera 121b or the sound output unit 152b to the outside.

The cases 101 , 102 , and 103 may be formed by injection of synthetic resin or may be formed of metal, for example, stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

Unlike the above example in which a plurality of cases provide an internal space for accommodating various electronic components, the mobile terminal 100 may be configured such that one case provides the internal space. In this case, the mobile terminal 100 of the uni-body in which synthetic resin or metal is connected from the side to the back can be implemented.

Meanwhile, the mobile terminal 100 may include a waterproofing unit (not shown) that prevents water from permeating into the terminal body. For example, the waterproof part is provided between the window 151a and the front case 101, between the front case 101 and the rear case 102, or between the rear case 102 and the rear cover 103, and a combination thereof It may include a waterproof member for sealing the inner space of the city.

The mobile terminal 100 includes a display unit 151 , first and second sound output units 152a and 152b , a proximity sensor 141 , an illuminance sensor 142 , a light output unit 154 , and first and second audio outputs. Cameras 121a and 121b, first and second operation units 123a and 123b, a microphone 122, an interface unit 160, and the like may be provided.

Hereinafter, as shown in FIGS. 1B and 1C , the display unit 151, the first sound output unit 152a, the proximity sensor 141, the illuminance sensor 142, and the light output unit ( 154), the first camera 121a and the first operation unit 123a are arranged, the second operation unit 123b, the microphone 122 and the interface unit 160 are arranged on the side of the terminal body, the terminal body The mobile terminal 100 in which the second sound output unit 152b and the second camera 121b are disposed on the rear side of the device will be described as an example.

However, these configurations are not limited to this arrangement. These components may be excluded, replaced, or disposed on different sides as necessary. For example, the first operation unit 123a may not be provided on the front surface of the terminal body, and the second sound output unit 152b may be provided on the side surface of the terminal body instead of the rear surface of the terminal body.

The display unit 151 displays (outputs) information processed by the mobile terminal 100 . For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information. .

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (Flexible Display). display), a three-dimensional display (3D display), and an electronic ink display (e-ink display) may include at least one.

In addition, two or more display units 151 may exist depending on the implementation form of the mobile terminal 100 . In this case, in the mobile terminal 100 , a plurality of display units may be spaced apart from each other or disposed integrally on one surface, or may be respectively disposed on different surfaces.

The display unit 151 may include a touch sensor for sensing a touch on the display unit 151 so as to receive a control command input by a touch method. Using this, when a touch is made to the display unit 151, the touch sensor detects the touch, and the controller 180 may generate a control command corresponding to the touch based thereon. The content input by the touch method may be letters or numbers, or menu items that can be instructed or designated in various modes.

Meanwhile, the touch sensor is configured in the form of a film having a touch pattern and disposed between the window 151a and a display (not shown) on the rear surface of the window 151a, or a metal wire patterned directly on the rear surface of the window 151a. may be Alternatively, the touch sensor may be integrally formed with the display. For example, the touch sensor may be disposed on a substrate of the display or provided inside the display.

As such, the display unit 151 may form a touch screen together with the touch sensor, and in this case, the touch screen may function as the user input unit 123 (refer to FIG. 1A ). In some cases, the touch screen may replace at least some functions of the first operation unit 123a.

The first sound output unit 152a may be implemented as a receiver that transmits a call sound to the user's ear, and the second sound output unit 152b is a loudspeaker that outputs various alarm sounds or multimedia reproduction sounds. ) can be implemented in the form of

A sound hole for emitting sound generated from the first sound output unit 152a may be formed in the window 151a of the display unit 151 . However, the present invention is not limited thereto, and the sound may be configured to be emitted along an assembly gap between structures (eg, a gap between the window 151a and the front case 101). In this case, the appearance of the mobile terminal 100 may be simpler because the holes formed independently for sound output are not visible or hidden.

The light output unit 154 is configured to output light to notify the occurrence of an event. Examples of the event may include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an email reception, and information reception through an application. When the user's event confirmation is detected, the controller 180 may control the light output unit 154 to end the light output.

The first camera 121a processes an image frame of a still image or a moving image obtained by an image sensor in a shooting mode or a video call mode. The processed image frame may be displayed on the display unit 151 and stored in the memory 170 .

The first and second manipulation units 123a and 123b are an example of the user input unit 123 operated to receive a command for controlling the operation of the mobile terminal 100, and may be collectively referred to as a manipulating portion. have. The first and second operation units 123a and 123b may be adopted in any manner as long as they are operated in a tactile manner, such as by a touch, push, or scroll, while the user receives a tactile feeling. In addition, the first and second manipulation units 123a and 123b may be operated in a manner in which the user is operated without a tactile feeling through a proximity touch, a hovering touch, or the like.

In this drawing, the first operation unit 123a is illustrated as a touch key, but the present invention is not limited thereto. For example, the first operation unit 123a may be a push key (mechanical key) or may be configured as a combination of a touch key and a push key.

The contents input by the first and second operation units 123a and 123b may be variously set. For example, the first operation unit 123a receives commands such as menu, home key, cancel, search, etc., and the second operation unit 123b is output from the first or second sound output units 152a and 152b. It is possible to receive a command such as adjusting the volume of the sound and switching the display unit 151 to the touch recognition mode.

Meanwhile, as another example of the user input unit 123, a rear input unit (not shown) may be provided on the rear surface of the terminal body. The rear input unit is manipulated to receive a command for controlling the operation of the mobile terminal 100 , and input contents may be variously set. For example, a command such as power on/off, start, end, scroll, etc., control of the sound output from the first and second sound output units 152a and 152b, and a touch recognition mode of the display unit 151 You can receive commands such as switching of The rear input unit may be implemented in a form capable of input by a touch input, a push input, or a combination thereof.

The rear input unit may be disposed to overlap the front display unit 151 in the thickness direction of the terminal body. As an example, the rear input unit may be disposed on the upper rear portion of the terminal body so that the user can easily manipulate the terminal body by using the index finger when holding the terminal body with one hand. However, the present invention is not necessarily limited thereto, and the position of the rear input unit may be changed.

As such, when the rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the same can be implemented. In addition, when the aforementioned touch screen or rear input unit replaces at least some functions of the first operation unit 123a provided on the front surface of the terminal body, the first operation unit 123a is not disposed on the front surface of the terminal body, The display unit 151 may be configured as a larger screen.

Meanwhile, the mobile terminal 100 may be provided with a fingerprint recognition sensor for recognizing a user's fingerprint, and the controller 180 may use fingerprint information detected through the fingerprint recognition sensor as an authentication means. The fingerprint recognition sensor may be built in the display unit 151 or the user input unit 123 .

The microphone 122 is configured to receive a user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations and configured to receive stereo sound.

The interface unit 160 serves as a passage through which the mobile terminal 100 can be connected to an external device. For example, the interface unit 160 is a connection terminal for connection with another device (eg, earphone, external speaker), a port for short-range communication (eg, infrared port (IrDA Port), Bluetooth port (Bluetooth) Port), a wireless LAN port, etc.], or at least one of a power supply terminal for supplying power to the mobile terminal 100 . The interface unit 160 may be implemented in the form of a socket for accommodating an external card such as a Subscriber Identification Module (SIM), a User Identity Module (UIM), or a memory card for information storage.

A second camera 121b may be disposed on the rear side of the terminal body. In this case, the second camera 121b has a photographing direction substantially opposite to that of the first camera 121a.

The second camera 121b may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix form. Such a camera may be referred to as an 'array camera'. When the second camera 121b is configured as an array camera, an image may be captured in various ways using a plurality of lenses, and an image of better quality may be obtained.

The flash 124 may be disposed adjacent to the second camera 121b. The flash 124 illuminates light toward the subject when the subject is photographed by the second camera 121b.

A second sound output unit 152b may be additionally disposed on the terminal body. The second sound output unit 152b may implement a stereo function together with the first sound output unit 152a, and may be used to implement a speakerphone mode during a call.

At least one antenna for wireless communication may be provided in the terminal body. The antenna may be built into the terminal body or formed in the case. For example, an antenna forming a part of the broadcast reception module 111 (refer to FIG. 1A ) may be configured to be withdrawable from the terminal body. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the rear cover 103 , and a case including a conductive material may be configured to function as an antenna.

The terminal body is provided with a power supply unit 190 (refer to FIG. 1A ) for supplying power to the mobile terminal 100 . The power supply unit 190 may include a battery 191 that is built into the terminal body or is detachably configured from the outside of the terminal body.

The battery 191 may be configured to receive power through a power cable connected to the interface unit 160 . In addition, the battery 191 may be configured to be wirelessly charged through a wireless charging device. The wireless charging may be implemented by a magnetic induction method or a resonance method (magnetic resonance method).

On the other hand, in this figure, the rear cover 103 is coupled to the rear case 102 to cover the battery 191 to limit the detachment of the battery 191 and to protect the battery 191 from external shocks and foreign substances. is foreshadowing When the battery 191 is detachably configured to the terminal body, the rear cover 103 may be detachably coupled to the rear case 102 .

An accessory for protecting the appearance of the mobile terminal 100 or supporting or extending a function of the mobile terminal 100 may be added. As an example of such an accessory, there may be a cover or a pouch that covers or accommodates at least one surface of the mobile terminal 100 . The cover or pouch may be configured to extend the function of the mobile terminal 100 by interworking with the display unit 151 . As another example of the accessory, there may be a touch pen for assisting or extending a touch input to a touch screen.

Hereinafter, embodiments related to a control method according to the present invention will be described with reference to the accompanying drawings. It is apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention.

The communication method using inaudible sound waves according to the present invention may be implemented between electronic devices having a microphone and a speaker. More specifically, the first device may generate a sound wave signal including a control command for controlling execution of a specific function by targeting the second device. In this case, when the second device cannot receive the sound wave signal (for example, the distance between the first device and the second device is too far or the sound wave is caused by an obstacle between the first device and the second device) When signal reception is difficult), the sound wave signal may be transmitted to the second device by an electronic device different from the first and second devices. That is, after the other device receives the sound wave signal, the sound wave signal may be retransmitted toward the second device. Accordingly, even if a wireless communication function is not provided, a desired function can be controlled to be executed in a specific target device located at a long distance using other electronic devices having a microphone and a speaker.

Hereinafter, the inaudible sound wave communication according to the present invention will be described with reference to FIGS. 2A and 2B .

2A and 2B are diagrams illustrating an example in which an inaudible sound wave signal is transmitted/received between electronic devices.

Inaudible sound wave communication refers to using sound waves in an inaudible region when performing communication using sound waves. That is, it means that a sound wave signal including specific information is formed and transmitted/received within a range of an inaudible region. As such, when the sound wave in the inaudible frequency region is used, the user may not feel inconvenience because the user does not hear the sound according to the sound wave, and there is an advantage in that the security of information included in the sound wave can be maintained. However, since the sound wave in the inaudible high frequency band has strong straightness and its size is rapidly attenuated as the distance increases, the success rate of sound wave communication using the inaudible high frequency band is low.

That is, referring to FIG. 2A , when an inaudible sound wave signal is generated from the first device 100 toward the second device 200 , the size of the inaudible sound wave signal increases as it moves away from the first device 100 . can be rapidly attenuated. In this case, the inaudible sound wave signal may gradually decrease in size as it moves away from the first device 100 and then disappear at a specific distance l. Accordingly, the inaudible sound wave signal cannot be received by the second device 200 located at a long distance R from the first device 100 .

In order to solve this problem, the control method according to the present invention may transmit the inaudible sound wave signal using a device different from the first and second devices. That is, as in FIG. 2B , another device 300 located at a specific distance l from the first device 100 may exist. In this case, the inaudible sound wave signal may be received from the first device 100 and the other device 300 located at the specific distance l. In this way, when the other device 300 receives the inaudible sound wave signal, the second device 200 may regenerate the inaudible sound wave signal by using a speaker so that the inaudible sound wave signal can be received. have. Accordingly, the second device 200 may receive the inaudible sound wave signal generated by the first device 100 through the other device 300 .

In this way, even when a sound wave signal of an inaudible frequency region is used, the success rate of inaudible sound wave communication can be increased by transmitting the sound wave signal of the inaudible frequency region to a desired device using another device having a microphone and a speaker. .

Here, the other device may determine a device that is a target of the sound wave signal by using identification information corresponding to the sound wave signal received from the first device. Then, different controls are performed according to the determination result can do. In this regard, it will be described with reference to FIGS. 3A, 3B and 3C. Hereinafter, an electronic device that generates a sound wave signal will be referred to as a first device, and an electronic device that is a control target of the sound wave signal will be referred to as a second device.

3A is a flowchart for explaining a control method according to the present invention, and FIGS. 3B and 3C are representative diagrams for explaining an embodiment according to the control method.

First, referring to FIG. 3A , a sound wave signal generated by a first device may be received through a microphone of an electronic device ( S310 ).

Here, the first device may include any type of electronic device capable of generating a sound wave signal. That is, an electronic device having a controller capable of forming a control command for controlling a specific device and a speaker capable of generating sound waves may correspond to this. For example, the first device may be the mobile terminal 100 as shown in FIGS. 3B and 3C .

In addition, the sound wave signal is a sound wave signal including an inaudible frequency region, and may include specific information. More specifically, the specific information may include identification information about the first device that generated the sound wave signal. In addition, the specific information may include identification information about a device to be controlled by the sound wave signal. Here, the identification information may mean unique ID information capable of identifying each electronic device itself. In addition, the specific information may include control information for controlling the device to be controlled.

As such, when a sound wave signal is received from the one electronic device, the control unit of the one electronic device may determine whether identification information corresponding to the sound wave signal and preset identification information match ( S320 ).

That is, the one electronic device may analyze the identification information corresponding to the received sound wave signal to determine a device that is a target of the sound wave signal. Here, the control unit of the one electronic device determines whether the identification information corresponding to the sound wave signal (identification information of the device that is the target of the sound wave signal) matches the identification information preset in the one electronic device. can

In addition, when the predetermined identification information in the one electronic device matches the identification information corresponding to the sound wave signal, the control unit of the one electronic device determines that the second device to be controlled by the sound wave signal is the one electronic device. It can be considered a device. And, the control unit of the one electronic device may execute a function according to the sound wave signal (S330).

That is, when it is determined that the second device, which is the target of the sound wave signal received through the microphone, is the one electronic device, the one electronic device analyzes the sound wave signal, and based on the control information included in the sound wave signal, A function according to the sound wave signal may be executed. For example, as shown in FIG. 3B , when the one electronic device is the refrigerator 200 , the controller of the refrigerator 200 determines that the second device to be controlled by the sound wave signal received through the microphone is the refrigerator 200 . can be judged as In this case, the controller of the refrigerator 200 may analyze the sound wave signal received from the first device 100 and execute a function of lowering the temperature by 2°C according to the sound wave signal.

On the other hand, when the preset identification information of the one electronic device does not match the identification information corresponding to the sound wave signal, the one electronic device may transmit the sound wave signal to the second device using a speaker (S340). ).

That is, when the predetermined identification information does not match the identification information corresponding to the sound wave signal, the one electronic device may determine that the device to be controlled by the sound wave signal is not the one electronic device. In addition, the sound wave signal may be regenerated through a speaker so that the sound wave signal can be transmitted to a device to be controlled.

For example, as shown in FIG. 3C , when the one electronic device is the refrigerator 300 , the controller of the refrigerator 300 transmits the sound wave signal received from the first device 100 to the second device 200 . You can control the speaker so that it is transmitted to

Here, the regenerated sound wave signal may be a signal processed from the sound wave signal received through the microphone. In addition, the regenerated sound wave signal may also be a sound wave signal including an inaudible frequency region. A control method for processing and regenerating a sound wave signal as described above will be described later with reference to FIG. 5A.

As such, even when the sound wave signal generated by the first device cannot be directly transmitted to the second device, the second device can be controlled by transmitting the sound wave signal through another electronic device having a microphone and a speaker. can

Meanwhile, although FIG. 3C illustrates an embodiment in which one electronic device transmits a sound wave signal to the second device, there may be a plurality of electronic devices that can transmit a sound wave signal to the second device. In this regard, it will be described with reference to FIGS. 4A and 4B.

4A is a flowchart related to a control method when a plurality of sound wave signals are received by a second device, and FIG. 4B is a diagram illustrating an embodiment when there are a plurality of electronic devices that transmit sound wave signals to the second device.

First, referring to FIG. 4A , the second device may receive a sound wave signal generated by the first device through a microphone ( S310 ).

Here, the sound wave signal may be a sound wave signal directly received from the first device or a sound wave signal generated by the first device transmitted from another electronic device.

In this way, after receiving the sound wave signal, the second device may receive a new sound wave signal different from the sound wave signal through the microphone (S410).

Here, the new sound wave signal may also be a sound wave signal directly received from the first device or a sound wave signal generated by the first device received from another electronic device.

More specifically, as shown in FIG. 4B , there may be a plurality of electronic devices that transmit a sound wave signal to the second device. In this case, each electronic device 301 , 302 , 303 receives a sound wave signal from the first device 100 , and sets identification information corresponding to the sound wave signal to each device 301 , 302 , 303 . It can be compared with identification information. In addition, if it is determined that the device is not a target of the sound wave signal, each of the electronic devices 301 , 302 , 303 may regenerate the received sound wave signal using a speaker. In this case, the second device 200 may receive a plurality of sound wave signals from the respective electronic devices 301 , 302 , and 303 .

Here, the sound wave signal received from each of the electronic devices 301 , 302 , 303 may be received by the second device 200 according to a temporal relationship. For example, the second device 200 may first receive a sound wave signal from the device A 301 , and then receive a new sound wave signal from the device B 302 .

As such, when the second device receives a plurality of sound wave signals, the control unit of the second device determines whether identification information corresponding to each of the sound wave signal and the new sound wave signal matches the identification information preset in the second device can be determined (S420).

That is, when the sound wave signal is received, the control unit of the second device determines whether the identification information corresponding to the sound wave signal matches the preset identification information, and the device that is the control target of the sound wave signal is the second device. device can be determined. Also, the control unit of the second device may similarly determine whether the device, which is the target of the new sound wave signal, is the second device through the analysis of the new sound wave signal.

If it is determined that the device that is the target of the sound wave signal is the second device, the control unit of the second device may perform a function according to the sound wave signal using the first received sound wave signal.

In addition, after the sound wave signal is received, the received new sound wave signal may be analyzed, and it may be determined whether a function according to the new sound wave signal is the same as the function according to the sound wave signal (S430).

If the function according to the new sound wave signal is the same as the function according to the sound wave signal, the control unit of the second device may determine that the sound wave signal generated by the first device has been repeatedly received through other electronic devices. . Accordingly, the new sound wave signal received later in time may be ignored (S440). That is, it is possible to limit the execution of the function according to the new sound wave signal.

On the other hand, when the function according to the new sound wave signal is different from the function according to the sound wave signal, it may be determined that the new sound wave signal is a sound wave signal including a control command different from the sound wave signal. Accordingly, the control unit of the second device may execute a function according to the new sound wave signal (S450).

As such, when the sound wave signal generated by the first device is transmitted through the plurality of electronic devices, the control unit of the second device receives the plurality of sound wave signals from the plurality of electronic devices, and the plurality of sound wave signals It is possible to determine whether there is overlap with each other. That is, according to the temporal relationship, when a new sound wave signal is received after first executing a function according to the received sound wave signal, if the function according to the new sound wave signal is the same as the function according to the sound wave signal, the new sound wave signal is It may be determined that it is a duplicate sound wave signal. Therefore, even if the sound wave signal including the same control command is repeatedly transmitted from a plurality of electronic devices through the inaudible sound wave communication according to the present invention, inefficient control of overlapping functions can be prevented.

Meanwhile, a plurality of electronic devices that transmit a sound wave signal to the second device may regenerate sound wave communication received from the first device through a speaker. More specifically, the plurality of electronic devices may determine that the sound wave signal is not a sound wave signal targeted to each of the plurality of electronic devices. In this case, each of the plurality of electronic devices cannot grasp the second device that is the target of the sound wave signal, and can only determine that the signal is not the target of each of the plurality of electronic devices. Accordingly, the plurality of electronic devices may uniformly regenerate the sound wave signal based on a determination that the sound wave signal is not a target of each of the plurality of electronic devices.

Here, the regenerated sound wave signal may be transmitted between the plurality of electronic devices in addition to being transmitted to the second device. If the plurality of electronic devices receive the regenerated sound wave signal with each other, identification information corresponding to the regenerated sound wave signal is analyzed, and a problem of uniformly regenerating the regenerated sound wave signal may occur. . Accordingly, each of the plurality of electronic devices may perform a preset process in regenerating the sound wave signal so as not to regenerate the regenerated sound wave signal. In this regard, it will be described with reference to FIGS. 5A, 5B and 5C.

FIG. 5A is a flowchart related to a control method for regenerating a sound wave signal received from a first device after processing, FIG. 5B is a diagram illustrating an example of transmitting and receiving a sound wave signal regenerated between a plurality of electronic devices, FIG. 5C is It is a view showing an embodiment related to a process of processing and transmitting a sound wave signal in each electronic device.

First, referring to FIG. 5A , the electronic device may receive a sound wave signal generated by the first device (S310).

Here, the electronic device may be plural. That is, as shown in FIG. 5B , the sound wave signal generated by the first device 100 may be transmitted to the second device 200 through the plurality of electronic devices 301 and 302 .

In this case, the electronic device may determine that the identification information corresponding to the sound wave signal does not match the identification information preset in the electronic device (S510). That is, the electronic device may determine that the second device, which is the target of the sound wave signal generated by the first device, is not the electronic device. In addition, the sound wave signal may be regenerated so that the sound wave signal is transmitted to the second device.

In this case, the electronic device may process the sound wave signal to include identification information of the electronic device in the sound wave signal (S520).

Here, the control unit of the electronic device may process the sound wave signal to include information on a path through which the sound wave signal is transmitted. Here, the information on the path through which the sound wave signal is transmitted may mean information about electronic devices that transmit the sound wave signal to the second device. More specifically, the information on the path through which the sound wave signal is transmitted may include identification information of each of the electronic devices transmitting the sound wave signal to the second device.

That is, referring to FIG. 5B , the device A 301 may process the sound wave signal so that the identification information of the device A 301 is included in the sound wave signal received from the first device. In addition, the device B 302 may process the sound wave signal so that the identification information of the device B 302 is included in the sound wave signal.

In this way, when the sound wave signal is processed, the controller of the electronic device may output the processed sound wave signal using a speaker (S530).

That is, as shown in FIG. 5B , the sound wave signals processed by the device A 301 and the device B 302 may be output through the speaker provided in the device A 301 and the device B 302 . In addition, the sound wave signal processed by each of the device A 301 and the device B 302 may be transmitted/received between the device A 301 and the device B 302 . Also, the sound wave signal processed by each of the device A 301 and the device B 302 may be transmitted to the second device 200 .

Accordingly, even if the device A 301 and the device B 302 receive the sound wave signal regenerated by each of the device A 301 and the device B 302 , it is possible to prevent the re-occurrence of duplication. For a more detailed description, refer to FIG. 5C.

Referring to FIG. 5C , device A and device B may receive a sound wave signal from the first device 100 . Here, the sound wave signal may be a sound wave signal targeted to the second device 200 . In this case, the device A and the device B may process and regenerate each of the sound wave signals. That is, the sound wave signal may be processed and regenerated so that the unique identification information (A) of the device A and the unique identification information (B) of the device B are included in the sound wave signal received from the first device 100 .

In this way, when the sound wave signals processed in each of the devices A and B are regenerated through the speakers provided in the devices A and B, each of the processed sound wave signals is transmitted to the second device 200 in addition to may be received again by each of the device A and the device B. In this case, each of the device A and the device B may process and regenerate a sound wave signal received from each other.

More specifically, when the device A receives a sound wave signal including the unique identification information (B) of the device B from the device B, the sound wave signal includes its own unique identification information (A), the processed sound wave The signal BA may be regenerated. In addition, when the device B receives a sound wave signal including the device A's unique identification information (A), it includes its own unique identification information (B) in the sound wave signal to reproduce the processed sound wave signal (AB). can occur

In this way, when the respectively processed sound wave signals AB and BA are regenerated, the respectively processed sound wave signals AB and BA may be received through the microphones provided in each of the device A and the device B. In this case, the device A and the device B may analyze information about a transmission path of the sound wave signal included in the processed sound wave signal AB and BA, and prevent overlapping and reoccurrence.

That is, when the device A receives the processed sound wave signal AB, it analyzes information about the transmission path included in the processed sound wave signal AB, and includes its own identification information in the information about the transmission path. It can be determined whether there is In this case, if it is determined that the processed sound wave signal AB includes its own identification information A, it is determined that the processed sound wave signal AB was a previously regenerated signal and will not regenerate any more. can That is, the device A may generate the acoustic signal ABA by further processing the acoustic signal AB or may not output the additionally processed acoustic signal ABA.

Similarly, when the processed sound wave signal BA is received from the device B, additional processing or re-occurrence may be prevented based on the analysis of the processed sound wave signal BA.

In this way, each electronic device transmits the sound wave signal to the second device, by performing processing, the same sound wave signal (information including the identification information of the first device, the identification information of the second device and the control command The same sound wave signal) can be prevented from being duplicated and regenerated.

Meanwhile, when the function according to the sound wave signal received from the first device is performed by the second device, the second device may generate a feedback sound wave signal informing that the function is performed. Also, the feedback sound wave signal may be transmitted to the first device through other electronic devices in the same manner as the sound wave signal generated from the first device is transmitted. In this regard, it will be described with reference to FIG. 6 .

6 is a diagram illustrating a feedback sound wave signal formed in the second device is transmitted to the first device.

Referring to FIG. 6 , the second device 200 may perform a function (a function of lowering the temperature by 2° C.) according to the sound wave signal received from the first device 100 . In this case, the second device 200 may form a feedback sound wave signal indicating that the function according to the sound wave signal has been performed. In addition, the feedback sound wave signal may also be a sound wave signal including an inaudible frequency region. In this way, the second device 200 that has formed the feedback sound wave signal may output the feedback sound wave signal through the speaker.

In this case, the second device 200 and another electronic device 300 located within a preset distance may receive the feedback sound wave signal. And, it is possible to compare the identification information corresponding to the feedback sound wave signal (here, the identification information corresponding to the feedback sound wave signal may be the identification information of the first device) and its own identification information. In addition, when it is determined that the other electronic device 300 is not the device that is the target of the feedback sound wave signal, the other electronic device 300 may process the feedback sound wave signal and then regenerate the feedback sound wave signal using a speaker.

In this way, the regenerated feedback sound wave signal may be received by the first device 100 . If, as shown in FIG. 6 , when the first device 100 is a terminal including the display unit 151 , information indicating that the function has been performed in the second device 200 is output to the display unit 151 . can That is, a pop-up window 10a indicating that a function has been performed in the second device 200 (air conditioner) may be output on the display unit 151 of the first device 100 .

Therefore, even if the user performs a function of controlling another device using an inaudible sound wave signal, the user can be provided with information on the control status of the other device through the feedback sound wave signal transmitted to the first device. can

The present invention described above can be implemented as computer-readable code on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. In addition, the computer may include the control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (5)

speaker;
a microphone for receiving the sound wave signal generated by the first device; and
When the identification information corresponding to the sound wave signal matches the preset identification information, a function according to the sound wave signal is executed,
When the identification information corresponding to the sound wave signal does not match the preset identification information, the sound wave signal is analyzed to determine information about a transmission path of the sound wave signal, and the preset information about the transmission path If the identification information is not included, the sound wave signal is transmitted to the second device using the speaker so that the function according to the sound wave signal is executed in a second device different from the first device,
and a controller for controlling the speaker to limit the transmission of the sound wave signal when the information on the transmission path includes the preset identification information. According to claim 1, wherein the control unit,
After the sound wave signal is received, when a new sound wave signal is received through the microphone, and identification information corresponding to each of the sound wave signal and the new sound wave signal matches the preset identification information,
If the function according to the new sound wave signal is the same as the function according to the sound wave signal, the execution of the function according to the new sound wave signal is limited,
If the function according to the new sound wave signal is not the same as the function according to the sound wave signal, the function according to the new sound wave signal is executed. According to claim 1, wherein the control unit,
When the identification information corresponding to the sound wave signal does not match the preset identification information,
The sound wave signal is processed so that the preset identification information is included in the sound wave signal, and the processed sound wave signal is transmitted to the second device. delete According to claim 1, wherein the control unit,
When a feedback sound wave signal notifying execution of a function according to the sound wave signal is received from the second device through the microphone,
and controlling the speaker so that the feedback sound wave signal is transmitted to the first device.

Images