KR102243641B1 - Home appliance, and method for operating the same - Google Patents

Abstract

The present invention relates to a home appliance and a method of operating the same. A method of operating a home appliance according to an embodiment of the present invention includes receiving sound through a microphone, extracting information from the received sound, and when other home appliance-related information is included in the extracted information. And outputting a sound including information. Accordingly, information included in the sound can be shared among a plurality of home appliances.

Description

Home appliance, and method for operating the same}

The present invention relates to a home appliance and a method of operating the same, and more particularly, to a home appliance capable of sharing information included in sound among a plurality of home appliances, and a method of operating the same.

Among the home appliances placed in the building, the refrigerator stores food for the user, the laundry treatment device handles laundry, the air conditioner adjusts the indoor temperature, and the cooking appliance cooks food, etc. .

On the other hand, as various communication methods are developed, various methods for increasing user convenience for a home appliance through communication are being studied.

An object of the present invention is to provide a home appliance capable of sharing information included in sound among a plurality of home appliances, and a method of operating the same.

In order to achieve the above object, a method of operating a home appliance according to an embodiment of the present invention includes receiving a sound through a microphone, extracting information from the received sound, and other home appliance-related information in the extracted information. When is included, outputting a sound including related information.

In addition, a method of operating a home appliance according to an embodiment of the present invention for achieving the above object includes the steps of receiving sound from another home appliance, extracting information from the received sound, and operating the extracted information. When the control command is included, performing a corresponding operation, and when the extracted information includes a voice memo, storing the voice memo in a memory.

In addition, a home appliance according to an embodiment of the present invention for achieving the above object includes a driving unit, a control unit for controlling the driving unit, a microphone for receiving external sound, a sound output module, and information from the sound received from the microphone. It extracts and, when other home appliance related information is included in the extracted information, includes a sound communication unit for outputting a sound including the related information to the sound output module.

According to an embodiment of the present invention, the home appliance receives sound from the outside, extracts information from the sound, and outputs a sound including related information when other home appliance related information is included in the extracted information. , It is possible to share information contained in sound between home appliance devices. Accordingly, user convenience may be increased.

Specifically, a sound including information may be output through at least one adjacent home appliance, and accordingly, the corresponding home appliance may finally receive related information.

On the other hand, if the information contained in the sound received from another home appliance includes a motion control command, the operation is performed, and if the information contained in the sound includes a voice memo, the voice memo is stored in the memory. It becomes possible to perform the operation. Accordingly, user convenience may be increased.

1 is an example of a configuration diagram of a communication system according to an embodiment of the present invention.
2A to 2E are diagrams illustrating various examples of acoustic communication between a mobile terminal and a home appliance.
3A is an example of a simplified internal block diagram of the home appliance of FIG. 1.
3B is another example of a simplified internal block diagram of the home appliance of FIG. 1.
4A to 4D are views referenced to describe the acoustic communication of FIG. 1.
5 is an internal block diagram of the server of FIG. 1.
6 is an internal block diagram of the mobile terminal of FIG. 1.
7 is a flowchart illustrating a method of operating a home appliance according to an embodiment of the present invention.
8 is a flowchart illustrating a method of operating a home appliance according to another embodiment of the present invention.
9 to 14B are views referenced for explanation of the operation method of FIG. 7 or 8.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "unit" for the constituent elements used in the following description are given in consideration of only the ease of writing in the present specification, and do not impart a particularly important meaning or role by themselves. Therefore, the "module" and "unit" may be used interchangeably with each other.

1 is an example of a configuration diagram of a communication system according to an embodiment of the present invention.

Referring to the drawings, the communication system 10 according to an embodiment of the present invention may include a home appliance 200, a mobile terminal 600, and a server 500.

In particular, in relation to the embodiment of the present invention, the home appliance 200 and the mobile terminal 600 may perform acoustic communication or sound communication.

Acoustic communication according to an embodiment of the present invention means that a sound in an audible frequency band is output, but predetermined information data is added to the sound. To add such information data, signal modulation is required, and in the embodiment of the present invention, modulation is performed based on a modulated complex lapped transform (MCLT).

Specifically, the home appliance 200 may receive a sound including information related to the home appliance, and extract information related to the home appliance in the sound by means of an acoustic communication method.

In particular, when the information related to the home appliance in the sound includes information on the other home appliance, the home appliance 200 may output a sound including information on the other home appliance by an acoustic communication method.

In this way, it is possible to share the information through the adjacent home appliance, and finally, the information can be delivered to the home appliance. Accordingly, user convenience may be increased.

According to this acoustic communication method, since the home appliance 200 only needs to have an audio output module and a microphone, information can be easily exchanged. In particular, since the home appliance 200 does not have to have a separate wireless communication module, such as WiFi, manufacturing cost can be reduced.

Meanwhile, the home appliance 200 is an electric device for a user, for example, a refrigerator 200a, a washing machine 200b, an air conditioner 200c, a cooking appliance 200d, a vacuum cleaner 200e, etc. This can be illustrated. In addition, it may be a concept including a TV or the like.

Meanwhile, a mobile terminal 600, a mobile phone, a smart phone, a notebook, a tablet PC, and the like are possible.

2A to 2E are diagrams illustrating various examples of acoustic communication between a mobile terminal and a home appliance.

2A illustrates that acoustic communication is performed between the mobile terminal 600 and the refrigerator 200a, and FIG. 2B illustrates that the acoustic communication is performed between the mobile terminal 600 and the washing machine 200b, 2C illustrates that acoustic communication is performed between the mobile terminal 600 and the air conditioner 200c, and FIG. 2D illustrates that the acoustic communication is performed between the mobile terminal 600 and the cooking appliance 200d. For example, FIG. 2E illustrates that acoustic communication is performed between the mobile terminal 600 and the cleaner 200e.

According to FIGS. 2A to 2E, acoustic communication by sound output from a mobile terminal, communication by sound output from a home appliance, or a combination thereof are possible, respectively.

3A is an example of a simplified internal block diagram of the home appliance of FIG. 1.

Referring to the drawings, the home appliance 200 includes an input unit 220 for user input, a display unit 230 for displaying an operation state of the home appliance, a communication unit 222 for communication with other external devices, and a home appliance. It may include a driving unit 245 for driving and a control unit 270 for internal control.

For example, when the home appliance is a refrigerator, the driving unit 245 may include a refrigerator compartment driving unit and a freezing compartment driving unit.

As another example, when the home appliance is a washing machine, the driving unit 245 may be a driving unit that drives a drum or a tub.

As another example, when the home appliance is an air conditioner, the driving unit 245 may include a compressor driving unit in the outdoor unit, an outdoor unit fan driving unit, and an indoor unit fan driving unit.

As another example, when the home appliance is a cooking appliance, the driving unit 245 may include a microwave driving unit that outputs microwaves into the cavity.

As another example, when the home appliance is a vacuum cleaner, the driving unit 245 may include a fan motor driving unit.

Meanwhile, the communication unit 222 may include an acoustic communication unit 217 capable of acoustic communication. The acoustic communication unit 217 will be described later with reference to FIGS. 4A to 4D.

3B is another example of a simplified internal block diagram of the home appliance of FIG. 1.

Referring to the drawings, the internal block diagram of the home appliance of FIG. 3B is similar to the internal block diagram of the home appliance of FIG. 3A, but the difference is that the display microcomputer 221 is further provided.

When the display unit 230 is provided in the home appliance, a display microcomputer 221 may be provided for controlling the separate display unit 230. In this case, the control unit 270 may be provided on a circuit board separate from the display micom 221 as a main micom.

On the other hand, as in the embodiment of the present invention, when the home appliance includes an acoustic communication unit 217 capable of acoustic communication, for acoustic communication, the communication unit 222, in particular, the acoustic communication unit 217 is a display microcomputer 221 It is possible to be provided on the same circuit board as ). Accordingly, as shown in FIG. 3B, control of the sound communication unit 217 is primarily performed by the display micom 221, and thereafter, the control unit 270, that is, the main micom 270 may be in charge.

4A to 4D are views referenced to describe the acoustic communication of FIG. 1.

First, FIG. 4A illustrates that the mobile terminal 600 outputs sound through acoustic communication, and the home appliance 200 receives the sound.

To this end, the mobile terminal 600 may include an acoustic communication unit 617 and an audio output module 653, and the home appliance 200 may include a microphone 223 and an acoustic communication unit 217.

The sound communication unit 617 of the mobile terminal 600 receives the digital sound to be output from the control unit 680, adds predetermined data to the digital sound to be output, and modulates the digital sound. Sound is output. Then, the sound output module 653 outputs the modulated sound through an audible frequency band, an acoustic channel.

The microphone 223 of the home appliance 200 receives a sound output from the mobile terminal 600. Then, the received sound signal is transmitted to the sound communication unit 217. The acoustic communication unit 217 extracts data from the sound signal.

This enables simple information data exchange between the mobile terminal 600 and the home appliance 200.

Meanwhile, opposite to FIG. 4A, it is possible for the home appliance 200 to output sound through acoustic communication, and for the mobile terminal 600 to receive the sound, and to perform two-way acoustic communication.

Accordingly, the mobile terminal 600 may further include a microphone 623 in addition to the sound communication unit 617 and the sound output module 653, and the home appliance 200 includes the microphone 223 and the sound communication unit ( In addition to the 217), a sound output module 253 may be further provided.

FIG. 4B illustrates an internal block diagram of an acoustic communication unit 617 in the mobile terminal 600 of FIG. 4A and an acoustic communication unit 217 in the home appliance 200, respectively.

In order to output sound, the acoustic communication unit 617 in the mobile terminal 600 may include a frequency conversion unit 410, a data insertion unit 415, an inverse conversion unit 420, and a multiplexing unit 425. .

The frequency converter 410 may receive an audio signal to be output in a time domain and perform frequency conversion. The frequency transformation at this time may be performed on a frame basis, and specifically, may be a frequency transformation based on a modulated complex lapped transform (MCLT).

The MCLT method has the advantage of reducing blocking artifacts at frame boundaries according to the overlapping characteristics for each frame.

The data insertion unit 415 adds or inserts predetermined data (data) to the frequency-converted audio signal. That is, data is added to the audio signal by the modulation method. Specifically, data may be added by varying a phase coefficient among coefficients (magnitude, phase, etc.) for each frequency that has been converted into a frequency. For example, the variable phase coefficient may have a value of 0 degrees or 180 degrees. Thereby, the added data can be distinguished.

The inverse transform unit 420 inverse transforms the audio signal into which the information data is inserted. When the frequency converter 410 performs MCLT transformation, it performs inverse MCLT transformation and outputs a time-based sound signal.

Meanwhile, the frequency conversion unit 410, the data insertion unit 415, and the inverse conversion unit 420 may perform a corresponding operation in units of frames.

The multiplexer 425 multiplexes and outputs the inversely transformed audio signal. That is, a plurality of frames are multiplexed to output one continuous sound.

Then, the sound output module 253 outputs one multiplexed sound to the outside. To this end, the sound output module 253 may include at least one speaker.

The home appliance 200 receives sound through the microphone 425 and converts it into an electrical signal. In addition, the acoustic communication unit 217 in the home appliance 200 may include a synchronization unit 430, a frequency conversion unit 435, and a data extraction unit 440 to extract data from received sound.

The synchronization unit 430 synchronizes the received audio signal. That is, the multiplexed audio signals can be synchronized and separated in units of frames.

The frequency converter 435 may receive an audio signal to be output in a time domain and perform frequency conversion. The frequency transformation at this time may be performed on a frame basis, and specifically, may be a frequency transformation based on a modulated complex lapped transform (MCLT).

The data extraction unit 440 extracts added data from the frequency-converted audio signal. As described above, since data is added by varying the phase coefficient among the coefficients for each frequency, data can be extracted from the phase coefficient. In particular, when the phase coefficient has a value of 0 degrees or 180 degrees, data may be extracted based on this.

The extracted data may be transmitted to the controller 270 of the home appliance 200.

According to this MCLT-based acoustic communication method, it is possible to add data while maintaining a sound similar to an audio signal originally intended to be output. And, according to the overlapping characteristics of each frame, there is an advantage that it is possible to reduce the blocking artifact (blocking artifact) at the frame boundary.

4C is a diagram illustrating the operation of the sound communication unit 617 of FIG. 4B together with audio waveforms.

Referring to the drawing, the audio signal 400 to be output is illustrated, and the audio signal 400 to be output may be divided into a plurality of frames FR1 to FR4 based on time. In the drawing, in a first frame (FR1) section, a first audio signal (400a), a second frame (FR2) section, a second audio signal (400b), a third frame (FR3) section, a third The audio signal 400c is exemplified in the fourth frame FR4 section, and the fourth audio signal 400d is exemplified.

The frequency converter 410 frequency-converts the audio data for each frame. Specifically, frequency conversion is performed according to the MCLT method.

Then, the data insertion unit 415 adds predetermined data (data) to the frequency-converted audio signal for each frame. Specifically, data is added by varying a phase coefficient among coefficients (magnitude, phase, etc.) for each frequency that has been converted into frequency.

The inverse transform unit 420 performs inverse transform on an audio signal into which information data is inserted, for each frame. Accordingly, a time-based sound signal is output.

In the drawing, for each frame, first to fourth sound signals 401a to 401d similar to the first to fourth audio signals 400a to 400d are illustrated. Looking at the drawings, it can be seen that the first to fourth sound signals 401a to 401d are similar to the audio signals originally intended to be output, respectively.

Meanwhile, the multiplexer 425 may output one sound signal by multiplexing the sound signal to which data is added for each frame.

Meanwhile, in FIGS. 4A to 4C, it is described that a sound including predetermined information is output from the mobile terminal 600 and the home appliance 200 receives the sound and extracts predetermined information. It is also possible.

That is, a sound including predetermined information may be output from the home appliance 200, and the mobile terminal 600 may receive the corresponding sound and extract predetermined information.

In this case, the acoustic communication unit 217 in the home appliance 200 may include a frequency conversion unit 410, a data insertion unit 415, an inverse conversion unit 420, and a multiplexing unit 425, and a mobile terminal The acoustic communication unit 617 in 600 may include a synchronization unit 430, a frequency conversion unit 435, and a data extraction unit 440.

4D illustrates that the sound generator 618 is provided in the mobile terminal 600 and the sound detector 218 is provided in the home appliance 200.

The sound generator 618 in the mobile terminal 600 of FIG. 4D is similar to the sound communication unit 617 in the mobile terminal 600 of FIG. 4B, but generates audio data by itself to generate the input data. There is a difference in outputting in addition to the data. That is, it is possible to generate audio data by itself without receiving the audio data from the control unit 680 or the like. To this end, in addition to the frequency conversion unit 410, the data insertion unit 415, the inverse conversion unit 420, and the multiplexing unit 425 in the acoustic communication unit 617, a separate audio generation unit (not shown) is provided. I can.

For example, when the sound generator 618 configures four consecutive sounds by using 36 sounds, it may generate approximately 168,000 sounds. And, you can add data to it.

Next, the sound detection unit 218 in the home appliance 200 is the same as the sound communication unit 217 in the home appliance 200 of FIG. 4B. That is, to extract data from the received sound, a synchronization unit 430, a frequency converter 435, and a data extraction unit 440 may be provided.

5 is an internal block diagram of the server of FIG. 1.

Referring to the drawings, the server 500 may include a communication module 530, a storage unit 540, and a processor 520.

The communication module 530 may receive home appliance related information from the mobile terminal 600. In addition, the communication module 530 may transmit result information corresponding to the received home appliance related information to the mobile terminal 600.

To this end, the communication module 530 may include an Internet module or a mobile communication module.

The storage unit 540 may store received home appliance-related information and may include data for generating result information corresponding to the home appliance-related information.

For example, when the information related to the home appliance is information related to the home appliance, the storage unit 540 may store received product information for product registration of the home appliance.

The processor 520 may control the overall operation of the server 500.

Meanwhile, when receiving home appliance related information from the mobile terminal 600, the processor 520 may control to generate result information corresponding to the home appliance related information. In addition, the generated result information may be controlled to be transmitted to the mobile terminal 600.

For example, when the home appliance-related information is information related to the home appliance, the processor 520 may generate product registration result information of the home appliance.

Meanwhile, the server 500 may be a server operated by a manufacturer of the home appliance 200 or a server operated by an application store operator related to the home appliance 200.

6 is an internal block diagram of the mobile terminal of FIG. 1.

Referring to FIG. 6, the mobile terminal 600 includes a wireless communication unit 610, an audio/video (A/V) input unit 620, a user input unit 630, a sensing unit 640, an output unit 650, and A memory 660, an interface unit 670, a control unit 680, and a power supply unit 690 may be included.

Meanwhile, the wireless communication unit 610 may include a broadcast receiving module 611, a mobile communication module 613, a wireless Internet module 615, an acoustic communication unit 617, and a GPS module 619.

The broadcast receiving module 611 may receive at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like.

The broadcast signal and/or broadcast related information received through the broadcast receiving module 611 may be stored in the memory 660.

The mobile communication module 613 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission and reception of text/multimedia messages.

The wireless Internet module 615 refers to a module for wireless Internet access, and the wireless Internet module 615 may be built-in or external to the mobile terminal 600. For example, the wireless Internet module 615 may perform WiFi-based wireless communication or WiFi Direct-based wireless communication.

The acoustic communication unit 617 may perform acoustic communication. The acoustic communication unit 617 may output sound by adding predetermined information data to audio data to be output in the acoustic communication mode. In addition, the acoustic communication unit 617 may extract predetermined information data from sound received from the outside in the acoustic communication mode. For a detailed description of this, refer to FIGS. 4A to 4D.

In addition, as a short-range communication technology, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The Global Position System (GPS) module 619 may receive location information from a plurality of GPS satellites.

The A/V (Audio/Video) input unit 620 is for inputting an audio signal or a video signal, and may include a camera 621 and a microphone 623.

The user input unit 630 generates key input data that the user inputs to control the operation of the terminal. To this end, the user input unit 630 may include a key pad, a dome switch, and a touch pad (positive pressure/power failure). In particular, when the touch pad forms a layered structure with the display 651, this may be referred to as a touch screen.

The sensing unit 640 detects the current state of the mobile terminal 600, such as an open/closed state of the mobile terminal 600, a location of the mobile terminal 600, and whether a user is in contact, and controls the operation of the mobile terminal 600. It can generate a sensing signal.

The sensing unit 640 may include a detection sensor 641, a pressure sensor 643, a motion sensor 645, and the like. The motion sensor 645 may detect the movement or position of the mobile terminal 600 using an acceleration sensor, a gyro sensor, a gravity sensor, or the like. In particular, the gyro sensor is a sensor that measures an angular velocity, and can detect a direction (angle) that has turned relative to a reference direction.

The output unit 650 may include a display 651, a sound output module 653, an alarm unit 655, a haptic module 657, and the like.

The display 651 displays and outputs information processed by the mobile terminal 600.

Meanwhile, as described above, when the display 651 and the touch pad form a mutual layer structure to form a touch screen, the display 651 may be used as an input device capable of inputting information by a user's touch in addition to an output device. I can.

The sound output module 653 outputs audio data received from the wireless communication unit 610 or stored in the memory 660. The sound output module 653 may include a speaker, a buzzer, and the like.

The alarm unit 655 outputs a signal for notifying the occurrence of an event of the mobile terminal 600. For example, a signal can be output in the form of vibration. .

The haptic module 657 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 657 is a vibration effect.

The memory 660 may store a program for processing and control of the controller 680, and provides a function for temporary storage of input or output data (eg, phonebook, message, still image, video, etc.). You can also do it.

The interface unit 670 serves as an interface with all external devices connected to the mobile terminal 600. The interface unit 670 may receive data from such an external device or receive power and transmit it to each component inside the mobile terminal 600, and transmit the data inside the mobile terminal 600 to an external device. .

The controller 680 typically controls the operation of each unit to control the overall operation of the mobile terminal 600. For example, it is possible to perform related control and processing for voice calls, data communication, video calls, and the like. In addition, the controller 680 may include a multimedia playback module 681 for playing multimedia. The multimedia playback module 681 may be configured as hardware in the control unit 680 or may be configured as software separately from the control unit 680.

The power supply unit 690 receives external power and internal power under the control of the control unit 680 and supplies power necessary for the operation of each component.

Meanwhile, the block diagram of the mobile terminal 600 shown in FIG. 6 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the mobile terminal 600 that is actually implemented. That is, if necessary, two or more components may be combined into one component, or one component may be subdivided into two or more components to be configured. In addition, functions performed by each block are for explaining the embodiments of the present invention, and specific operations or devices thereof do not limit the scope of the present invention.

7 is a flow chart showing a method of operating a home appliance according to an embodiment of the present invention, Figure 8 is a flow chart showing a method of operating a home appliance according to another embodiment of the present invention, and FIGS. 9 to 14B are It is a diagram referred to for explanation of the operation method of FIG. 7 or 8.

First, referring to FIG. 7, the first home appliance 200a may enter an acoustic communication mode (S610). Meanwhile, operation S810 of FIG. 9 corresponds to operation S610 of FIG. 7.

Here, the acoustic communication mode may mean a mode in which the first home appliance 200a receives sound through the microphone 223. The controller 270 of the home appliance may control to activate the microphone 223 when a specific key of the first home appliance 200a is operated.

Next, the home appliance may receive sound through a microphone (S612). Meanwhile, step S812 of FIG. 9 corresponds to step S612 of FIG. 7.

When a predetermined sound is output from another home appliance or mobile terminal while the microphone 252 of the home appliance is activated, it may be received.

Next, the home appliance extracts information from the received sound (S615). Meanwhile, step S815 of FIG. 9 corresponds to step S615 of FIG. 7.

The acoustic communication unit 217 may include a synchronization unit 430, a frequency conversion unit 435, and a data extraction unit 440, as described above, to extract data from received sound. Then, through synchronization and frequency conversion, data can be extracted.

Next, the home appliance determines whether information related to other home appliances is included in the extracted information data (S616). And, if applicable, a sound including the extracted information is output to the corresponding home appliance or an adjacent home appliance (S620). Meanwhile, step 816 (S816) and step 820 of FIG. 9 may correspond to step 616 (S616) and step 620 (S620) of FIG. 7, respectively.

The control unit 270 or the sound output unit 217 determines whether information related to other home appliances is included in the extracted information data. For example, if the name of another home appliance (cooking equipment, TV, etc.) is included, or terms related to the main operation of the other home appliance (watching a broadcast, broadcasting program, temperature, etc.) are included, the relevant As a home appliance, it may be decided to output a sound including related information.

After the control unit 270 or the acoustic communication unit 217 decides to transmit the extracted information data to another home appliance, the acoustic communication unit 217 generates a sound including the extracted information data according to the acoustic communication mode. can do.

To this end, the acoustic communication unit 217 may include a frequency conversion unit 410, a data insertion unit 415, an inverse conversion unit 420, and a multiplexing unit 425, as described above. Accordingly, the extracted information data is added to the audio data to be output, and sound is output. The output sound includes other home appliances and related information.

Next, referring to FIG. 8, the second home appliance 200b receives sound from the first home appliance 200a (S720). Meanwhile, operation S820 of FIG. 9 may correspond to operation S720 of FIG. 8.

The microphone 223 of the second home appliance 200b may receive sound from the first home appliance 200a.

Next, the second home appliance 200b extracts information from the received sound (S723). Meanwhile, step 823 (S823) of FIG. 9 may correspond to step 723 (S723) of FIG. 8.

The acoustic communication unit 217 in the second home appliance 200b includes a synchronization unit 430, a frequency conversion unit 435, and a data extraction unit 440, as described above, to extract data from the received sound. can do. Then, through synchronization and frequency conversion, data can be extracted.

Next, the second home appliance 200b may determine whether the extracted information data is an operation control command (S725). And, if applicable, the second home appliance 200b is controlled to perform an operation according to the operation control command (S730). Meanwhile, steps 825 (S825) and 830 (S830) of FIG. 9 may correspond to steps 725 (S725) and 7520 (S725) of FIG. 8.

For example, if the extracted information data is information data indicating "power on the washing machine", it is possible to turn on the power of the washing machine, which is the second home appliance 200b. Specifically, it is possible for the washing machine in the standby power mode to be powered on to activate the display unit and the input unit of the washing machine.

Next, in step 725 (S725), if the extracted information data is not an operation control command, step 735 (S735) or lower may be performed.

The second home appliance 200b may determine whether the extracted information data is a voice memo (S735). And, if applicable, the voice memo is stored in the memory 260 (S740). Then, when there is a reproduction input (S742), the stored voice memo is reproduced and output (S745). On the other hand, step 835 (S835), step 840 (S840), step 842 (S842), and step 845 (S845) of FIG. 9 are described in step 735 (S735) and step 740 (S740) of FIG. , May correspond to steps 742 (S742) and 745 (S745).

Accordingly, the control unit of the second home appliance 200b stores the voice memo in the memory 260 when the extracted information data is a voice memo saying "It's a dinner today. Please do some laundry in the washing machine." Can be controlled to do.

Meanwhile, when a voice memo is received, the control unit of the second home appliance 200b may control to output a message informing it. As a result, the user can intuitively recognize it.

In addition, when the user presses a specific button in the input unit 220 of the second home appliance 200b, the voice memo 1030 stored in the memory may be reproduced and output. Accordingly, it is possible to simply check the stored memo.

10A to 10C illustrate data sharing between the refrigerator 200a and the washing machine 200b.

10A illustrates that the user 900 performs remote control using the mobile terminal 600. In particular, it exemplifies selecting the item "Power on the washing machine" by running the remote control application. Thereby, the mobile terminal 600 can output the sound Sc including information data of "power on the washing machine" according to the acoustic communication mode. Accordingly, the refrigerator 200a may receive a sound Sc including information data indicating “power on the washing machine”. In addition, information data may be extracted from the received sound Sc.

When the extracted information data includes information related to other home appliances other than the information related to itself, a sound including the extracted information data may be output.

FIG. 10B illustrates that the refrigerator 200a outputs a sound Sc including information data indicating “power on the washing machine” based on the received sound. In particular, it is illustrated that the sound Sc is output to the adjacent washing machine 200b.

Next, FIG. 10C illustrates that the washing machine 200b is turned on according to related information data included in the received sound Sc. In this case, a voice message or a text message indicating power-on of the washing machine 200b may be output.

11A to 11C illustrate data sharing between the refrigerator 200a and the TV 200f.

11A illustrates that the user 900 performs remote control using the mobile terminal 600. In particular, it exemplifies selecting the remote control item “TV channel 9” by running the remote control application.

Thereby, the mobile terminal 600 can output the sound S3 including information data of "TV channel 9" according to the acoustic communication mode. Accordingly, the refrigerator 200a may receive a sound S3 including information data of “TV channel 9”. Then, information data can be extracted from the received sound S3.

When the extracted information data includes information related to other home appliances other than the information related to itself, a sound including the extracted information data may be output.

11B illustrates that the refrigerator 200a outputs a sound S3 including information data “TV channel 9” based on the received sound. In particular, it is illustrated that the sound S3 is output to the adjacent TV 200f.

Next, FIG. 11C shows that the broadcast image 1120 of CH 11 is displayed on the TV 200f, and then the broadcast image 1130 of CH 9 is displayed according to the related information data included in the received sound data S3. Illustrate that. Accordingly, the user in front of the refrigerator can easily change the TV channel.

12A to 12C illustrate data sharing between the refrigerator 200a and the air conditioner 200c.

12A illustrates that the user 900 performs remote control using the mobile terminal 600. In particular, it exemplifies selecting the remote control item "lower temperature" by running the remote control application. Thereby, the mobile terminal 600 can output the sound Sg including information data "lowering the temperature" according to the acoustic communication mode. Accordingly, the refrigerator 200a may receive a sound Sg including information data of “lowering the temperature”. Then, information data can be extracted from the received sound Sg.

When the extracted information data includes information related to other home appliances other than the information related to itself, a sound including the extracted information data may be output.

12B illustrates that the refrigerator 200a outputs the sound Sg including information data “lowering the temperature” based on the received sound. In particular, it is illustrated that the sound Sg is output to the adjacent air conditioner 200c.

Next, FIG. 12C illustrates that the air conditioner 200c starts a cooling operation to lower the indoor temperature according to the related information data included in the received sound data Sg, and discharges the cooled air toward the user. do. As a result, the user who is in front of the refrigerator can easily reduce the temperature of the living room.

13A to 13E illustrate data sharing between the refrigerator 200a and the cooking appliance 200d.

13A illustrates that the user 900 performs remote control using the mobile terminal 600. In particular, it exemplifies selecting the item "a program notification" by running the remote control application. Thereby, the mobile terminal 600 can output the sound S6 including information data "a program notification" according to the acoustic communication mode. Accordingly, the cooking appliance 200d may receive a sound S6 including information data “a program notification”. Then, information data can be extracted from the received sound S6.

When the extracted information data includes information related to other home appliances other than the information related to itself, a sound including the extracted information data may be output.

13B illustrates that the cooking appliance 200d outputs a sound S6 including information data “a program notification” based on the received sound. In particular, it is illustrated that the sound S6 is output to the adjacent TV 200f.

Next, FIG. 13C illustrates that a program guide image 1320 in the TV 200f is displayed, and a program item 1325 is highlighted in accordance with information data included in the received sound S6. That is, the control unit in the TV 200f may determine a program start time point according to the information data included in the received sound S6.

In addition, the control unit in the TV 200f may control to turn on the TV or change a TV channel according to a program start time.

13D illustrates that a corresponding broadcast image 1330 is displayed at the start time of the program a, and a voice message 1335 notifying the start of the corresponding program is output. Accordingly, a user in front of the cooking appliance 200d can easily watch a desired TV program.

14A-14B illustrate sharing data between a plurality of home appliances.

14A shows an example of an arrangement of a plurality of home appliances in a house. Inside the house, a washing machine (200b) is arranged outside, a refrigerator (200a) and a cooking appliance (200d) are arranged in an adjacent kitchen, and a TV (200f) is arranged adjacent to the living room, and near the TV (200f). At, an air conditioner 200c may be disposed.

When the user 900 uses the mobile terminal 600, in front of the washing machine 200b, in a state in which home appliances in the house are arranged, "air conditioner on" selects the remote control item, the mobile terminal 600 May output sound Sc including information data of “air conditioner on” according to the acoustic communication mode.

Accordingly, the washing machine 200b adjacent to the mobile terminal 600 may receive a sound Sc including information data of “air conditioner on”. In addition, information data may be extracted from the received sound Sc.

When the extracted information data includes information related to another home appliance other than information related to itself, the washing machine 200b may output a sound Sc including information data of “air conditioner on”.

Accordingly, the refrigerator 200a adjacent to the washing machine 200b may receive a sound Sc including information data of “air conditioner on”. In addition, information data may be extracted from the received sound Sc.

When the extracted information data includes information related to another home appliance other than information related to itself, the refrigerator 200a may output a sound Sc including information data of “air conditioner on”.

Accordingly, the cooking appliance 200d adjacent to the refrigerator 200a may receive a sound Sc including information data of “air conditioner on”. In addition, information data may be extracted from the received sound Sc.

When the extracted information data includes information related to other home appliances other than information related to itself, the cooking appliance 200d may output a sound Sc including information data of “air conditioner on”. .

Accordingly, the TV 200f adjacent to the cooking appliance 200d may receive the sound Sc including information data of “air conditioner on”. In addition, information data may be extracted from the received sound Sc.

When the extracted information data includes information related to other home appliances other than the information related to itself, the TV 200f may output a sound Sc including information data of “air conditioner on”.

Accordingly, the air conditioner 200c adjacent to the TV 200f may receive the sound Sc including information data of “air conditioner on”. In addition, information data may be extracted from the received sound Sc.

When information related to itself is included in the extracted information data, an operation corresponding to the information data of the air conditioner 200c and “air conditioner on” may be performed. That is, the power of the air conditioner 200c can be turned on. Accordingly, it is possible to share related information with each other even with only the microphone and the sound output module without the use of a separate communication module.

Meanwhile, FIG. 14B is similar to FIG. 14A, but the TV 200f receives the sound Sc including information data of “air conditioner on” output from the refrigerator 200a, and not the cooking appliance 200d. There is a difference in outputting the sound Sc, including information data of "air conditioner on".

For example, when the power of the cooking appliance 200d is not turned on, the refrigerator 200a may increase the volume of the output sound so that the sound reaches a greater distance. Accordingly, the TV 200f can receive the sound Sc including information data of “air conditioning on”.

On the other hand, when there is no sound output including related data from the adjacent home appliance, it is possible to output a sound including information indicating this, and by this sound, ACK for data exchange between adjacent home appliances. The function may be activated.

The home appliance and its operation method according to the present invention are not limitedly applicable to the configuration and method of the embodiments described as described above, but the embodiments are all or part of each of the embodiments so that various modifications can be made. It may be selectively combined and configured.

On the other hand, the operating method of the home appliance of the present invention can be implemented as a code that can be read by a processor on a recording medium that can be read by a processor provided in the home appliance. The processor-readable recording medium includes all types of recording devices that store data that can be read by the processor. Examples of recording media that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and also include those implemented in the form of carrier waves such as transmission through the Internet. . In addition, the recording medium readable by the processor may be distributed over a computer system connected through a network, so that code readable by the processor may be stored and executed in a distributed manner.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be understood individually from the technical spirit or prospect of the present invention.

Claims (17)

In the operating method of the home appliance,
Receiving sound through a microphone;
Extracting information from the received sound;
If an operation control command is included in the extracted information, performing a corresponding operation; And
When other home appliance related information is included in the extracted information, outputting a sound including the related information through a sound output module; and
When the home appliance is a refrigerator, the home appliance,
A refrigerating compartment driving unit for operating a refrigerating compartment fan for supplying cooled air to the refrigerating compartment, a freezing compartment driving unit for operating a freezer compartment fan for supplying cooled air to the freezing compartment, and a compressor driving unit for operating a compressor for compressing a refrigerant. ,
The other home appliance,
Any one of an air conditioner including a compressor driving unit, a washing machine driving a drum or a tub, a cooking appliance including a microwave driving unit for outputting microwaves, or a vacuum cleaner including a fan motor driving unit for inhaling air, and a TV,
The home appliance includes the microphone and the sound output module,
When information on the operation of the washing machine is included in the extracted information, a first sound including information on the operation of the washing machine is output through the sound output module,
When the information on the operation of the TV is included in the extracted information, a second sound including information on the operation of the TV is output,
When the information on the operation of the air conditioner is included in the extracted information, a third sound including information on the operation of the air conditioner is output. The method of claim 1,
The sound output step,
A method of operating a home appliance, characterized in that outputting the sound to a corresponding home appliance or an adjacent home appliance. delete The method of claim 1,
When the voice memo is included in the extracted information, storing the voice memo in a memory. The method of claim 1,
The information extraction step,
Synchronizing the received sound;
Frequency converting the synchronized sound signal;
And extracting the information from the frequency-converted sound signal. The method of claim 1,
The sound output step,
Frequency converting an audio signal to be output;
Inserting the extracted information data into the frequency-converted audio signal;
Inversely transforming an audio signal into which the information data is inserted; And
And outputting the sound based on the inversely transformed audio signal. The method of claim 6,
Multiplexing the inversely transformed audio signal; further comprising,
The sound output step,
And outputting the sound based on the multiplexed audio signal. The method of claim 6,
The frequency conversion step,
A method of operating a home appliance, comprising frequency transforming the audio signal based on a modulated complex lapped transform (MCLT). In the operating method of the home appliance,
Receiving sound from another home appliance through a microphone;
Extracting information from the received sound;
If the extracted information includes an operation control command, performing a corresponding operation; And
If the extracted information includes a voice memo, storing the voice memo in a memory; Including,
When the home appliance is a refrigerator, the home appliance,
A refrigerating compartment driving unit for operating a refrigerating compartment fan for supplying cooled air to the refrigerating compartment, a freezing compartment driving unit for operating a freezer compartment fan for supplying cooled air to the freezing compartment, and a compressor driving unit for operating a compressor for compressing a refrigerant. ,
The other home appliance,
Any one of an air conditioner including a compressor driving unit, a washing machine driving a drum or a tub, a cooking appliance including a microwave driving unit for outputting microwaves, or a vacuum cleaner including a fan motor driving unit for inhaling air, and a TV,
The home appliance includes the microphone and a sound output module that outputs sound,
When information on the operation of the washing machine is included in the extracted information, a first sound including information on the operation of the washing machine is output, and
When the information on the operation of the TV is included in the extracted information, a second sound including information on the operation of the TV is output,
When the information on the operation of the air conditioner is included in the extracted information, a third sound including information on the operation of the air conditioner is output. The method of claim 9,
And reproducing and outputting the stored voice memo when there is a reproduction input for the voice memo. The method of claim 9,
The information extraction step,
Synchronizing the received sound;
Frequency converting the synchronized sound signal;
And extracting information related to the home appliance from the frequency-converted sound signal. In the home appliance,
Driving unit;
A control unit for controlling the driving unit;
A microphone for receiving external sound;
Sound output module; And
Including; a sound communication unit for extracting information from the sound received from the microphone, and outputting a sound including the related information to the sound output module when other home appliance related information is included in the extracted information,
When the home appliance is a refrigerator, the home appliance,
A refrigerating compartment driving unit for operating a refrigerating compartment fan for supplying cooled air to the refrigerating compartment, a freezing compartment driving unit for operating a freezer compartment fan for supplying cooled air to the freezing compartment, and a compressor driving unit for operating a compressor for compressing a refrigerant. ,
The other home appliance,
Any one of an air conditioner including a compressor driving unit, a washing machine driving a drum or a tub, a cooking appliance including a microwave driving unit for outputting microwaves, or a vacuum cleaner including a fan motor driving unit for inhaling air, and a TV,
The control unit,
When an operation control command is included in the extracted information, the operation is controlled to be performed,
The acoustic communication unit,
When information on the operation of the washing machine is included in the extracted information, a first sound including information on the operation of the washing machine is output, and
When the information on the operation of the TV is included in the extracted information, a second sound including information on the operation of the TV is output,
When the information on the operation of the air conditioner is included in the extracted information, a third sound including information on the operation of the air conditioner is output. delete The method of claim 12,
It further includes a memory;
The control unit,
When a voice memo is included in the extracted information, the home appliance is configured to control to store the voice memo in the memory. The method of claim 12,
The acoustic communication unit,
A synchronization unit for synchronizing the received sound;
A frequency converter for frequency conversion of the synchronized sound signal;
And a data extracting unit for extracting the information from the frequency-converted sound signal. The method of claim 12,
The acoustic communication unit,
A frequency converter for frequency conversion of an audio signal to be output;
A data insertion unit for inserting the extracted information data into the frequency-converted audio signal;
An inverse transform unit for inverse transforming the audio signal into which the information data is inserted; And
And a multiplexer for multiplexing the inversely transformed audio signal. The method of claim 14,
The control unit
When there is a playback input for the voice memo, the stored voice memo is played and controlled to be output from the sound output module.

Images