KR20190043519A - Voice recognition module - Google Patents

Abstract

The present invention relates to a voice recognition device. According to an embodiment of the present invention, the voice recognition device comprises: an audio input unit acquiring voice; a communication module transmitting voice data from the audio input unit to a server system performing voice recognition and receiving recognition result data for the voice data from the server system; and a control unit controlling the audio input unit and the communication module. The control unit controls to perform an operation corresponding to a keyword command when a voice command in the voice data corresponds to the prestored keyword command and to transmit the voice data including the voice command to the server system when the voice command in the voice data does not correspond to the prestored keyword command. Accordingly, the voice recognition may be efficiently performed.

Description

[0001] Voice recognition module [0002]

The present invention relates to a speech recognition apparatus, and more particularly, to a speech recognition apparatus capable of efficiently performing speech recognition.

The speech recognition apparatus is a device for performing a speech recognition function.

On the other hand, home appliances such as an air conditioner, a washing machine, a vacuum cleaner, and the like used in a predetermined space such as a home or an office perform unique functions and operations according to user's operations.

On the other hand, for the operation of the home appliance, the user can use a remote control device such as a remote controller to avoid the inconvenience of directly operating a button or the like provided in the home appliance body or inputting it to the main body every time.

However, even when a remote controller is used, the user has to select and input an operation key for each function, which is inconvenient to use, and when the room is dark, separate illumination for identifying the remote controller and the operation key is required .

Therefore, there is an increasing research on a method of controlling a home appliance using speech recognition technology.

Prior Art 1 (Laid-Open Patent Publication No. 10-1999-00069703) discloses a remote controller for an air conditioner having an audio input unit and a signal processing unit to generate and transmit an operation signal according to voice recognition.

In the conventional art 2 (Japanese Unexamined Patent Publication (Kokai) No. 10-2006-0015092), an input voice signal is converted into a digital signal and text, and it is checked whether there is a control command in the database. And if there is no matching control command, extracts the keyword and controls each device in the air conditioner according to the associated control command.

However, there is a limit to the system resources that individual devices such as remote controllers and air conditioners can have. Especially, it is difficult to realize embedded modules that are installed in individual devices because it requires a high computation amount to recognize natural words rather than only a few words.

Therefore, the speech recognition technology of the related art 1 and the conventional art 2 has a limitation in recognizing and processing various natural language voice commands of users all over the world.

Therefore, there is a need for a method that can recognize and process natural language without restriction of the system resources of the individual devices, and can conveniently control the home appliance.

An object of the present invention is to provide a speech recognition apparatus capable of efficiently performing speech recognition.

It is another object of the present invention to provide a speech recognition apparatus capable of performing natural language speech recognition by communication with a server system.

According to another aspect of the present invention, there is provided a speech recognition apparatus including: an audio input unit for acquiring speech; and a server system for performing speech recognition processing, the speech recognition apparatus comprising: And a control section for controlling the audio input section and the communication module, wherein when the voice command in the voice data corresponds to a pre-stored keyword command, the control section controls the communication module corresponding to the keyword command And controls to transmit the voice data including the voice command to the server system when the voice command in the voice data does not correspond to the pre-stored keyword command.

According to another aspect of the present invention, there is provided a speech recognition method comprising: receiving a voice command through a microphone; receiving a voice command corresponding to a keyword command corresponding to a previously stored keyword command; And transmitting voice data including a voice command to a voice server when the voice command does not correspond to a pre-stored keyword command.

The speech recognition apparatus according to an embodiment of the present invention includes an audio input unit for acquiring a voice and a server system for performing speech recognition processing and transmitting voice data from the audio input unit, And a control unit for controlling the audio input unit and the communication module. When the voice command in the voice data corresponds to the pre-stored keyword command, the control unit performs control to perform an operation corresponding to the keyword command , And when the voice command in the voice data does not correspond to the pre-stored keyword command, voice data including the voice command is transmitted to the server system, thereby enabling voice recognition to be performed efficiently. In particular, there is no need for the user to operate the remote controller, and the user convenience can be increased. In addition, keyword commands and natural language commands can be recognized and processed.

Particularly, when a keyword is included in the voice data in a state in which the keyword voice is a simple voice, it is possible to perform the corresponding operation immediately without communicating with the server system. Therefore, Lt; / RTI >

On the other hand, when natural language is included in the voice data instead of keywords, the accuracy of natural language recognition is improved by performing natural language recognition through the server system.

On the other hand, when the voice data including the voice command is unsuccessfully transmitted to the voice server, the operation corresponding to the keyword command most similar to the voice command is performed, so that the convenience of the user can be increased.

On the other hand, when the result data is not received from the server system, the control unit controls the output of the re-order request message so that the user's convenience of use can be increased.

On the other hand, when any one of the automatic speech recognition server, the natural language processing server, and the linkage service server in the server system fails, the control unit controls the user to determine which server of the server system is malfunctioning I will be able to tell you whether.

Meanwhile, a speech recognition method according to an embodiment of the present invention includes: receiving a voice command through a microphone; performing an operation corresponding to a keyword command when the received voice command corresponds to a pre-stored keyword command And transmitting the voice data including the voice command to the voice server when the received voice command does not correspond to the pre-stored keyword command, thereby enabling voice recognition to be efficiently performed. In particular, there is no need for the user to operate the remote controller, and the user convenience can be increased.

1 illustrates a home network system according to an embodiment of the present invention.
2 illustrates a home network system according to another embodiment of the present invention.
3 is a perspective view illustrating a speech recognition apparatus according to an embodiment of the present invention.
4 is a front view (a) of the speech recognition apparatus and a sectional view (b) taken along line A1-A1 shown in (a).
5 is an enlarged view of a portion of FIG.
6A is a right side view of the voice recognition device.
Fig. 6B is a cross-sectional view of the grill taken at each part shown in Fig. 6A.
7 is a block diagram showing the control relationship between the main parts constituting the speech recognition apparatus.
8 is an exploded perspective view of the cover.
Fig. 9 shows a cover in which a window is removed.
10 is an exploded view of the state before the voice input PCB is coupled to the window support.
11 is a sectional view of the state in which the voice input PCB is coupled to the window support.
12A is a perspective view showing the top surface of the window support.
12B is a perspective view showing the bottom of the window support.
12C is a right side view of the window support.
12D is a bottom view of the window support.
Fig. 13 is a front view of the cover shown in Fig.
14A is a cross-sectional view taken along B3-B3 shown in FIG.
Fig. 14B is a cross-sectional view taken along line A3-A3 shown in Fig. 13. Fig.
Fig. 14C is a cross-sectional view taken along line C3-C3 shown in Fig.
FIG. 14D is a sectional view taken along the line D3-D3 shown in FIG.
15 is a right side view of the cover.
16A is a cross-sectional view taken along line F1-F1 in FIG.
16B is a cross-sectional view taken along line F2-F2 in Fig.
Figure 17 shows the window support removed in the assembly shown in Figure 9;
Figure 18 shows the display removed from the assembly shown in Figure 17;
19 is a plan view of the display PCB.
Fig. 20 is a perspective view showing the display PCB so that the bottom surface thereof is seen. Fig.
21 is an exploded perspective view of a cover and a button.
22 is a plan view (a) and a perspective view (b) of the cover housing.
23 is a rear view of the cover housing.
Fig. 24 is a perspective view showing the main body so that its upper surface is seen. Fig.
25 is a perspective view showing the main body so that its bottom surface is seen.
26 shows the front case (a) and the rear case (b).
27 shows a rear surface of the main body.
28 is a view showing positions of antennas connected to the Wi-Fi module.
29 is a view showing positions of an antenna connected to the Bluetooth module and an antenna connected to the GPS module.
30 is an exploded perspective view of the main body, the heat sink, the main PCB, the base body, and the supporting rubber.
31 is a view schematically showing a smart home system including a speech recognition server system and a speech recognition apparatus according to an embodiment of the present invention.
32A is an example of a speech recognition server system according to an embodiment of the present invention.
32B is a block diagram of a speech recognition server system according to an embodiment of the present invention.
33 to 35 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention.
36 to 38 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention.
FIG. 39 is a diagram showing an example of an internal block diagram of a server according to an embodiment of the present invention.
40 is a block diagram of an internal block diagram of a speech recognition apparatus according to an embodiment of the present invention.
41 is a flowchart illustrating an operation method of the speech recognition apparatus according to an embodiment of the present invention.
42 is a flowchart illustrating an operation method of a smart home system including a voice recognition server system and a voice recognition apparatus according to an embodiment of the present invention.
43 to 48 are diagrams referred to in explaining various operations of the speech recognition server system and the speech recognition apparatus according to an embodiment of the present invention.
49 is a flowchart illustrating an operation method of a speech recognition apparatus according to another embodiment of the present invention.
Figs. 50A to 51F are drawings referred to in the description of the operation method of Fig.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, it is needless to say that the present invention is not limited to these embodiments and can be modified into various forms.

In the drawings, the same reference numerals are used for the same or similar parts throughout the specification.

The suffix " module " and " part " for components used in the following description are given merely for convenience of description and do not give special significance or role in themselves. Thus, " module " and " part " may be used interchangeably.

1 illustrates a network system according to an embodiment of the present invention.

A network system is a collection of devices that establish a network by mutual communication within a certain space such as a home or an office. As an example of such a network system, FIG. 1 shows a home network system built in a home.

Hereinafter, the device 1 exemplifies a voice recognition device (Hub) 1 for a communication network having an acoustic output function, but is not necessarily limited thereto. Depending on the viewpoint, the apparatus 1 may be referred to as an audio output device.

1, a network system according to an exemplary embodiment of the present invention includes an accessory 2, 3a, 3b, a gateway 4, an access point 7, Or a sound output device.

The accessory 2, 3a, 3b, the gateway 4, the access point 7 and / or the speech recognition device 1 can communicate with each other according to a predetermined communication protocol, Fi, Ethernet, Zigbee, Z-wave, Bluetooth, and the like.

Wi-fi is a trademark of the Wi-Fi Alliance. It is a term commonly used as a wireless communication technology. It is a term used for wireless communication between devices in accordance with the general rules defined by the WLAN standard (IEEE 802.11) Refers to a set of technologies that support LAN connectivity, device-to-device connectivity (Wi-Fi P2P), wireless LAN connectivity, and PAN / LAN / WAN configurations. Hereinafter, " Wi-Fi module " is defined as a wireless communication device based on Wi-Fi technology.

Ethernet is a networking technology according to the IEEE 802.3 standard, and is the most representative standard for local area network (LAN) hardware, protocols, and cables. Ethernet uses mainly CSMA / CD (Carrier Sense Multiple Access with Collision Detection) for data transmission. Hereinafter, " Ethernet module " is defined as a device that performs communication based on Ethernet technology.

Zigbee is a wireless network technology for configuring and communicating a private communication network using a small, low-power digital radio. It is a communication method according to the regulations defined in IEEE 802.15. It is small size, low power consumption, low cost, and it is widely used as a ubiquitous building solution such as home network. It is used in the near field communication market of intelligent home network, building, industrial automation, logistics, human interface, telematics, environmental monitoring and military.

The mobility protocol consists of a physical layer, a media access control (MAC) layer, a network layer, and an application layer. The physical layer and the MAC layer are defined in the IEEE 802.15.4 standard.

ZigBee Home Network Public Profile and ZigBee Smart Energy Profile are used as the application profiles. The RF4CE, a new off-the-shelf specification, defines a simple network stack for star topology and a solution for remote control of appliances. RF4CE uses 2.4GHz frequency band and provides security using AES-128.

Low power transmission rate is sufficient for long battery life and security, and it is suitable for periodic or intermittent data transmission or data transmission for simple signal transmission such as sensors and input devices. Applications include wireless lighting switches, household watt-hour meters, traffic management systems, and other personal and industrial devices that require near-field low-speed communication. The advantage is that it is relatively simple and inexpensive compared to other WPAN technologies such as Bluetooth and Wi-Fi. Hereinafter, the " occupancy module " is defined as a device that performs wireless communication based on the occupancy technology.

Z-wave is a wireless transmission scheme designed for devices requiring low power and low bandwidth, such as home automation and sensor networks, to provide reliable communication between one or more nodes and control units in a wireless network. Main purpose. JiWave is composed of physical layer, media access control (MAC) layer, transport layer, routing layer and application layer. It uses 9.6kbps and 40kbps (900MHz band, Europe: 869MHz, USA: 908MHz) , And a speed of 200kbps. Hereinafter, " geo-wave module " is defined as a device that performs wireless communication based on geo-wave technology.

The accessory 2 may be installed at any position desired by the user and may include various sensors such as a temperature sensor, a humidity sensor, a vibration sensor, a proximity sensor, and an infrared (IR) sensor. The information obtained by these sensors can be transmitted to the voice recognition device 1 via the network and vice versa that signals for the control of the sensors from the voice recognition device 1 are transmitted to the accessory 2 It is possible.

Also, the accessory 2 can be configured to be able to remotely control peripheral equipment located nearby. For example, the accessory 2 may include an originating device that emits an infrared signal in accordance with a control signal transmitted over the network.

On the other hand, the infrared sensor may include a transmitter for irradiating infrared rays and a receiver for receiving infrared rays irradiated from the transmitter when the infrared rays hit the object and are reflected.

The access point 7 is a device that relays the wireless device to a network so as to connect the home network with the Internet. The home appliance 5, the voice recognition device 1, the accessory 3b and the like may be connected to the access point 7 by wire (e.g., Ethernet) or wireless (e.g., Wi-Fi).

The gateway 4 is a device for connecting these networks to each other so that other networks can exchange information with each other. For example, it is possible to relay the accessories 2 and 3b and the access point 7 by converting a signal of a lengthwise (or gyro-wave) type received from the accessory 2 or 3b into a signal of a wifi type.

On the other hand, the home network system can be connected to the Internet through the access point 7, and can be connected to the server 8 providing the service through the Internet. A server (or a cloud) 8 is managed by a manufacturer, a seller or a service provider contracted with the manufacturer (2), (3a, 3b) and / . The server 8 stores software and data, which may be received from a home network. When there is a request from the speech recognition apparatus 1, the server 8 can transmit the stored software or data to the home network via the Internet.

The server 8 can exchange information with a mobile terminal such as a PC (personal computer) or a smart phone connected to the Internet. Information transmitted from the speech recognition device 1 or the accessories 2, 3a and 3b can be stored in the server 8 and these information can be transmitted to the mobile terminal 6 connected to the server 8 . The information transmitted from the mobile terminal 6 can also be transmitted to the voice recognition device 1 or the accessory 2, 3a, 3b via the server 8, It is also possible to control the recognition device 1 or accessories 2, 3a, 3b.

As a kind of mobile terminal 6, since a smart phone widely used recently provides a convenient UI based on a graphic, it is possible to control accessories 2, 3a and 3b through the UI, 2, 3a, 3b) can be processed and displayed. In addition, by updating an application installed in the smartphone, functions that can be implemented through the accessory 2, 3a, 3b can be expanded or changed. However, it is also possible to control the accessories 2, 3a, and 3b using the voice recognition device 1 alone or to process and display information received from the accessories 2, 3a, and 3b without using the mobile terminal 6 Do.

The communication between the voice recognition apparatus 1 and the accessory 2, 3a, 3b can be performed via the gateway 4 and the access point 7. Specifically, the signal output from the accessory 2, (Or information) is transmitted to the voice recognition device 1 via the gateway 4 and the access point 7 in turn. Conversely, the information output from the voice recognition device 1 is transmitted to the access point 7, (4) to the accessory (2, 3b) in turn. According to the embodiment, the communication between the accessory 2, 3a, 3b and the speech recognition device 1 is possible even when the network is disconnected from the Internet.

In addition to the accessories 2, 3a, 3b described above, various kinds of accessories may be provided according to the embodiment. For example, the accessory can be configured to include an air quality sensor that senses the quality of the air, a smart plug, a CT sensor, a nest temperature controller, a sleep sensor, and the like.

The accessory may be attached to the home appliance (5). For example, an accessory having a vibration sensor may be attached to a washing machine to detect vibrations generated during operation of the washing machine, and a signal output from the vibration sensor may be transmitted to the network according to the sensed vibration.

However, the accessory may be attached to a place other than the home appliance 5. For example, when an attempt is made to detect the opening and closing of a door in a residence, an accessory having a motion detection sensor (for example, an infrared ray sensor) may be attached to the wall to detect opening and closing operations of the door. If the opening and closing operation of the door in the dwelling is not detected for a long period of time, there is a possibility that the dwelling person has been changed, and such a situation may be notified to the predetermined mobile terminal 6.

Further, when the opening / closing operation of the refrigerator door is detected by using the accessory having the motion detection sensor and the opening / closing operation of the refrigerator door is not detected for a long time, there is a possibility that the inhabitant is changed. This situation can be notified to the predetermined mobile terminal 6.

In such embodiments, a signal transmitted over the network from the accessory may be received by the mobile terminal 6, and the application loaded on the mobile terminal 6 may analyze the received signal and transmit the signal to the home appliance 5 (For example, an unbalance of the washing machine) and door opening / closing information of the washing machine (for example, a warning indicating the abnormal operation of the washing machine, A notification that the door is not opened or closed, a request for confirming the occupant's personal identity, etc.) may be displayed through the display of the mobile terminal 6 or the speaker.

On the other hand, the speech recognition apparatus 1 may include a microphone (not shown), and may extract commands from the speech inputted through the microphone in accordance with the installed speech recognition program and perform control accordingly.

2 illustrates a home network system according to another embodiment of the present invention.

The home network system according to another embodiment of the present invention is different from the above embodiment in that the gateway 4 is not provided and the voice recognition device 1 also functions as the gateway 4 And the other features are substantially the same as in the case of the above-described embodiment.

The accessories 2 and 3b can communicate directly with the speech recognition device 1 without sharing the gateway 4 (see Fig. 1). Preferably, the accessory 2, 3b and the voice recognition device 1 communicate via the directivity method, in which case the accessory 2, 3b and the speech recognition device 1 may each be equipped with a directivity module .

3 is a perspective view illustrating a speech recognition apparatus according to an embodiment of the present invention. 4 is a front view (a) of the speech recognition apparatus and a sectional view (b) taken along line A1-A1 shown in (a). 5 is an enlarged view of a portion of FIG. 6A is a right side view of the voice recognition device. Fig. 6B is a cross-sectional view of the grill taken at each part shown in Fig. 6A. 7 is a block diagram showing the control relationship between the main parts constituting the speech recognition apparatus. 8 is an exploded perspective view of the cover. Fig. 9 shows a cover in which a window is removed. 10 is an exploded view of the state before the voice input PCB is coupled to the window support. 11 is a sectional view of the state in which the voice input PCB is coupled to the window support.

3 to 11, a speech recognition apparatus (or speech recognition apparatus) 1 according to an embodiment of the present invention includes a cover 10, a main body 40, a grill 20, and a base 30 . The main body 40 is supported by the base 30 positioned at the lower side and the cover 10 can be coupled to the upper side of the main body 40.

The body (40) is disposed in the grill (20). Not all of the body 40 has to be placed completely within the grill 20, and the body 40 can be partially projected through the top of the grill 20, as in the embodiment. The grill 20 is formed with a plurality of through holes 20h and is formed in a vertically long cylindrical shape and surrounds the main body 40.

A porous filter (not shown) may be attached to the inner surface of the grill 20 so that dust does not enter the grill 20 through the through hole 20h. The filter may be made of a material having fine pores such as a mesh or a nonwoven fabric. The filter may be attached to the inner surface of the grill 20 by an adhesive member such as double-sided tape. The filter also serves to conceal the configuration of the speakers 43 and 44 and the body cases 41 and 42 disposed in the grill 20 from being visible from the outside through the through holes 20h.

3, the through hole 20h is formed in a part of the grill 20 and is omitted in the other parts. However, the through hole 20h is omitted in order to avoid complication of the drawing. And the sound outputted from the speakers 43 and 44 to be described later can be spread evenly through the through holes 20h in front, back, left, right, and all directions.

The cover 10 may include a window 11, a window support 12, a display 13, a printed circuit board 14 and a cover housing 15. The window 11, the window support 12, the display 13 and the display PCB 14 may be disposed within the cover housing 15.

4 to 5, the cover housing 15 is made of synthetic resin, is coupled to the upper portion of the main body 40, and has an opening 15h formed on the upper surface thereof. The cover housing 15 has a cylindrical shape and includes a side wall 151 defining an opening 15h at an upper end thereof and a partition plate (not shown) extending upward from the inside of the side wall 151, 152). The display PCB 14, the display 13, the window support 12, and the window 11 are disposed on the upper side of the partition plate 152. (See FIGS. 21 to 22 for the detailed configuration of the cover housing 15).

The lower end 151a of the side wall 151 preferably contacts the upper end of the grill 20, but a fine clearance due to the clearance may exist between them. The lower end 151a of the side wall 151 overlaps at least a part with the upper end of the grill 20. [ There is a gap between the outer surface of the side wall 151 and the outer surface of the grill 20 but the outer surface of the side wall 151 and the outer surface of the grill 20 except for the above- It forms a continuous contour.

The upper end holding portion 153 extends downward from the lower end 151a of the side wall 151 and is engaged with the grill 20. The upper end holding portion 153 and the grill 20 are not engaged with each other by using a separate fastening member such as a bolt but the upper end holding portion 153 is inserted into the upper end opening of the grill 20 And it is preferably a force fitting type using the elasticity / restoring force of the grill 20 or the upper holding portion 153 itself.

The upper end holding portion 153 is positioned further inside than the lower end portion of the side wall 151 (i.e., the outer side surface of the cover housing 15 is recessed at the lower end 151a of the side wall 151, The upper end of the side wall 151 extends from the outer surface of the side wall 151 to the upper end holding portion 153 so that the upper surface of the grill 20 faces the opposite surface 157 do.

The cover housing 15 may have protrusions 154 protruding from the inner side surface of the side wall 151 and protrusion insertion grooves 418 may be formed in the front surface of the main body 40 to engage with the protrusions 154 . The protrusion 154 moves along the outer surface of the main body 40 while the cover housing 15 and the main body 40 are assembled with each other. When the protrusion 154 reaches the protrusion insertion groove 418, the cover housing 15 itself made of synthetic resin Is inserted into the projection insertion groove 418 by the elasticity of the projection.

The top surface of the upper end holding portion 153 abuts the inner surface of the grill 20, so that the shape of the upper end of the grill 20 is maintained. Particularly, when the grill 20 is made of a metal material, the grill 20 is deformed corresponding to the shape of the upper end holding portion 153, so that the upper end of the grill 20 corresponds to the upper end holding portion 153 . ≪ / RTI >

On the other hand, when the upper end holding portion 153 extends in an elliptical shape along the lower end 151a of the side wall 151, the metal plate is rolled to form a cylindrical grill 20 having a domed shape in cross section, The shape of the grill 20 is deformed into an elliptical shape corresponding to the shape of the upper end holding portion 153 and can be maintained in the deformed state.

As in the embodiment, a garden-like window 11 having a radius r is formed at a predetermined angle (indicated by? 1 in FIG. 6A, an acute angle, hereinafter also referred to as a "first angle") with respect to a predetermined horizontal plane. When the vector Vh obtained by orthogonalizing the normal vector Vs with respect to the upper surface of the window 11 to the horizontal plane is directed toward the static room, the form in which the window 11 is orthogonally projected in the horizontal plane, And has an ellipse having a long radius of r in the left-right direction. Therefore, in order to provide a sense of unity of the outline of the voice recognition apparatus 1, the cross section of the grill 20 is also preferably formed in a shape corresponding to the ellipse (that is, a shape in which the ratio of the minor axis to the major axis is cos? The shape of the cross section of the grill 20 can be maintained in a shape corresponding to the ellipse by forming the concave portion 153 in a shape corresponding to the ellipse. Here, the " corresponding form " includes not only the case where the shapes of the both shapes are completely matched with each other, but also the case where both shapes resemble each other (for example, In the following, the same meaning is defined.

Here, the angle? 1 at which the window 11 is tilted with respect to the horizontal plane is determined in consideration of the user's gaze in a general use environment, so that the voice recognition device 1 is placed on a cradle The angle of view of a general adult positioned in front of the voice recognition device 1 is set to be close to 90 degrees with the upper surface of the window 11, preferably about 20 degrees, It should not be.

On the other hand, the display panel 131 may be arranged to be inclined at a predetermined angle with respect to the horizontal so that the displayed screen faces the upper side of the front side, and is preferably inclined at the same angle? 1 as the window 11. The window support plate 121 to be described later is also inclined at the same angle as the display panel 131 (or the window 11).

6A and 6B, the upper end of the side wall 151 of the cover housing 15 is of a garden type having an outer diameter L1, and the outer diameter of the lower end 151a of the side wall 151 is a Is inclined at an angle? 2 (? 2 <? 1 or less,? 2 is also referred to as a "second angle") with a diameter of La in the lateral direction and a diameter of Lb in the forward and backward directions. Here, since the outer surface of the side wall 151 is inclined at a predetermined angle? 3 with respect to the vertical line, the end face S1 of FIG. 6B is orthogonal to the horizontal plane, and the end face S2 does not exactly coincide with the horizontal face , and if the value of? 3 is sufficiently small (preferably, 5 degrees or less), La has a value close to L1, and hence La = L1. Further, if the difference between? 1 and? 2 is sufficiently small (preferably, 5 degrees or less), Lb also has a value close to L1, and Lb = L1 is assumed below.

The angle θ3 is an angle formed by the outer surface of the side wall 151 and the vertical line. The angle θ3 may have a constant value over the entire outer surface of the side wall 151. However, It is also possible to vary.

6B, the grill 20 has an outer diameter of elliptical shape (L1> L2), a long diameter L1 in the left-right direction and a short diameter L2 in the front-rear direction. Here, as assumed above, when La = L1 and Lb = L1, L2 becomes L1 cos? 1. That is, the outer shape of the grill 20 having a regular view on the horizontal plane is an ellipse having a shape in which the diameter L2 in the front-rear direction is shorter than the straightness L1 in the lateral direction. When the window 11 is tilted and disposed, when the speech recognition device 1 is viewed from above, its external shape becomes elliptical in its entirety to provide a sense of unity.

The upper end holding portion 153 is completely inserted into the inside of the grill 20 and the upper end holding portion 153 is inserted into the upper portion of the grill 20, The voice recognition device 1 is not visible.

The positioning protrusion 156 can be protruded from the lower end of the side wall 151 and the positioning protrusion 156 is inserted into the upper end of the grill 20 in a state where the grill 20 is properly positioned A positioning groove can be formed.

The window 11 may be disposed in the opening 15h of the cover housing 15. [ The window 11 is formed by processing a transparent plate having a constant thickness, and the side surface (or the outer peripheral surface) is orthogonal to the upper surface and the lower surface.

The inner surface of the cover housing 15 is formed so that a certain portion 151b extending downward from the upper end of the cover housing 15 is positioned in a direction in which the upper surface of the window 11 faces ). An upper end inner side surface 151a of the side wall 151 is a bar that defines the opening 15h. Hereinafter, the upper end inner side surface 151b of the side wall 151 is referred to as an opening limiting surface. The opening-defining surface 151b is formed in a cylindrical shape extending from the periphery of the opening 15h, and the window 11 is disposed on the inside surrounded by the opening-defining surface 151b. Preferably, the upper surface of the window 11 belongs to the same plane as the upper end of the cover housing 15 (or the plane to which the opening 15h belongs), so that the upper surface of the voice recognition device 1 is made up of one plane A sense of unity is created.

The opening-defining surface 151b is formed in a plane parallel to the vector Vs at any position. That is, even if the cover housing 15 is cut by an arbitrary plane parallel to the vector Vs, the opening defining surface 151b on the section is parallel to the vector Vs.

When the center of the window 11 and the center of the opening defining surface 151b are aligned along the vector Vs because the opening defining surface 151b is parallel to the side surface of the window 11, It is possible to maintain a constant gap g with the opening-defining surface 151b. This is because the gap g is maintained between the window 11 and the upper end of the cover housing 15 when the speech recognition device 1 is viewed from the top, The gap g is set such that the side surface of the window 11 does not interfere with the opening defining surface 151b when the window 11 is pressed to operate the contact switches 181a, 181b, 181c, and 181d It is desirable to set it to the minimum.

When the cover housing 15 is cut into an arbitrary vertical plane, the outer side surface of the side wall 151 is parallel to the normal vector Vs or gradually away from the normal vector Vs toward the lower side Can be achieved. When the cover housing 15 is injection-molded, the cover housing 15 is taken out from the first mold forming the side wall 151 vertically downward. Accordingly, in order for the cover housing 15 to be detached from the first metal mold, the outer surface of the side wall 151 should have the above-described shape.

On the other hand, in order to form the opening 15h on the upper surface of the cover housing 15, a separate second mold having a core inserted into the opening 15h is required. The cover housing 15 can be separated from the second mold by moving the second mold while the first mold is removed. At this time, the movement of the second mold is equal to the normal vector Vs Direction.

12A is a perspective view showing the top surface of the window support. 12B is a perspective view showing the bottom of the window support. 12C is a right side view of the window support. 12D is a bottom view of the window support. Fig. 13 is a front view of the cover shown in Fig. 14A is a cross-sectional view taken along B3-B3 shown in FIG. Fig. 14B is a cross-sectional view taken along line A3-A3 shown in Fig. 13. Fig. Fig. 14C is a cross-sectional view taken along line C3-C3 shown in Fig. FIG. 14D is a sectional view taken along the line D3-D3 shown in FIG. 15 is a right side view of the cover. 16A is a cross-sectional view taken along line F1-F1 in FIG. 16B is a cross-sectional view taken along line F2-F2 in Fig. Figure 17 shows the window support removed in the assembly shown in Figure 9; Figure 18 shows the display removed from the assembly shown in Figure 17; 19 is a plan view of the display PCB. Fig. 20 is a perspective view showing the display PCB so that the bottom surface thereof is seen. Fig. 21 is an exploded perspective view of a cover and a button. 22 is a plan view (a) and a perspective view (b) of the cover housing. 23 is a rear view of the cover housing. Reference is now made to Figures 12A-23.

8 and 17 to 20, the display PCB 14 is disposed on the upper surface of the partition plate 152 to support the display 13 from the lower side. The display PCB 14 comprises a circuit which is electrically connected to the display 13 and the display 13 is connected to the circuit via a connector 132. Four contact switches 181a, 181b, 181c, and 181d may be disposed on the upper surface of the display PCB 14 in front, back, left, and right directions with respect to the display 13.

The display PCB 14 may be formed in a cross shape extending from the center portion to front, back, left, and right. More specifically, the substrate 140 on which the circuits of the display PCB 14 are structured comprises a first substrate arm 145, a second substrate arm 146, and a second substrate arm 144 extending from the substantially central portion in the rearward, frontward, leftward, A third substrate arm 147, and a fourth substrate arm 148. As shown in FIG. The substrate 140 is substantially in the shape of a cross, but this shape need not necessarily be symmetrical.

17 to 18, ribs 152a protruding from the periphery of the display PCB 14 may be formed on the upper surface of the partition plate 152 of the cover housing 15. The ribs 152a do not necessarily have to correspond to the entire circumference of the display PCB 14 and may only touch a part of the periphery of the display PCB 14, As shown in FIG. In particular, the ribs 152a may be formed at positions that are in contact with the sides of the substrate arms 145, 146, 147, 148 (i.e., the sides extending outward from the center of the substrate 140).

A first contact switch 181a, a second contact switch 181b, a third contact switch 181c, and a fourth contact switch 181d are disposed on each of the substrate arms 145, 146, 147, . The contact switches 181a, 181b, 181c, and 181d are electrically connected to a circuit formed on the substrate 140. [

The display PCB 14 may be provided with an NFC module 50d (see FIG. 7). The NFC module 50d may be disposed in the NFC mounting portion 146a formed on the second substrate arm 146 by enabling NFC communication. Near Field Communication (NFC) is a non-contact communication technology that uses the frequency band of 13.56 MHz as one of radio frequency identification (RFID) technologies. It is a next-generation LAN technology that is attracting attention due to its relatively low security and relatively low price because of its short communication distance. Since both data reading and writing functions are available, there is no need for a dongle (reader) that was previously required for RFID use. It is similar to conventional short range communication technologies such as Bluetooth, but it does not need to set up between devices like Bluetooth.

The display 13 is an apparatus for receiving an electric signal and displaying an image. The display 13 is connected to a circuit of the display PCB 14, and displays an image according to a control signal input through the circuit. The display 13 may include a display panel 131 and a connector 132 for connecting the display panel 131 to the circuitry of the display PCB 14 (see FIG. 8). The display panel 131 can be attached to the upper surface of the display PCB 14 by an adhesive member (for example, a double-sided tape 171 (see Fig. 17)).

The display PCB 14 is connected to the main PCB 48 via a predetermined cable (not shown) so that a control unit for controlling the display 13 can be connected to the display PCB 14 or the main PCB 48 ). Hereinafter, it is assumed that the display 13 is controlled by a control unit 82 (see FIG. 7) mounted on the main PCB 48. A groove 429 for receiving the cable may be formed on the side surface of the main body 40 in the vertical direction.

Various information can be displayed on the screen of the display panel 131. The controller 240 can control not only the operation of the display panel 131 according to the program stored in the memory 250 but also the overall operation of the electrical components constituting the voice recognition device 1. [ A user interface (UI) can be displayed through the display panel 131, and the interface is implemented by executing the program.

The interface may display playback information of the speakers 43 and 44. For example, various information such as a music reproduction / stop / selection menu, a reproduction status, a song name, an artist / record information, a lyrics, and a volume can be displayed.

When the voice recognition device 1 is equipped with the communication module 50, the interface can display information exchanged through the communication module 50. For example, the interface may display a menu for controlling the accessory 2, 3a, 3b in communication with the communication module 50, or may display a menu for controlling the accessories 2, 3a, 3b based on the information transmitted from the accessories 2, Information can be displayed. Specifically, information such as the network connection status of the communication module 50, temperature, humidity, brightness, and the like sensed by the sensor provided in the accessory 2 can be displayed through the interface. In addition, a menu for controlling the output of the speakers 43 and 44 may be displayed through the interface, for example, a menu for selecting a song or an album to be outputted through the speakers 43 and 44, (E.g., song title, album name, artist), the size of the volume being output, and the like.

Operations on the menus displayed on the interface are possible through the operation unit 181. [

On the other hand, the operation unit 181 may include contact switches 181a, 181b, 181c, and 181d. How the output signals of the respective contact switches 181a, 181b, 181c, and 181d are processed is determined by the program stored in the memory 250. For example, menus displayed left and right on the interface may be selected according to the operation signals of the first and second contact switches 181a and 181b, and the operation signals of the third and fourth contact switches 181c and 181d The menus displayed up and down on the interface may be selected.

The user can communicate with the Bluetooth module 50b using an external device such as a smart phone or a notebook computer, and various data such as music and images can be stored in the memory 250. [ In particular, the control unit 240 can control the speakers 43 and 44 so that the music stored in the memory 250 is output, and various functions such as selection, playback, and stop of music are controlled by the contact switches 181a, 181b, and 181c , 181d.

The board 140 of the display PCB 14 may be formed with a through hole 140h through which the support boss 122b formed in the window support 12 described later passes. The through-hole 140h may be formed in the first substrate arm 145.

Referring to FIG. 20, a pair of volume control switches 185a and 185b may be provided on the bottom surface of the substrate 140. FIG. The volume control switches 185a and 185b are used to control the volume of the speakers 43 and 44 provided in the main body 40. The volume control switches 185a and 185b may be formed of contact switches and are connected to the circuit of the display PCB 14 have. The volume control switches 185a and 185b are connected to a first volume control switch 185a (or a volume control switch 185a) that increases the volume of the speakers 43 and 44 each time it is pressed, (Or the volume reduction switch 185b), in which the volume of the first volume control switch 44 is reduced.

The volume control switches 185a and 185b may be disposed on the fourth substrate arm 148 of the display PCB 14 and may include a movable terminal (a portion pressed for switching operation) of the volume control switches 185a and 185b, Can be protruded toward the side wall 151 of the cover housing 15.

21 to 22, the side wall 151 of the cover housing 15 may have an opening 151h in which the volume button 16 is installed. The volume button 16 may include a dome 161 and an elastic pad 162.

The elastic pad 162 may be formed as a single piece of a material having elasticity (preferably, rubber). The elastic pad 162 is in the form of a plate extending elongated along the circumferential direction of the side wall 151 and includes a support portion 162a disposed inside the housing 15 and a pair of protruding portions 162b protruding from the inner side of the support portion 162a And dome fixing protrusions 162d protruding from the outer surface of the supporting portion 162a and exposed to the outside through the opening 151h. The support portion 162a is not separated to the outside of the cover housing 15 through the opening 151h unless the size of the support portion 162a is larger than the opening portion 151h and is not bent by an external force.

The dome 161 is made of synthetic resin, has a groove formed on one surface thereof, and a dome fixing protrusion 162d is inserted into the groove. Preferably, the dome fixing protrusion 162d is forced into the groove, and even if no separate bonding means is applied, the dome fixing protrusion 162d can be easily removed from the dome 161 by the elasticity or restoring force of the material itself of the dome fixing protrusion 162d It does not separate. However, the dome 161 and the dome fixing protrusion 162d may be coupled to each other by an adhesive member such as a double-sided tape or the like.

The dome 161 may protrude from the upper surface and / or the lower surface of the separation preventing protrusion 161c. The detent protrusion 161c is located inside the cover housing 15 and is caught around the opening 151h to more reliably prevent the dome 161 from being separated from the cover housing 15. [ In the embodiment, a pair of escape preventing projections 161c are formed on the upper and lower surfaces of the dome 161, but the present invention is not limited thereto.

The pair of switch movable projections 162b and 162c are connected to the first volume control switch 185a and the second volume control switch 185b in correspondence with the first volume control switch 185a and the second volume control switch 185b, When the volume increase operation portion 161a or the volume decrease operation portion 161b of the dome 161 is pressed, the switch operation protrusions 162b and 162c of the elastic pad 162 are moved to the volume increase switch 185a, Or the volume reduction switch 185b, so that the volume of the speakers 43 and 44 is adjusted accordingly.

Referring to FIGS. 8 to 16, a substantially circular window support 12 may be disposed above the display 13. The window support 12 is an injection molding of a synthetic resin material, and is preferably formed of one component. An opening 12h is formed in the window support 12, and a screen of the display 13 is exposed through the opening 12h.

The opening 12h is formed at a position corresponding to the display panel 131 disposed below the window support 12 and is preferably formed to be slightly smaller than the display panel 131. [ The screen displayed on the display panel 131 can be viewed through the opening 12h.

The display panel 131 is formed in a rectangular shape longer than the longitudinal length in the left-right direction, and accordingly, the opening 12h also has a shape in which the length in the left-right direction is larger than the length in the forward- desirable.

The window support 12 includes a window support plate 121 having an opening 12h formed at its center and having a window 11 on its upper surface and operation protrusions 126a, 126b, and 126c protruding downward from the window support plate 121, 126c and 126d and a plurality of support bosses 122a, 122b, 122c and 122d protruding downward from the window support plate 121. [

The support bosses 122a, 122b, 122c, 122d may extend vertically downward. In this case, the support bosses 122a, 122b, 122c, and 122d may be disposed at the first angle? 1 relative to the horizontal plane, as in the case of the window 11, (90 -? 1) of? 1 with the window support plate 121, as shown in FIG.

9, each portion of the window support plate 121 is divided into a first region SE1 located at the rear side with respect to the opening 12h, a second region SE2 located at the front side, And a fourth region SE4 located on the right side.

At least one of the support bosses 122a, 122b, 122c, and 122d may be formed in each of the first region SE1 and the second region SE2. The four support bosses 122a, 122b, 122c, and 122d can be formed so that the window support plate 121 can be stably supported without being shaken. Of these, the first support boss 122a and the second support boss 122b, The third support boss 122c and the fourth support boss 122d may be formed in the second region SE2.

The support bosses 122a, 122b, 122c and 122d are coupled with the cover housing 150 to support the window support plate 121, wherein the window support plate 121 can be spaced apart from the display PCB 14. At least one of the support bosses 122a, 122b, 122c and 122d may be coupled with the partition plate 152 through the quadrant region by the substrate arms 145, 146, 147 and 148, And may be coupled with the partition plate 152 through the through hole 140h formed in the substrate arm 145. [

19, the inside of the cover housing 15 is divided into four regions P1, P2, P3, and P4 by four substrate arms 145, 146, 147, and 148 in a cross shape. Hereinafter, in order to meet the general definition of the quadrant, the order is assigned to each quadrant, and P1 is defined as a first quadrant, P2 is defined as a second quadrant, P3 is defined as a third quadrant, and P4 is defined as a fourth quadrant do.

The first support boss 122a, the third support boss 122c and the fourth support boss 122d pass through the second quadrant P2, the third quadrant P3 and the fourth quadrant P4, And the second support boss 122b passes through the through hole 140h formed in the first substrate arm 145 and is coupled to the partition plate 152. [

The coupling between the support bosses 122a, 122b, 122c and 122d and the partition plate 152 of the cover housing 15 is such that the support bosses 122a, 122b, 122c and 122d are directly engaged with the partition plate 152 However, as in the embodiment, the support bosses 122a, 122b, 122c, and 122d may be coupled to the insertion bosses 154a, 154b, 154c, and 154d formed in the partition plate 152. [

The partition plate 152 of the cover housing 15 is provided at a position corresponding to the first support boss 122a, the second support boss 122b, the third support boss 122c and the fourth support boss 122d The first insertion boss 154a, the second insertion boss 154b, the third insertion boss 154c, and the fourth insertion boss 154d may be formed. The insertion bosses 154a, 154b, 154c and 154d may protrude downward from the partition plate 152 and each may extend in parallel with the corresponding support bosses 122a, 122b, 122c and 122d.

The first support boss 122a, the second support boss 122b, the third support boss 122c and the fourth support boss 122d are connected to the first insertion boss 154a, the second insertion boss 154b, 3 insertion boss 154c and the fourth insertion boss 154d. The lower ends of the insertion bosses 154a, 154b, 154c, and 154d may be formed with fastening holes for fastening the bolts. The bolts 19 pass through the fastening holes from the bottom to the support bosses 122a, 122b, 122d.

17 to 19, the cover housing 15 may include at least one ribs 152a, 152b, 152c, 152d, 152e, and 152f protruding upward from the partition plate 152. [

At least one of the ribs 152a, 152b, 152c, 152d, 152e, 152f 152b, 152c, 152d, 152e, 152f may be in contact with the periphery of the display panel 131. [ Since the display PCB 14 is disposed on the upper surface of the partition plate 152, in order for the ribs 152b, 152c, 152d, 152e, and 152f to contact the periphery of the display panel 131, . To this end, the present invention is characterized in that the ribs 152b, 152c, 152d, 152e, 152f are connected to the display PCB 14 by subdivided regions P1, P2, P3, P4 by a cross- It is suggested to utilize it as a path to pass through without interference with.

The ribs 152b, 152c, 152d, 152e, and 152f may be any of the regions P1, P2, P3, and P4 subdivided by the substrate arms 145, 146, 147, And can be brought into contact with the edge of the display panel 131. The ribs 152b, 152c, 152d, 152e, and 152f function to set the position of the display panel 131 and allow the display panel 131 to maintain a proper position without shaking.

The display panel 131 may have a rectangular shape and at least one of the four sides of the display panel 131 may be in contact with the ribs 152b, 152c, 152d, 152e, and 152f.

Of the four sides of the display panel 131, a pair of mutually parallel sides can be in contact with the ribs. In the embodiment, the transverse sides (or the sides extending in the lateral direction) of the display panel 131 are in contact with the ribs 152b, 152c, and 152d. The ribs 152b, 152c, and 15d may be elongated along the lateral sides of the display panel 131. [

The ribs 152b, 152c and 152c may pass through different regions of the four regions P1, P2, P3 and P4, respectively, defined by the substrate arms 145, 146, 147 and 148. In an embodiment, the rib 152b passes through the second quadrant P2, the rib 152c passes through the third quadrant P3, and the rib 152d passes through the fourth quadrant P4 And are respectively in contact with the rear side (upper horizontal side in the figure), the left side and the front side (lower lateral side in the drawing) of the display panel 131, respectively.

According to the embodiment, a rib may be further formed that passes through the first quadrant P1 and / or the fourth quadrant P4 and contacts the right side of the display panel 131. [

Ribs (for example, 152b) which are in contact with one side of the display panel 131 and ribs (for example, 152c) which are in contact with the other side of the display panel 131 are formed on the substrate arms 145, 146, 147 (E.g., P2, P3) among the quadrant regions P1, P2, P3, P4,

The window support plate 121 may be bent around each of the support bosses 122a, 122b, 122c, and 122d when pressure is applied within a certain limit due to the characteristics of the material. It is elastic that the shape is restored to the original shape.

The first operation protrusion 126a, the second operation protrusion 126b, the third operation protrusion 126c and the fourth operation protrusion 126d of the window support 12 are connected to the first contact The second contact switch 181a, the second contact switch 181b, the third contact switch 181c and the fourth contact switch 181d are arranged at positions corresponding to the switch 181a, the second contact switch 181b, the third contact switch 181c, When a pressure is applied to any one of the first region SE1, the second region SE2, the third region SE3 and the fourth region SE4, the pressure applied region (for example, the first region SE1) operates the contact switch (e.g., the first contact switch 181a) located below the operating projection (for example, the first operating projection 126a).

The window support 12 may further include a first tab 125a, a second tab 125b, a third tab 125c and a fourth tab 125d extending downward from the window support plate 121. [ The tabs 125a, 125b, 125c, and 125d may protrude in a direction perpendicular to the bottom surface of the window support plate 121, respectively. The upper surface of the partition plate 152 of the cover housing 15 may be provided with tab insertion grooves (not shown) at positions corresponding to the tabs 125a, 125b, 125c, and 125d, respectively.

On the other hand, the window 11 is a circular transparent plate, which transmits the screen of the display 13, and the material is preferably acrylic. The user can see the screen displayed on the display 13 through the window 11. [ The entire area of the window 11 does not need to be transparent. Only the screen of the display panel 131 exposed through the opening 12h of the window support 12 can be seen without the window support 12 on the outer side of the voice recognition device 1 being visible. Only a predetermined region 11b at a position substantially corresponding to the opening 12h is transparent and the other region 11a may be colored opaque or translucent so as to be concealed or a film or the like may be adhered thereto.

The window 11 can be adhered to the upper surface of the window support plate 121 of the window support 12 using a double-sided tape or the like. The window 11 can be flexibly bent when pressure is applied within a certain limit due to the characteristics of the synthetic resin material. This warping causes the contact switches 181a, 181b, 181c, and 181d to operate more smoothly. However, since the warp of the window 11 is elastic, it goes without saying that when the pressing pressure is removed, the window 11 is restored to its original shape.

On the other hand, since the opening 12h formed in the window support plate 121 is longer than the length in the transverse direction (or in the left-right direction) of the opening 12h, The third region SE3 and the fourth region SE4 are not suitable for installing the support bosses. Considering that the shape of the window 11 is circular, the third region SE3 and the fourth region SE4 are formed from the third operating protrusion 126c or the fourth operating protrusion 126d Is shorter than the distance from the periphery of the opening 12h in the first area SE1 and the second area SE2 to the first operation projection 126a or the second operation projection 126b If the support boss is formed in the third area SE3 or the fourth area SE4, the third operation protrusion 126c and the fourth operation protrusion 126d are too close to the support boss , The operation protrusion can be operated only when a large pressure is applied to the window support plate 121.

For this reason, the first support boss 122a and the second support boss 122b are formed in the first region SE1 and the third support boss 122c and the fourth support boss 122d are formed in the second region SE2 As shown in Fig.

On the other hand, when viewed from above, the first operation protrusion 126a is located on the outer side of the first support boss 122a and the second support boss 122b in the cover housing 15, and the second operation protrusion 126b Is positioned further outward than the third support boss 122c and the fourth support boss 122d.

Slits 121a and 121b may be formed between the operating protrusions 126a and 126b and the supporting bosses 122a, 122b, 122c, and 122d, respectively, in the first region SE1 and the second region SE2.

12D, since the support bosses 122a, 122b, 122c, and 122d are located in the first area SE1 or the second area SE2, the third operation protrusion 126c, The first operation protrusion 126a and the second operation protrusion 126b are relatively closer to each other than the first operation protrusion 126d. For example, when pressure is applied to the first area SE1 of the window support plate 121, the window support plate 121 is bent around the first support boss 122a and the second support boss 122b At this time, the turning radius (moment arm) of the first operating projection 126a with respect to the first supporting boss 122a is r11, and the turning radius with respect to the second supporting boss 122b is r12. In the embodiment, r12 is shorter than r11 because the first operating projection 126a is closer to the second supporting boss 122b than the first supporting boss 122a. The third operation protrusion 126c has a distance r31 (r31> r11> r12) to the first support boss 122a and a distance r33 to the third support boss 122c is substantially equal to r31.

The operability of each of the operation protrusions 126a, 126b, 126c, 126d is greatly influenced by the distance to the nearest positioned support bosses. If r31 is larger than r12, as in the above example, even if the same pressure is applied on the first region SE1 and the third region SE3, SE3 are more curved than the first area SE1 so that the third operating protrusion 126c is moved downward more easily than the first operating protrusion 126a and the third contact switch 181c is moved to the first contact switch 181a. For the same reason, the operation of the second contact switch 181b may not be smoothly performed as compared with the operation of the third contact switch 181c or the fourth contact switch 181d.

The first slit 121a and the second slit 121b are formed in the first region SE1 and the second region SE2 of the window support plate 121, respectively. In these areas SE1 and SE2, the slits 121a and 121b are positioned between the support bosses 122a, 122b, 122c and 122d in the area and the operation protrusions 126a, 126b, 126c and 126d.

12D, the diameter extending in the left-right direction is referred to as a diagonal diameter D1, and the diameter extending in the anteroposterior direction is defined as the diagonal diameter D2, passing through the center c of the window support plate 121 The first support boss 122a and the second support boss 122b are arranged in the first region SE1 in a direction substantially parallel to the transverse diameter D1 and the third support boss 122c The fourth support boss 122d may be arranged in a direction substantially parallel to the transverse diameter D1 in the second area SE2. The first slit 121a and the second slit 121b may extend in a direction substantially parallel to the transverse diameter D1.

When the first region SE1 or the second region SE2 is pressed by the slits 121a and 121b, the curvature of the window support plate 121 is shifted to a position adjacent to both ends of the slits 121a and 121b The warpage is generated mainly in a narrow region between the ends of the slits 121a and 121b and the outer periphery of the window support plate 121. Compared with the case where the slits 121a and 121b are not formed, There is an effect that the window support plate 121 is bent more smoothly.

For example, in the case of the first operating protrusion 126a, the distance from the first slit 121a to the first slit 121a (i.e., the distance between the first slit 121a and the first slit 121a) rs is longer than the distance r12 to the second support boss 122b because the force of the moment arm of the force applied to the first region SE1 against the portion where the bending occurs in the first region SE1 As a result of the increase in length, it contributes to making the first operating projection 126a descend more smoothly.

Even when the support bosses 122a, 122b, 122c and 122d of the first area SE1 and the second area SE2 are arranged asymmetrically as in the embodiment, the support bosses 122a, 122b, The slits 121a and 121b are formed between the first and second areas SE1 and SE2 and the operating protrusions 126a and 126b so that the curvature of the window supporting plate 121 in the first area SE1 and the second area SE2 Is influenced more heavily by the position and shape of the slits 121a and 122b than by the positions of the bosses 122a, 122b, 122c and 122d, When the slits 121b are arranged substantially symmetrically with each other, the operability of the first contact switch 181a and the second contact switch 181b is equalized.

3 to 5, the main body 40 is supported by the base 30 disposed at the lower side, and the upper end can be engaged with the cover housing 15. The main body 40 may include a speaker case 41 and 42 forming a cavity 49 inwardly and at least one speaker 43 and 44 disposed in the cavity 49. [ Two speakers 43 and 44 are arranged in the upper and lower parts in the speaker cases 41 and 42 and a speaker 43 disposed on the upper side is a tweeter for outputting a high frequency band, (44) is a woofer that outputs a low frequency band.

3 to 23, the cover 10 is provided with voice input PCBs 17 and 18. The voice of the user is input to the voice input PCBs 17 and 18. The voice input PCBs 17 and 18 are connected to the voice recognition PCB 40a disposed in the main body 40 in a circuit manner. The voice input PCBs 17 and 18 may be connected to the voice recognition PCB 40a through harness cables 17b and 18b. The voice input PCBs 17 and 18 convert the input voice of the user into sound wave signals that can be recognized by the voice recognition PCB 40a and the voice recognition PCB 40a inputs voice signals from the voice input PCBs 17 and 18 The user's voice can be recognized by analyzing the sound wave signal.

The audio input PCBs 17 and 18 are installed in the window support 12. A plurality of audio input PCBs 17 and 18 may be provided and the plurality of audio input PCBs 17 and 18 may be arranged symmetrically with respect to the opening 12h formed in the window support 12 . In this embodiment, the audio input PCBs 17 and 18 are provided in two and include a first audio input PCB 17 and a second audio input PCB 18.

The first audio input PCB 17 includes a first audio input PCB 17 positioned in front of the opening 12h formed in the window support 12 and a second audio input PCB 17 located rearward of the opening 12h And a second audio input PCB (18). The first audio input PCB 17 is disposed in the second area SE2 of the window support plate 121 and the second audio input PCB 18 is disposed in the first area SE1 of the window support plate 121. [

The first voice input PCB 17 is disposed biased to the right with respect to the center of the window support plate 121 and the second voice input PCB 18 is disposed biased to the left with respect to the center of the window support plate 121.

In the window support 12, PCB accommodating grooves 12a and 12b are formed on the upper surface opposite to the window 11 to accommodate the audio input PCBs 17 and 18. The voice input PCBs 17 and 18 do not protrude outside the PCB receiving grooves 12a and 12b when the voice input PCBs 17 and 18 are housed in the PCB receiving grooves 12a and 12b. That is, the PCB receiving grooves 12a and 12b are formed on the upper surface of the window support 12 so as to have a depth corresponding to the upper and lower thicknesses of the voice input PCBs 17 and 18, respectively. The upper surfaces of the audio input PCBs 17 and 18 coincide with the upper surface of the window support 12 when the audio input PCBs 17 and 18 are accommodated in the PCB accommodating grooves 12a and 12b.

The PCB receiving grooves 12a and 12b include a first PCB receiving groove 12a in which the first voice input PCB 17 is accommodated and a second voice loud power PCB inserting portion 12b in which the second voice input PCB 18 is accommodated ). The first PCB receiving groove 12a is disposed on the front side of the opening 12h formed in the window support 12 and the second PCB receiving groove 12b is disposed on the rear side of the opening 12h. The first PCB receiving groove 12a is formed in the second region SE2 of the window supporting plate 121 and the second PCB receiving groove 12b is formed in the first region SE1 of the window supporting plate 121. [

The first PCB receiving groove 12a is formed to be biased to the right with respect to the center of the window supporting plate 121 and the second PCB receiving groove 12b is formed to be biased to the left with respect to the center of the window supporting plate 121.

The window support 12 further includes positioning projections 12c and 12d protruding from the bottom of the PCB receiving grooves 12a and 12b. The voice input PCBs 17 and 18 are formed with positioning holes 17a and 18a into which the positioning projections 12c and 12d are inserted. One of the positioning projections 12c and 12d is formed at the corner of the rectangular PCB receiving grooves 12a and 12b and the positioning holes 17a and 18a are formed at the corners of the rectangular voice input PCB 17 and 18 . The operator inserts the positioning holes 17a and 18a into the positioning projections 12c and 12d when the audio input PCB 17 and 18 are received in the PCB receiving grooves 12a and 12b, 18 can be received at the correct positions of the PCB receiving grooves 12a, 12b.

The positioning projections 12c and 12d include a first positioning protrusion 12c in which the first PCB receiving groove 12a protrudes upward from the bottom and a second positioning protrusion 12b in which the second PCB receiving groove 12b protrudes upward And a second positioning protrusion 12d. The positioning holes 17a and 18a are formed in the first audio input PCB 17 and have a first positioning hole 17a into which the first positioning projection 12c is inserted and a second positioning hole 17b through which the second audio input PCB 18 And a second positioning hole 18a formed in the second positioning projection 12d for receiving the second positioning projection 12d.

Openings 12e and 12f are formed at the bottoms of the PCB receiving grooves 12a and 12b. The openings 12e and 12f serve as holes through which the harness cables 17b and 18b pass when the voice input PCBs 17 and 18 are connected to the voice recognition PCB 40a. The openings 12e and 12f include a first opening 12e formed at the bottom of the first PCB receiving groove 12a and a second opening 12f formed at the bottom of the second PCB receiving groove 12b .

The openings 12e and 12f constitute at least a part of the slits 121a and 121b formed in the first area SE1 and the second area SE2, respectively. The first PCB receiving groove 12a is disposed at a position shifted to the right of the second slit 121b formed in the second region SE2 and is connected to the third supporting boss 122c formed in the second region SE2, And is formed on the side of the fourth support boss 122d between the support bosses 122d. The second PCB receiving groove 12b is disposed at a position shifted to the left of the first slit 121a formed in the first region SE1 and has a first supporting boss 122a formed in the first region SE1, And is formed on the side of the first support boss 122a between the second support bosses 122b. Therefore, when the user presses the window 11, the window support plate 121 is easily resiliently deformed, so that the contact switches 181a, 181b, 181c, and 181d can be easily operated.

The openings 12e and 12f are formed to be wider in the front-back direction than the slits 121a and 121b. The voice input PCBs 17 and 18 are connected to the voice recognition PCB 40a via the harness cables 17b and 18b and connected to the voice recognition PCB 40a at the lower ends of the harness cables 17b and 18b 17c and 18c. The connectors 17c and 18c must pass through the openings 12e and 12f and down the window support 12 so that the connectors 17c and 18c are formed to be wider in the forward and backward direction than the slits 121a and 121b.

The harness cables 17b and 18b include a first harness cable 17b connecting the first audio input PCB 17 and the voice recognition PCB 40a and a second harness cable 17b connecting the second audio input PCB 18 and the voice recognition PCB 40a, And a second harness cable 18b connecting the first harness cable 18a and the second harness cable 18b. The connectors 17c and 18c include a first connector 17c coupled to the lower end of the first harness cable 17b and connected to the voice recognition PCB 40a and a second connector 17c coupled to the lower end of the second harness cable 18b And a second connector 18c connected to the voice recognition PCB 40a.

The voice passage holes 11c and 11d through which the user's voice passes are formed in the window 11 from the upper side of the window 11 to the lower side of the window 11. [ The voice passing holes 11c and 11d are formed in the first voice passing hole 11c formed in the front region with respect to the center of the window 11 and the second voice passing hole 11c formed in the rear region with respect to the center of the window 11, And includes a through hole 11d. The first voice passage hole 11c guides the voice to the first voice input PCB 17 and the second voice passage hole 11d guides the voice to the second voice input PCB 18. [

In the window 11, the center portion is formed of the transparent region 11b, and the region other than the transparent region 11b is formed of the opaque region 11a. The transparent region 11b is formed in a size and shape corresponding to the opening 12h formed in the window support 12 to transmit the screen output from the display panel 131. [

The first voice passage hole 11c is formed in the front opaque area 11a with respect to the transparent area 11b of the window 11 and the second voice passage hole 11d is formed in the transparent area 11b of the window 11 11b in the rear opaque region 11a.

It is preferable that the voice passage holes 11c and 11d are formed at positions corresponding to the voice input PCBs 17 and 18 so that the user's voice can be easily inputted to the voice input PCBs 17 and 18. [ The voice input PCBs 17 and 18 are formed with voice input holes 17d and 18d through which the voice passing through the voice pass holes 11c and 11d is inputted at a position corresponding to the voice pass holes 11c and 11d. It is preferable that a microphone (not shown) is provided on the bottom surface of the voice input PCB 17, 18 where the voice input holes 17d, 18d are formed. The microphone amplifies the voice inputted into the voice input holes 17d and 18d and inputs the amplified voice to the sound wave converting circuit of the voice input PCB 17 or 18. That is, the user's voice that has passed through the voice passage holes 11c and 11d from outside the window 11 is input to the voice input holes 17d and 18d formed in the voice input PCBs 17 and 18, Amplified and inputted to the sound wave converting circuit of the sound input PCB 17, 18 and converted into a sound wave signal readable by the voice recognition PCB 40a.

Between the window 11 and the window support 12, gaskets 17e and 18e are provided. The gaskets 17e and 18e do not enter the audio input holes 17d and 18d of the audio input PCBs 17 and 18 and enter the window 11 and the window support (12). To this end, the gaskets 17e and 18e are brought into close contact with the upper surface of the window 11, and the lower surfaces are brought into close contact with the upper surfaces of the voice input PCBs 17 and 18, respectively. The gaskets 17e and 18e are provided with communication holes 17f and 18f for communicating the voice passage holes 11c and 11d and the voice input holes 17d and 18d. Therefore, since all of the voice that has passed through the voice passage holes 11c and 11d is input to the voice input holes 17d and 18d through the communication holes 17f and 18f, it is possible to accurately recognize the voice.

The gaskets 17e and 18e have a first gasket 17e whose upper surface is in close contact with the bottom surface of the window 11 and whose lower surface is in close contact with the upper surface of the first audio input PCB 17, And the lower surface includes a second gasket 18e that is in close contact with the upper surface of the second voice input PCB 18. [ The communication holes 17f and 18f are formed in the first gasket 17e and have a first communication hole 17f for communicating the first voice passage hole 11c and the first voice input hole 17d, And a second communication hole 18f formed in the second voice input hole 18d and communicating the second voice input hole 11d and the second voice input hole 18d.

The gaskets 17e and 18e may be formed in shapes and sizes corresponding to the voice input PCBs 17 and 18. The gaskets 17e and 18e may be double-sided tapes adhered to the upper surfaces of the voice input PCBs 17 and 18. In this embodiment, the window 11 and the window support 12 are coupled to each other via the double-sided tape. When the window 11 and the window support 12 are coupled to each other via the double-sided tape, The gaskets 17e and 18e are preferably formed of a double-sided tape so that the gaskets 18 and 18 can be easily coupled to the bottom surface of the window 11. [

The communication holes 17f and 18f are formed to be larger than the voice input holes 17d and 18d formed in the voice input PCBs 17 and 18, respectively. If the communication holes 17f and 18f are formed to have a smaller size than the voice input holes 17d and 18d, the voice passing through the voice passage holes 11c and 11d can be easily received into the voice input voice holes 17d and 18 There is a fear that speech recognition may not be accurately performed. If the communication holes 17f and 18f are formed to have a smaller size than the voice input holes 17d and 18d or have the same size as the voice input holes 17d and 18d, When the sound passes through the communication holes 17f and 18f, the gaskets 17e and 18e vibrate slightly due to the vibration of the sound, and the adhesion of the gaskets 17e and 18e is lowered and the window 11 and the gaskets 17e and 18e , And the gap between the gaskets 17e, 18e and the voice input PCB 17, 18. Therefore, it is preferable that the communication holes 17f and 18f are formed to be larger than the voice input holes 17d and 18d formed on the voice input PCBs 17 and 18 in order to accurately recognize the voice.

In this embodiment, the voice input holes 17d and 18d are formed to have the same size as the voice passage holes 11c and 11d formed in the window 11. [ Therefore, the communication holes 17f, 18f are formed larger than the voice passage holes 11c, 11d formed in the window 11. [ If the communication holes 17f and 18f are formed to have a smaller size than the voice passage holes 11c and 11d or have the same size as the voice passage holes 11c and 11d, When the sound passes through the communication holes 17f and 18f, the gaskets 17e and 18e vibrate slightly due to the vibration of the sound, and the adhesion of the gaskets 17e and 18e is lowered and the window 11 and the gaskets 17e and 18e , And the gap between the gaskets 17e, 18e and the voice input PCB 17, 18. Therefore, it is preferable that the communication holes 17f and 18f are formed to be larger than the voice passage holes 11c and 11d formed in the window 11 in order to accurately recognize the voice.

On the other hand, the voice passage holes 11c and 11d are formed at positions corresponding to the voice input PCBs 17 and 18, respectively. That is, the first audio input PCB 17 is biased to the right with respect to the center of the window support plate 121, and the second audio input PCB 18 is biased to the left with respect to the center of the window support plate 121 One of the front regions with respect to the center of the window 11 is biased to the right with respect to the center and one of the first voice passage holes 11c is formed, And one second voice passage hole 11d is formed on the left side with respect to the center. Therefore, the positions of the voice passage holes 11c and 11d are not vertically symmetric and horizontally symmetrical with respect to the center of the window 11, and there is a fear that the appearance design of the voice recognition device 1 is reduced.

In the window 11 of the present embodiment, two first decor holes 11e are formed beside the first voice passage hole 11c in the front-to-side direction with respect to the center of the window 11, Two second decoupling holes 11f are formed on the side of the second voice passage hole 11d from the rear side to the left and right with respect to the center of the second voice passage hole 11d.

The two first decor holes 11e are formed on the left side of the first sound passage hole 11c in the opaque area 11a located in front of the transparent area 11b of the window 11, 2 decor hole 11f is formed on the right side of the second voice passage hole 11d in the opaque region 11a located behind the transparent region 11b.

The overall arrangement of the first voice passage hole 11c and the two first decoupling holes 11e formed in the opaque area 11a located in front of the transparent area 11b of the window 11 is the same as that of the window 11 The overall arrangement of the second voice passage hole 11d and the two second decoupling holes 11f located at the intermediate point in the left and right direction of the front region with respect to the center and formed in the rear region with respect to the center of the window 11 The window 11 is vertically symmetrical and horizontally symmetrical with respect to its own center by being positioned at the intermediate point in the left and right direction of the rear area with respect to the center of the window 11, Can be improved.

Since the voice input PCBs 17 and 18 are connected to the voice recognition PCB 40a through the harness cables 17b and 18b, the harness cables 17b and 18b are connected to the partition plate 152 of the cover housing 15, The through-hole harness cable through holes 152g and 152h are formed. The harness cable through holes 152g and 152h are formed at positions corresponding to the wide portions of the slits 121a and 121b formed in the PCB receiving grooves 12a and 12b and extend downward from the PCB receiving grooves 12a and 12b .

The upper ends of the harness cables 17b and 18b are connected to the audio input PCBs 17 and 18 and the lower ends of the harness cables 17b and 18b are connected to the window supports 12a and 12b through a part of the wide slits 121a and 121b formed in the PCB receiving grooves 12a and 12b 12 and then through the harness cable through holes 152g and 152h formed in the partition plate 152 to the bottom of the partition plate 152 and the voice recognition PCB (40a).

The harness cable through holes 152g and 152h are connected to the first harness cable through hole 152g through which the first harness cable 17b connected to the first audio input PCB 17 passes, And a second harness cable through hole 152h through which the connected second harness cable 18b penetrates.

Fig. 24 is a perspective view showing the main body so that its upper surface is seen. Fig. 25 is a perspective view showing the main body so that its bottom surface is seen. 26 shows the front case (a) and the rear case (b). 27 shows a rear surface of the main body. 28 is a view showing positions of antennas connected to the Wi-Fi module. 29 is a view showing positions of an antenna connected to the Bluetooth module and an antenna connected to the GPS module. 30 is an exploded perspective view of the main body, the heat sink, the main PCB, the base body, and the supporting rubber.

24 to 27, a voice recognition PCB 40a is disposed on the upper surface of the main body 40. [ The voice recognition PCB 40a can recognize the voice of the user by analyzing the sound wave signals inputted from the voice input PCBs 17 and 18. The voice recognition PCB 40a is connected to the main PCB 48 in circuit. The voice recognized by the voice recognition PCB 40a is input to the control unit 240 of the main PCB 48. When the voice recognized from the voice recognized from the voice recognition PCB 40a is included, The device corresponding to the set voice can be controlled in accordance with the recognized voice by communicating with the device corresponding to the set voice among the devices 2, 3a, 3b, and 5 through the communication module 50.

For example, when the user presses the window 11 to say " let the weather know " with one of the contact switches 181a, 181b, 181c and 181d being operated, Is input to the PCBs 17 and 18 and converted into sound wave signals that can be recognized by the voice recognition PCB 40a at the voice input PCBs 17 and 18 and then transmitted through the harness cables 152g and 152h to the voice recognition PCB 40a ), And the voice recognition PCB 40a analyzes the sound wave signals inputted from the voice input PCBs 17 and 18 and recognizes that the voice of the user is " inform the weather ". Thereafter, the voice signal of " Tell Weather " recognized by the voice recognition PCB 40a is signal-processed and input to the control unit 240 of the main PCB 48. The control unit 240 controls the voice recognition PCB 40a When the voice "weather", which is the voice set in the voice "inform the weather", is included, the device which can receive the weather information among the peripheral devices 2, 3a, 3b, 5 and the communication module 50 The weather information can be displayed on the display 13 by receiving the weather information from the device capable of receiving the weather information by controlling the device capable of receiving the weather information, , 44).

The upper surface of the main body 40 may be formed as a slope 41S having a front portion with a lower height and a rear portion having a higher height and a rear portion extending rearward from the front portion with a horizontal surface 42H. The inclined surface 41S is disposed in parallel with the window 11, the window support 12, and the partition plate 152. [ That is, the upper surface of the speaker case 41, 42, which forms the outer surface of the main body 40, is formed by the inclined surface 41S whose front portion is lower in height and rear is higher in height, As shown in FIG. The voice recognition PCB 40a may be installed on a rear portion of the upper surface of the main body 40, which is formed in a horizontal plane.

Since the window 11, the window support 12 and the partition plate 152 are arranged in such a manner that the front is lower in height and the rear is inclined at a higher height, when the cover 10 is engaged with the upper portion of the main body 40 , A space S (see FIG. 5) in which the voice recognition PCB 40a can be installed is secured between the rear portion of the upper surface of the main body 40 formed by the horizontal surface 42H and the partition plate 152. Therefore, it is preferable that the voice recognition PCB 40a is installed at the rear portion of the upper surface of the main body 40 formed by the horizontal surface 42H.

The speaker case 41 has a front case 41 which forms a front part of the front part of the main body 40 and a rear case 41 which is coupled to the rear part of the front case 41 to form a rear outer appearance of the main body 40. [ 42). The rear case 42 forms a cavity 49 with the front case 41. The upper surface of the front case 41 is formed of an inclined surface 41S having a lower front height and a higher height and the upper surface of the rear case 42 is formed of a horizontal surface 42H. Therefore, when the cover 10 is coupled to the upper portion of the main body 40, a space S in which the voice recognition PCB 40a can be installed is ensured between the partition plate 152 and the rear case 42 It is preferable that the voice recognition PCB 40a is installed on the upper side of the rear case 42. The voice recognition PCB 40a may be mounted on the upper side of the rear case 42 through an adhesive member such as a double-sided tape.

The front case 41 may be formed with a pair of sound output openings for exposing the diaphragms of the woofer 44 and the upper and lower woofers 43 upward and downward, respectively.

On the inner surface of the front case 41, a case positioning protrusion 411 protruding rearward can be formed at a plurality of points. In the embodiment, case positioning projections 411 are formed at two positions on both sides of a predetermined height from the left and right sides. In the same manner, case positioning projections 411 are formed in a total of six positions at three different heights But is not necessarily limited thereto.

The rear case 42 is formed with insertion bosses 421 at positions corresponding to the case positioning projections 411 formed in the front case 41 and bolts are inserted from the rear of the rear case 42, And can be fastened to the case positioning protrusion 411 through the through hole 421.

A pair of fastening bosses 153c and 153d can be recessed rearward at both the left and right sides of the front portion of the upper end holding portion 153 of the cover housing 15 (refer to Figs. 13 to 16) A pair of fastening bosses 153a and 153b can be formed to be recessed forward.

The first boss insertion groove 415 and the second boss insertion groove 415 are formed in the front case 41 of the main body 40 in correspondence with the coupling bosses 153a, 153b, 153c, and 153d formed in the cover housing 15, A third boss insertion slot 425 and a fourth boss insertion slot 426 may be formed in the rear case 42. [

24, the first boss insertion groove 415 and the second boss insertion groove 416 are recessed rearward from the front surface of the front case 41 (the front surface of the voice recognition device 1) And upper ends are opened so that the fastening bosses 153c and 153d can be inserted from the upper side, respectively.

27, the third boss insertion groove 425 and the fourth boss insertion groove 426 are depressed forward from the rear surface of the rear case 42 (the rearward surface of the voice recognition device 1) And upper ends are opened so that the fastening bosses 153a and 153b can be inserted from the upper side, respectively.

Each of the boss insertion grooves 415, 416, 425, and 426 may be formed with a fastening hole through which the bolt passes. Although only the fastening holes 416h formed in the second boss insertion grooves 416 are illustrated in the drawing, the fastening holes 416h are also formed in the first boss insertion grooves 415 in the same manner (not shown in the drawings, And the other boss insertion grooves 425 and 426 may be formed with the fastening holes 425h and 426h (see FIG. 27) in the same manner.

The fastening bosses 153a, 153b, 153c, and 153d are inserted into the corresponding boss insertion grooves 415, 416, 425, and 426, respectively, and the fastening holes 415h, 416h, 425h, And the bolt can be fastened to the fastening bosses 153a, 153b, 153c, and 153d through the fastening holes 415h, 416h, 425h, and 426h.

27 to 29, at least one communication module 50 may be disposed in the main body 40. [ The communication module 50 may be connected to the main PCB 48 and / or the circuitry of the display PCB 14 and controlled by the control unit 240. In the embodiment, the communication module 50 is provided with a Wi-Fi module 50a, a Bluetooth module 50b, and a position module 50c. However, the present invention is not limited to this, and it is also possible to provide a geo-wave module.

The module assembly 510 may be disposed behind the main body 40 as a collection of the WiFi module 50a and the Bluetooth module 50b. The module assembly 510 may be disposed in the rear case 42.

The module assembly 510 may be integrally coupled to the rear case 42 or may be detached from the rear case 42. However, the present invention is not limited to this, and the WiFi module 50a and the Bluetooth module 50b may be provided separately from each other, and each of them may be independently coupled to the main body 40 or separated from the main body 40. [

The module assembly 510 may include a pair of antennas 511a and 511b for transmitting and receiving signals. The pair of antennas 511a and 511b may be provided as a basic unit in the module assembly 510 itself but may include at least one antenna 521 and 522 separate from the module assembly 510 (See Figs. 27 to 29).

The module assembly 510 may include a first antenna connection terminal 513 and a second antenna connection terminal 514 of the WiFi module 50a and an antenna connection terminal 515 of the Bluetooth module 50b. The first antenna 521 and the second antenna 522 may be disposed on the left and right sides of the rear portion of the inner wall of the side wall 151 of the cover housing 15, The first antenna connection terminal 513 may be connected to the second antenna connection terminal 514 through the conductor L1 and the second antenna 522 may be connected to the second antenna connection terminal 514 through the conductor L2.

The first antenna 521 and the second antenna 522 are each formed by bonding a predetermined pattern of conductors to a thin film, and the conductors L1 and L2 are connected to the conductor. The first antenna 521 and the second antenna 522 may be attached to the side wall 151 of the cover housing 15 by a double-sided tape.

The side wall 151 of the cover housing 15 is not surrounded by the grill 20 because it is located on the upper side of the grill 20 and therefore the first antenna 521 and the second antenna 522 are arranged so as to reduce signal interference caused by the grill 20, which is a metallic material, so that signal transmission and reception can be performed more accurately.

In addition, the side wall 151 may be formed such that the height of the upper end gradually becomes further away from the partition plate 152 from the front to the rear. In this case, the rear portion of the side wall 151 can form a larger gap with the display PCB 14 mounted on the partition plate 152, as compared with the front portion. Accordingly, by disposing the first antenna 521 and the second antenna 522 on the rear portion of the side wall 151, the antennas 521 and 522 can be spaced farther from the display PCB 14, It is possible to reduce the signal interference due to the magnetic field generated by the current flowing in the circuit of the antenna 14.

On the other hand, one of the left and right sides of the main body 40 may be provided with a position control module 50c. A third antenna 532 connected to the antenna connection terminal 531 of the position control module 50c via the lead L3 and a second antenna 532 connected to the antenna of the Bluetooth module 50b via the lead L3 are formed on the inner surface of the front portion of the side wall 151 of the cover housing 15, And a fourth antenna 541 connected to the connection terminal 515 through the lead L4.

The third antenna 532 and the fourth antenna 541 are each formed by bonding a predetermined pattern of conductors to a thin film, and the conductors L3 and L4 are connected to the conductor. The third antenna 532 and the fourth antenna 541 may be attached to the side wall 151 of the cover housing 15 by a double-sided tape.

Referring to FIG. 30, the main PCB 48 may be disposed in a space formed between the main body 40 and the base 30. The main PCB 48 controls the overall operation of the voice recognition device 1 and includes a control unit 240, a USB port 62, a data transmission port 64, various switches, a receptacle, Circuit boards 50a and 50c, a display PCB 14, a tweeter 43, a woofer 44, and the like.

A heat sink 33 may be disposed between the main PCB 48 and the main body 40. The heat radiating plate 33 is made of a metal plate, and is preferably made of aluminum. The heat radiating plate 33 dissipates the heat radiated from the main PCB 48 into the upper space (that is, the space between the bottom surface of the main body 40 and the heat sink 33).

A plurality of fastening bosses 45a, 45b, 45c, 45d can be protruded from the bottom surface of the main body 40. [ The first fastening boss 45a and the second fastening boss 45b may protrude from the bottom surface of the rear case 42 and the third fastening boss 45c and the fourth fastening boss 45d may protrude from the front case 41. [ As shown in FIG. The fastening bosses 45a, 45b, 45c, 45d may be engaged with the base 30.

The fastening bosses 45a, 45b, 45c, and 45d may be formed in four quadrants partitioned by the horizontal line and the vertical line, respectively, when the bottom surface of the main body 40 is divided into a horizontal line and a vertical line passing through the center thereof.

The base 30 may be provided with an insertion boss at a position corresponding to the fastening bosses 45a, 45b, 45c and 45d, respectively. The fastening bosses 45a, 45b, 45c, and 45d can be inserted into the insertion bosses, respectively. In this inserted state, the fastening bosses 45a, 45b, 45c, and 45d can be fastened to the bolts passing through the respective insertion bosses.

A plurality of heat-radiating plate support bosses 46b, 46c, and 46d may further protrude from the bottom surface of the main body 40. [ The heat radiating plate support bosses 46b, 46c and 46d may be arranged at positions close to the fastening bosses 45a, 45b, 45c and 45d. In the embodiment, three of the four quadrants are provided with heat radiating plate support bosses 46b, 46d are formed, but the number is not necessarily limited thereto.

The heat radiating plate 33 is made of a metal plate, and preferably made of aluminum or stainless steel. However, other metal materials are possible. The heat radiating plate 33 may include a horizontal flat plate 3331 and a plurality of support tabs 332b, 332c, and 332d extending from the periphery of the flat plate 3331. [

The flat plate portion 3331 is provided with through holes 335a, 335b, 335c, and 335d through which the fastening bosses 45a, 45b, 45c, and 45d pass, (334b, 334c, 334d) may be formed.

The support bosses 46b, 46c, and 46d may be coupled to the support tabs 332b, 332c, and 332d, respectively, above the main PCB 48. [ The support tabs 332b, 332c, and 332d may include a vertical portion extending downward from the flat plate portion 3331 and a horizontal portion bent horizontally from the vertical portion. The horizontal portions of the respective support tabs 332b, 332c, and 332d are formed with fastening holes through which the bolts pass, and after the bolts pass through the fastening holes from below, they can be fastened to the support bosses 46b, 46c, and 46d .

The flat plate portion 3331 is spaced apart from the bottom surface of the main body 40 located on the upper side while the support bosses 46b, 46c and 46d are engaged with the support tabs 332b, 332c and 332d, And is also separated from the main PCB 48. Even if the main body 40 vibrates due to the output of the speakers 43 and 44 because the flat plate portion 3331 is separated from the bottom surface of the main body 40, the contact between the bottom surface of the main body 40 and the flat plate portion 3331 No striking noises are generated.

The main PCB 48 may have through holes 481a, 481b, 481c, and 481d at positions corresponding to the through holes 335a, 335b, 335c, and 335d of the heat sink 33, respectively. The lengths of the fastening bosses 45a, 45b, 45c and 45d are longer than the length of the support bosses 46b, 46c and 46d and each of the fastening bosses 45a, 45b, 45c and 45d is connected to the through holes 335a, 335b, 335c and 335d of the heat sink 33, 481b, 481c, 481d of the base plate 48, and then inserted into the insertion bosses of the base 30.

The base 30 may include a base body 31 having an open upper surface and a predetermined space formed inside and a support rubber 32 fixed to the bottom surface of the base body 31. The voice recognition device 1 is formed in a small size so that the user can carry it, and can be mounted on a floor such as a table or a shelf. The supporting rubber 32 provided on the lower side of the base body 31 increases the friction with the floor and prevents the voice recognition device 1 from falling down or dropping.

The insertion bosses formed in the base 30 protrude upward from the inner side surface of the base body 31 and fasteners 351a, 351b, 351c, 351d May be formed.

After the main body 40 and the heat sink 33 are assembled, the fastening bosses 45a, 45b, 45c and 45d are passed through the fastening bosses 481a, 481b, 481c and 481d formed in the main PCB 48 . Then, the respective fastening bosses 45a, 45b, 45c, and 45d are inserted into the insertion bosses formed in the base 30. Thereafter, bolts (not shown) are inserted into the fastening holes 351a, 351b, 351c and 351d from the lower side of the base 30 and fastened to the fastening bosses 45a, 45b, 45c and 45d in the insertion boss .

31 is a view schematically showing a smart home system including a speech recognition server system and a speech recognition apparatus according to an embodiment of the present invention.

31, a smart home system 10 according to an embodiment of the present invention includes a voice recognition device 1 having a communication module (not shown) and capable of communicating with other devices or connecting to a network, And a voice recognition server system 1100 including a plurality of servers for home appliance control.

On the other hand, the speech recognition apparatus 1 is a speech recognition apparatus.

In addition, the smart home system 10 according to an embodiment of the present invention may include a mobile terminal (not shown) such as a smart phone, a tablet PC, and the like.

The voice recognition device 1 may include a communication module therein to communicate with electronic devices in the smart home system 10 or outside.

The smart home system 10 according to an embodiment of the present invention may further include an access point (AP) device 7, It can access the Internet network and communicate with other devices.

The access point apparatus 7 can allocate a wireless channel according to a predetermined communication method to the electronic devices in the smart home system 10 and perform wireless data communication through the corresponding channel.

Here, the predetermined communication method may be a Wi-Fi communication method. Correspondingly, the communication module included in the voice recognition device 1 may be a Wi-Fi communication module, but the present invention is not limited to the communication method.

Alternatively, the voice recognition device 1 may include other types of communication modules or a plurality of communication modules. For example, the speech recognition device 1 may include an NFC module, a zigbee communication module, a Bluetooth (TM) communication module, and the like.

The voice recognition apparatus 1 can be connected to a server included in the voice recognition server system 1100 or a predetermined external server or a user's portable terminal through a wi-fi communication module or the like, Smart function can be supported.

The user can check information on the voice recognition device 1 in the smart home system 10 or control the voice recognition device 1 through the portable terminal.

On the other hand, it may be inconvenient for a user to use the portable terminal even if the user wants to control the voice recognition device 1 or confirm certain information in the home.

For example, it is more efficient to have a means of controlling the voice recognition device 1 in other ways when the user does not know the current location of the portable terminal or is in another place.

The speech recognition apparatus 1 according to an embodiment of the present invention can receive a user's speech input and the speech recognition server system 1100 recognizes and analyzes the speech input of the user to control the speech recognition apparatus 1 can do.

Accordingly, the user can control the voice recognition device 1 without operating the portable terminal or the remote control device.

At least some of the servers included in the voice recognition server system 1100 may be a server operated by a manufacturer of a voice recognition apparatus or a sales company or a server operated by a company entrusted with a service by a manufacturer or a sales company have.

32A is an example of a speech recognition server system according to an embodiment of the present invention.

32A, a speech recognition server system according to an embodiment of the present invention includes a voice server 1110 for receiving voice data from the voice recognition device 1, analyzing the received voice data and discriminating voice commands, . &Lt; / RTI &gt;

The voice server 1110 receives voice data from the voice recognition device 1, converts the received voice data into text data, and analyzes the text data to determine a voice command.

Further, the voice server 1110 can transmit a signal corresponding to the voice command discriminated to the predetermined server.

For example, the speech recognition server system according to an embodiment of the present invention receives a signal corresponding to the identified voice command from the voice server 1110, and generates a request signal corresponding to the determined voice command And a home appliance control server 1130 that transmits a control signal based on a request signal received from the linkage service server 1120 and the linkage service server 1120 to the voice recognition device 1. [

The voice recognition apparatus 1 can receive voice command input by the user and transmit voice data based on the received voice command input to the voice server 1110. [

The voice server 1110 includes an Automatic Speech Recognition (ASR) server 1111 that receives voice data from the voice recognition device 1 and converts the received voice data into text data, The speech recognition apparatus 1 receives the text data from the automatic speech recognition server 1111, analyzes the received text data to determine a voice command, and transmits a response signal based on the determined voice command to the voice recognition apparatus 1 (NLP) server 1112, and a signal including text corresponding to the response signal from the speech recognition apparatus 1, converts the text included in the received signal into speech data And a text to speech (TTS) server 1113 for transmitting the voice message to the voice recognition apparatus 1. [

The automatic speech recognition server 1111 may perform speech recognition on the speech data received from the speech recognition apparatus 1 to generate text data and transmit the text data to the natural language processing server 1112. [

The natural language processing server 1112 can analyze the text data received from the automatic speech recognition server 1111 according to a natural language processing algorithm to discriminate a voice command.

The natural language processing server 1112 can process a natural language that is a language that a person routinely uses according to a natural language processing algorithm, and can analyze an intent of a user. The natural language processing server 1112 can perform natural language processing on the text data received from the automatic speech recognition server 1111 to determine a voice command that matches the user's intention.

Accordingly, the natural language processing server 1112 can determine a voice command that matches the user's intention even if the user inputs a voice command in a normal use language.

The natural language processing server 1112 can transmit a signal corresponding to the natural language processing result, that is, a signal corresponding to the discriminated voice command to the linked service server 1120. [

The connection service server 1120 can receive a signal corresponding to the voice command determined by the natural language processing server 1112. [

The connection service server 1120 can perform the corresponding operation by communicating with the home appliance control server 1130 if the voice command is related to the voice recognition device 1. [

Alternatively, if the determined voice command is not related to the voice recognition device 1, the connection service server 1120 can communicate with the external service 1121 to perform a corresponding operation.

For example, if the determined voice command is a command for requesting information such as weather, stock, news, etc., the connection service server 1120 requests and receives the information from the server providing the service corresponding to the requested information .

The connection service server 1120 can transmit the received information to the voice server 1110 and the natural language processing server 1112 can transmit the received information to the voice recognition device 1. [

The connection service server 1120 may generate a request signal corresponding to the identified voice command and transmit the request signal to the home appliance control server 1130 if the voice command is related to the voice recognition device 1. [

The home appliance control server 1130 can transmit a control signal based on the request signal received from the linked service server 1120 to the voice recognition device 1. [

For example, when the music reproduction request of the speech recognition apparatus 1 is received, the household control server 1130 may transmit a control signal for music reproduction to the speech recognition apparatus 1. [

On the other hand, the speech recognition apparatus 1 can perform a corresponding operation according to the control signal received from the home appliance control server 1130.

Also, the speech recognition apparatus 1 may transmit a signal to the home appliance control server 1130 indicating that the operation is performed after performing the requested operation.

The home appliance control server 1130 receives a response signal to the control signal from the speech recognition device 1 and transmits processing result information corresponding to the response signal to the linkage service server 1120 .

The voice server 1110 can transmit a response signal including the processing result information to the voice recognition device 1. [

The voice server 1110 receives a signal including an output text corresponding to the processing result information from the voice recognition device 1, converts the received output text into voice data, To the recognizing device (1).

In this case, the response signal based on the voice command determined by the natural language processing server 1112 to be transmitted to the voice recognition device 1 may include the processing result information.

On the other hand, the speech recognition apparatus 1 can receive a response signal based on the determined voice command from the natural language processing server 1112. [ Here, the response signal may include text data of a response corresponding to the identified voice command.

For example, when the user inputs a voice command for requesting music reproduction, the response signal may include text data indicating that the music has been reproduced.

On the other hand, the speech recognition apparatus 1 can transmit a signal including the text corresponding to the received response signal to the text-to-speech conversion server 1113. Here, the signal including the text corresponding to the response signal may include an output text corresponding to the processing result information.

On the other hand, the text-to-speech conversion server 1113 can convert the text included in the received signal into voice data and transmit the voice data to the voice recognition device 1. [ The converted voice data may include a sound source file.

The voice recognition apparatus 1 can output a voice guidance message based on voice data received through a speaker.

On the other hand, the connection service server 1120 requests the home appliance control server 1130 of the state information of the voice recognition device 1 based on the signal corresponding to the determined voice command, 1130 may transmit the status information of the voice recognition device 1 to the linked service server 1120. [ When the state information of the voice recognition device 1 is not secured, the home appliance control server 1130 can request and receive the state information from the voice recognition device 1. [

On the other hand, when it is possible to support the determined voice command based on the state information of the voice recognition device 1, the connection service server 1120 transmits the voice command to the home appliance control server 1130 It is possible to transmit a corresponding request signal.

Alternatively, when it is impossible to support the determined voice command based on the status information of the voice recognition apparatus 1, the connection service server 1120 transmits the voice command to the natural language processing server 1112, It is possible to transmit a signal indicating the function.

In this case, the speech recognition apparatus 1 can request and receive the voice data to the text-to-speech conversion server 1113, and output a voice guidance message indicating that the voice data is not supported in the current state.

According to an embodiment, the voice server 1110 can determine whether or not the identified voice command can be supported. For example, the natural language processing server 1112 that has analyzed the intention of the user's voice command can determine whether or not the determined voice command can be supported.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the determined voice command transmitted by the natural language processing server 1112 is a voice command, May be a signal indicating that the function (1) is not supported.

The voice server 1110 and the voice recognition server system 1100 including the voice server 1100 according to an embodiment of the present invention can organically connect servers having various roles for natural voice processing.

The voice recognition apparatus 1 performs operations from reception of voice commands to preprocessing and server transmission, and the voice server 1110 can perform natural language processing such as voice / text conversion, intent analysis, and command identification.

By performing the natural language processing by the voice server 1110, it is possible to reduce the burden on the CPU, memory, and the like of the embedded module in the voice recognition apparatus.

Meanwhile, the connection service server 1120 can communicate with the external service and home appliance control server 1130 to perform operations based on the voice command of the user.

On the other hand, the voice recognition device 1 can receive voice data including a sound source file from the voice server 1110 and output a voice guidance message to the voice, so that the voice recognition device 1 can respond to voice input of the user through auditory feedback.

The voice recognition apparatus 1 receives the voice file from the voice server 1110 through streaming, and can reproduce and output the voice guidance message to the user. Accordingly, the speech recognition apparatus 1 need not store various sound source files.

Meanwhile, it is possible to link with various external services without colliding with other servers through the linked service server 1120. In addition, through the external service interworking server, it is possible to increase the success rate of the intention analysis by reflecting external information in the intention analysis.

The voice recognition server system 1100 according to an embodiment of the present invention assures compatibility and connectivity through a plurality of servers and utilizes the home appliance control server 1130 as a final control command, The collision between the home appliance control using the Wi-Fi communication and the home appliance control through the portable terminal and the home appliance control by voice input through the voice recognition device 1 can be prevented through the server 1130. [

The speech recognition server system 1100 according to an embodiment of the present invention can reduce a load on a specific server depending on a certain server through an organic connection between the servers, If there is a problem with the server, it can be easily responded to by linking with other servers having the same role.

In addition, a plurality of servers can be independently updated from time to time, which is advantageous for performance improvement.

32B is an example of a speech recognition server system according to an embodiment of the present invention.

The speech recognition server system illustrated in FIG. 32B improves the process of transmitting speech data for outputting a voice guidance message to the voice recognition apparatus 1 by the voice recognition server system illustrated in FIG. 32A to improve the voice control response time will be.

Therefore, the speech recognition server system illustrated in FIGS. 32A and 32B can perform substantially the same operations other than the above-described differences, and the same portions will be briefly described below.

32B, a speech recognition server system according to an embodiment of the present invention includes a voice server 1110 for receiving voice data from the voice recognition device 1, analyzing the received voice data to discriminate voice commands, . &Lt; / RTI &gt;

In addition, the voice recognition server system according to an embodiment of the present invention may include a voice recognition server 1110 for receiving a signal corresponding to the voice command discriminated from the voice server 1110 and generating a request signal corresponding to the discriminated voice command And a home appliance control server 1130 that transmits a control signal based on a request signal received from the service server 1120 and the connection service server 1120 to the voice recognition device 1. [

The voice recognition server system exemplified in Fig. 32B can be configured so that the voice server 1110 transmits voice data including processing result information based on the voice command to the voice recognition apparatus 1 without requesting the voice recognition apparatus 1. [ As shown in FIG.

The voice server 1110 includes an automatic voice recognition server 1111 that receives voice data from the voice recognition device 1 and converts the received voice data into text data, A natural language processing server 1112 for receiving the text data from the voice recognition device 1112 and analyzing the received text data to determine a voice command, and a speech recognition server 1112 for converting the response signal based on the voice command into voice data, And a text-to-speech conversion server 1113 for transmitting the text-

Also in this embodiment, the household appliance control server 1130 receives a response signal to the control signal from the speech recognition device 1, and transmits processing result information corresponding to the response signal to the connection service server 1120, As shown in FIG.

The linked service server 1120 can transmit the processing result information to the voice server 1110, and more specifically, to the natural language processing server 1112.

In this case, the speech data transmitted from the text-to-speech conversion server 1113 to the speech recognition apparatus 1 may include the processing result information.

The connection service server 1120 also requests the appliance control server for the status information of the voice recognition apparatus 1 based on the signal corresponding to the voice command discriminated, And can transmit the status information of the recognition device 1 to the linked service server 1120.

When the determined voice command can be supported on the basis of the state information of the voice recognition device 1, the connection service server 1120 transmits the voice command to the home appliance control server 1130 It is possible to transmit a corresponding request signal.

Alternatively, when it is impossible to support the determined voice command based on the status information of the voice recognition device 1, the connection service server 1120 transmits a voice message to the voice server 1110, A signal indicating that the signal is transmitted can be transmitted.

For example, the connection service server 1120 can transmit a signal to the natural language processing server 1112 to inform the natural language processing server 1112 of the unsupported function in the current state.

In addition, the natural language processing server 1112 transmits a signal indicating that it is an unsupported function in the current state to the text-to-speech conversion server 1113, and the text-to-speech conversion server 1113 generates corresponding voice data, It is possible to transmit it to the recognition device 1. [

The speech recognition apparatus 1 may receive the voice data from the text-to-speech conversion server 1113 and output a voice guidance message indicating that the voice data is not supported in the current state.

According to an embodiment, the voice server 1110 can determine whether or not the identified voice command can be supported. For example, the natural language processing server 1112 that has analyzed the intention of the user's voice command can determine whether or not the determined voice command can be supported.

In this case, when the determined voice command includes an instruction that can not be supported, the response signal based on the determined voice command transmitted by the natural language processing server 1112 is a voice command, May be a signal indicating that the function (1) is not supported.

When a speech announcement about the corresponding operation is requested to the text-to-speech conversion server 1113 for speech guidance at the earliest after the speech recognition apparatus 1 operates, a time difference may occur between the operation and the announcement.

However, according to the embodiment of the present invention, when the intention analysis is completed and the operation request is transmitted from the natural language processing server 1112, the text voice conversion server 1113 can provide the information to the text voice conversion server 1113 at the same time.

In addition, the text-to-speech conversion server 1113 can provide the announcement to the speech recognition device 1 on the basis of a time point when the home appliance control server 1130 issues a control command to the speech recognition device 1. [

Accordingly, the announcement can be made at the same time or immediately after the operation of the speech recognition apparatus 1.

According to the present embodiment, by directly connecting the natural language processing server 1112 and the text-to-speech conversion server 1113, the time difference between the control command and the announcement via the home appliance control server 1130 can be minimized.

32A and 32B, speech recognition apparatuses that perform a hub function with speech recognition apparatus 1 are exemplified and explained, but the present invention is not limited thereto. For example, the speech recognition device 1 can be employed in a robot cleaner, a refrigerator, a washing machine, a cooking device, a TV, a mobile terminal (smart phone, wearable device), a vehicle, a lighting device, have.

According to one aspect of the present invention, unlike FIGS. 32A and 32B, the automatic speech recognition server 1111, the natural language processing server 1112, and the text-to-speech conversion server 1113 for speech recognition and processing are integrated Server.

In addition, according to an embodiment, the linkage service server 1120 and the home appliance control server 1130 may be configured as one integrated server.

According to the present invention, since the voice recognition device operates according to the voice input, the user does not need to operate the remote control device such as the remote control device, the portable terminal, and the like, and the user convenience can be increased.

32A and 32B, the present invention recognizes a natural language voice command of a user using a plurality of servers and performs a corresponding control operation, thereby enabling a voice recognition apparatus, a system resource of each server It is possible to efficiently recognize and process natural language.

33 to 35 are diagrams illustrating a signal flow of a speech recognition server system according to an embodiment of the present invention, and are a diagram illustrating a signal flow of a speech recognition server system illustrated in FIG. 32A.

33 illustrates a signal flow in a normal situation in which the speech recognition apparatus operates according to a voice command of a user.

Hereinafter, the speech recognition device 1 will be described as an example, but the present invention is not limited thereto.

33, a speech recognition apparatus 1, for example, a speech recognition apparatus 1 according to an embodiment of the present invention can receive a voice command of a user (S410) Command to the voice server 1110 (S420).

For example, when the user receives a music reproduction command such as " play dance music ", the voice recognition apparatus 1 converts the received voice command into digital voice data of a predetermined format such as a wave file, To the recognition server 1111.

On the other hand, after receiving the wakeup signal including the caller, the voice recognition device 1 may wait for command input and transmit voice command to the voice server 1110.

Alternatively, the speech recognition apparatus 1 may receive a continuous speech input including a caller and a voice command. In this case, the speech recognition apparatus 1 can recognize the call word and transmit the voice command to the voice server 1110. [

Meanwhile, when communicating with each other in the system 10, signals transmitted and received may further include identification information of each device, a session value for a task to be performed, and the like in addition to main data to be exchanged have.

The automatic speech recognition server 1111 recognizes the received speech data and converts the received speech data into text data (S431), and transmits the text data to the natural language processing server 1112 (S433).

The natural language processing server 1112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S441).

For example, the natural language processing server 1112 can determine a voice command intended to reproduce the dance music in the voice recognition apparatus 1 by the user in "Play Dance Music".

The natural language processing server 1112 can transmit a signal corresponding to the identified voice command to the linkage service server 1120 (S443).

When the connection service server 1120 requests the current state information of the voice recognition device 1 to the home appliance control server 1130 at S451, the home appliance control server 1130 inquires the current state information of the voice recognition device 1 (S453), and the current status information of the speech recognition apparatus 1 can be transmitted to the linking service server 1120 (S455).

If the home appliance control server 1130 does not have the current state information of the voice recognition device 1, the home appliance control server 1130 can request and receive the current state information from the voice recognition device 1.

On the other hand, the linkage service server 1120 receiving the status information may transmit a request signal to the home appliance control server 1130 to reproduce the dance music in the voice recognition device 1 according to the determined voice command (S461) .

The home appliance control server 1130 can generate the control signal based on the request signal and send it to the voice recognition device 1 to control the voice recognition device 1 (S463).

The home appliance control server 1130 receives the response signal to the control signal from the speech recognition device 1 after the control of the speech recognition device 1 and outputs the processing result information To the linkage service server 1120 (S465).

The linking service server 1120 can transmit the signal corresponding to the processing result information such as " play the dance music " to the natural language processing server 1112 (S470), and the natural language processing server 1112 transmits the discriminated user's voice A response signal based on the command can be transmitted to the speech recognition apparatus 1 (S481). Here, the response signal based on the voice command of the discriminating user may include the processing result information.

On the other hand, the speech recognition apparatus 1 transmits a signal including the text (output phrase) corresponding to the response signal (S483), and the text-to-speech conversion server 1113 receives the text included in the received signal (S485), and can transmit the voice data to the voice recognition device 1 (S487).

The voice recognition device 1 may output a voice guidance message such as " play a dance music " based on the received voice data (S490).

FIG. 34 illustrates the flow of the extension 5 when requesting the non-support function of the speech recognition apparatus.

34, the speech recognition apparatus 1 according to the embodiment of the present invention can receive a user's voice command for a radio output function not supported by the speech recognition apparatus 1, such as & (S510).

The voice recognition apparatus 1 can transmit the voice command of the received user to the voice server 1110 (S520). The voice recognition device 1 can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 1111. [

The automatic speech recognition server 1111 recognizes the received speech data and converts the received speech data into text data in step S531 and transmits the text data to the natural language processing server 1112 in step S533.

The natural language processing server 1112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S541).

In addition, the natural language processing server 1112 can determine whether or not the identified voice name can be supported. In the present embodiment, the natural language processing server 1112 can determine that the user has requested the laundry function not supported by the speech recognition device 1. [

Thereafter, the natural language processing server 1112 can transmit a response signal indicating that the voice command determined by the voice recognition apparatus 1 is a function not supported by the voice recognition apparatus 1 (S543).

On the other hand, the speech recognition apparatus 1 transmits a signal including the text (output phrase) corresponding to the response signal (S551), and the text-to-speech conversion server 1113 receives the text included in the received signal Converted into voice data (S553), and transmitted to the voice recognition device 1 (S555).

Based on the received voice data, the voice recognition device 1 can output a voice guidance message such as " This is an unsupported function " (S560).

FIG. 35 illustrates a signal flow when a non-supported function is requested in the current operation mode of the speech recognition apparatus.

35, the speech recognition apparatus 1 according to the embodiment of the present invention can receive a voice command of a user instructing a specific mode operation of the speech recognition apparatus 1, such as & (S610).

The voice recognition apparatus 1 can transmit the voice command of the received user to the voice server 1110 (S620). The voice recognition device 1 can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 1111. [

The automatic speech recognition server 1111 recognizes the received speech data and converts the received speech data into text data (S631), and transmits the text data to the natural language processing server 1112 (S633).

The natural language processing server 1112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S641).

For example, the natural language processing server 1112 can discriminate a voice command intended to record a music to be played by the user in the voice recognition apparatus 1 in " Record Play Music ".

The natural language processing server 1112 can transmit a signal corresponding to the identified voice command to the linkage service server 1120 (S643).

When the connection service server 1120 requests the current state information of the voice recognition device 1 to the home appliance control server 1130 in step S651, the home appliance control server 1130 inquires the current state information of the voice recognition device 1 (S653), and the current state information of the speech recognition apparatus 1 can be transmitted to the linking service server 1120 (S655).

If the home appliance control server 1130 does not have the current state information of the voice recognition device 1, the home appliance control server 1130 can request and receive the current state information from the voice recognition device 1.

On the other hand, the connection service server 1120 receiving the status information can determine whether the voice command can be supported based on the current status information of the voice recognition apparatus 1 (S657). For example, when the current speech recognition apparatus 1 is playing music and the recording function is supported only in the recording mode, the natural language processing server 1112 determines that the user has requested a recorded reproduction music not supported in the current state .

Thereafter, the connection service server 1120 can transmit a response signal to the natural language processing server 1112 indicating that the voice command is a function that the voice recognition apparatus 1 does not support in the present state (S660).

In step S671, the natural language processing server 1112 transmits a response signal indicating that the voice command is a function not supported by the voice recognition apparatus 1 in the current state.

On the other hand, the speech recognition apparatus 1 transmits a signal including the text (output phrase) corresponding to the response signal (S673), and the text-to-speech conversion server 1113 receives the text included in the received signal (S675), and transmits the voice data to the voice recognition device 1 (S677).

The voice recognition apparatus 1 can output a voice guidance message such as " Playback music is not supported " based on the received voice data (S680).

36 to 38 are diagrams illustrating a signal flow of the speech recognition server system according to an embodiment of the present invention, and are a diagram illustrating a signal flow of the speech recognition server system illustrated in FIG. 32B.

36 illustrates a signal flow in a normal situation in which the speech recognition apparatus operates according to a voice command of a user.

Referring to FIG. 36, a speech recognition apparatus 1, for example, a speech recognition apparatus 1 according to an embodiment of the present invention can receive a voice command of a user (S710) Command to the voice server 1110 (S720).

The automatic speech recognition server 1111 recognizes the received speech data and converts the received speech data into text data (S731), and transmits the text data to the natural language processing server 1112 (S733).

The natural language processing server 1112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S741).

For example, the natural language processing server 1112 can determine a voice command intended to reproduce the dance music in the voice recognition apparatus 1 by the user in "Play Dance Music".

The natural language processing server 1112 can transmit a signal corresponding to the determined voice command to the link service server 1120 (S743).

When the connection service server 1120 requests the current state information of the voice recognition device 1 to the home appliance control server 1130 in step S751, the home appliance control server 1130 inquires of the current state information of the voice recognition device 1 (S753), and the current state information of the speech recognition apparatus 1 can be transmitted to the linking service server 1120 (S755).

If the home appliance control server 1130 does not have the current state information of the voice recognition device 1, the home appliance control server 1130 can request and receive the current state information from the voice recognition device 1.

On the other hand, the connection service server 1120 receiving the status information may transmit a request signal to the home appliance control server 1130 to reproduce the dance music in the voice recognition device 1 according to the determined voice command (S761) .

The home appliance control server 1130 can generate the control signal based on the request signal and transmit the control signal to the voice recognition device 1 to control the voice recognition device 1 (S763).

The home appliance control server 1130 receives the response signal to the control signal from the speech recognition device 1 after the control of the speech recognition device 1 and outputs the processing result information To the connection service server 1120 (S765).

The linkage service server 1120 can transmit a signal corresponding to the processing result information such as " play the dance music " to the natural language processing server 1112 (S770).

On the other hand, the natural language processing server 1112 can transmit a response signal based on the voice command of the discriminating user to the text / voice conversion server 1113 (S781). Here, the response signal based on the voice command of the discriminating user may include the processing result information.

On the other hand, the text-to-speech server 1113 converts the response signal based on the voice command into voice data (S783) and transmits it to the voice recognition device 1 (S785).

The voice recognition device 1 can output a voice guidance message such as " play dance music &quot; based on the received voice data (S790).

37 exemplifies a signal flow when requesting the unsupported function of the speech recognition apparatus.

37, the speech recognition apparatus 1 according to the embodiment of the present invention can receive a user's voice command for a laundry function that is not supported by the speech recognition apparatus 1, such as " turn on the radio &quot; (S810).

The speech recognition apparatus 1 can transmit the voice command of the received user to the voice server 1110 (S820). The voice recognition device 1 can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 1111. [

The automatic speech recognition server 1111 recognizes the received speech data and converts the received speech data into text data (S831), and transmits the text data to the natural language processing server 1112 (S833).

The natural language processing server 1112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S841).

In addition, the natural language processing server 1112 can determine whether or not the identified voice command can be supported. In the present embodiment, the natural language processing server 1112 can determine that the user has requested the laundry function not supported by the speech recognition device 1. [

Thereafter, the natural language processing server 1112 can transmit a response signal to the text / voice conversion server 1113 indicating that the voice command is a function not supported by the voice recognition device 1 (S843).

The text-to-speech conversion server 1113 converts the response signal based on the voice command into voice data (S845) and transmits the voice data to the voice recognition device 1 (S847).

Based on the received voice data, the voice recognition device 1 can output a voice guidance message such as " This is an unsupported function " (S850).

38 illustrates a signal flow when a non-supported function is requested in the current operation mode of the speech recognition apparatus.

Referring to FIG. 38, the speech recognition apparatus 1 according to the embodiment of the present invention can receive a voice command of a user instructing a specific mode operation of the speech recognition apparatus 1, such as " (S910).

The speech recognition apparatus 1 can transmit the voice command of the received user to the voice server 1110 (S920). The voice recognition device 1 can convert the received voice command into digital voice data of a predetermined format such as a wave file and transmit the converted digital voice data to the automatic voice recognition server 1111. [

The automatic speech recognition server 1111 recognizes the received speech data and converts the received speech data into text data (S931), and transmits the text data to the natural language processing server 1112 (S933).

The natural language processing server 1112 can perform natural language processing on the received text data to analyze and determine the intention of the user's voice command (S941).

For example, the natural language processing server 1112 can determine a voice command intended to record the playback music in the voice recognition apparatus 1 in " record playback music ".

The natural language processing server 1112 can transmit a signal corresponding to the identified voice command to the linkage service server 1120 (S943).

When the connection service server 1120 requests the current state information of the voice recognition device 1 to the home appliance control server 1130 in step S951, the home appliance control server 1130 inquires the current state information of the voice recognition device 1 (S953), and the current status information of the speech recognition apparatus 1 can be transmitted to the linking service server 1120 (S955).

If the home appliance control server 1130 does not have the current state information of the voice recognition device 1, the home appliance control server 1130 can request and receive the current state information from the voice recognition device 1.

On the other hand, the connection service server 1120 receiving the status information can determine whether or not the voice command can be supported based on the current status information of the voice recognition apparatus 1 (S957). For example, when the current speech recognition apparatus 1 is playing music and the recording function is supported only in the recording mode, the natural language processing server 1112 can determine that the user has requested a recording mode that is not supported in the current state have.

Thereafter, the linking service server 1120 can transmit a response signal to the natural language processing server 1112 indicating that the voice command is a function not supported by the voice recognition apparatus 1 in the current state (S960).

In step S971, the natural language processing server 1112 may transmit a response signal indicating that the voice command is a function not supported by the text-to-speech conversion server 1113 in the current state.

On the other hand, the text-to-speech conversion server 1113 converts the response signal based on the voice command into voice data (S973) and transmits the voice data to the voice recognition device 1 (S975).

The voice recognition apparatus 1 can output a voice guidance message such as " Playback music is not supported ", based on the received voice data (S980).

According to the present invention, it is possible to implement a user experience that provides appropriate voice guidance for cases in which a command of a user is not understood or a function that can not be provided.

By providing an announcement tailored to each situation and time occurring during command processing, the inconvenience of the user can be minimized.

FIG. 39 shows an example of an internal block diagram of a server according to an embodiment of the present invention. The server 1100 includes an automatic speech recognition server 1111, a natural language processing server 1112, A connection service server 1113, a connection service server 1120, and a home appliance control server 1130.

39, the server may include a communication module 2020, a storage unit 2030, and a processor 2010. [

The processor 2010 can control the overall operation of the server.

The communication module 2020 can receive various data such as status information, operation information, operation information, voice data, and character data from other servers such as the voice recognition device 1. [

The communication module 2020 can transmit the data corresponding to the received various information as it is or after the predetermined processing to the speech recognition device 1, another server or the like.

To this end, the communication module 2020 may include one or more communication modules such as an Internet module, a mobile communication module, and the like.

The storage unit 2030 may store the received information and may have data for generating the corresponding result information.

The storage unit 2030 may store data for operation of the server. For example, in the case of the automatic speech recognition server 1111, an automatic speech recognition algorithm or the like is stored in the storage unit 2030, and in the case of the home appliance control server 1130, product information, Data for control of the speech recognition apparatus 1 can be stored.

On the other hand, the server may be a server operated by the manufacturer of the speech recognition apparatus 1 or a server operated by a service provider, or may be a kind of a cloud server.

40 is a block diagram of an internal block diagram of a speech recognition apparatus according to an embodiment of the present invention.

40, a speech recognition apparatus 1 according to an embodiment of the present invention includes an audio input unit 220 for receiving a voice command of a user, a memory 250 for storing various data, A communication module 50 for communication, an output unit 290 for displaying predetermined information as an image or outputting audio information, and a control unit 240 for controlling overall operation.

The audio input unit 220 can receive external audio signals and user voice commands. To this end, the audio input unit 220 may include one or more microphones (MICs). In addition, the audio input unit 220 may include a plurality of microphones 221 and 222 in order to more accurately receive a user's voice command. The plurality of microphones 221 and 222 can be disposed at different positions and can acquire an external audio signal and process it as an electrical signal.

In FIG. 40 and the like, the audio input unit 220 includes two microphones including a first microphone 221 and a second microphone 222, but the present invention is not limited thereto.

The audio input unit 220 may include a processor for converting analog sound into digital data, or may be connected to a processing unit to convert user input voice commands into data to be recognized by the controller 240 or a predetermined server.

Meanwhile, the audio input unit 220 may use various noise reduction algorithms for eliminating noise generated in the process of receiving a voice command of a user.

The audio input unit 220 may include a filter for removing noise from an audio signal received from each of the microphones 221 and 222 and an amplifier for amplifying and outputting a signal output from the filter, .

The memory 250 records various information necessary for the operation of the voice recognition device 1, and may include a volatile or nonvolatile recording medium. The storage medium stores data that can be read by a microprocessor, and includes a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD- Tape, floppy disk, optical data storage, and the like.

Meanwhile, the memory 250 may store data for voice recognition, and the control unit 240 may process the voice input signal of the user received through the audio input unit 220 and perform a voice recognition process.

Meanwhile, a simple speech recognition may be performed by the speech recognition apparatus 1, and a high-level speech recognition such as a natural language processing may be performed by the speech recognition server system 1100.

For example, when a wake up voice signal including a preset caller is received, the voice recognition apparatus 1 can be switched to a state for receiving a voice command. In this case, the speech recognition apparatus 1 performs only a speech recognition process up to whether or not a caller speech is input, and voice recognition for a subsequent user speech input can be performed through the speech recognition server system 1100.

Since the system resources of the speech recognition apparatus 1 are limited, complex natural language recognition and processing can be performed through the speech recognition server system 1100. [

Limited data may be stored in the memory 250. For example, in the memory 250, data for recognizing a wake up voice signal including a predetermined caller may be stored. In this case, the controller 240 can recognize a wake-up voice signal including a preset caller from the voice input signal received through the audio input unit 220.

On the other hand, the caller can be set by the manufacturer. For example, the " LG Hub " can be set to an alias.

The caller can be changed by the user.

The control unit 240 may control the voice recognition server system 1100 to transmit the voice command of the user inputted after recognizing the wake up voice signal to the voice recognition server system 1100 through the communication module 50. [

The communication module 50 includes one or more communication modules and can perform wireless communication with other electronic devices to exchange various signals. For example, the communication module 50 can communicate with electronic devices inside / outside the mall home system 10. [

In addition, the communication module 50 can communicate with the access point device 7, and can access the wireless Internet network through the access point device 7 to communicate with other devices.

The control unit 240 can also transmit the status information of the voice recognition device 1, the voice command of the user, and the like to the voice recognition server system 1100 or the like through the communication module 50.

Meanwhile, when a control signal is received through the communication module 50, the control unit 240 may control the voice recognition device 1 to operate according to the received control signal.

The output unit 290 may include a display 13 for displaying information corresponding to a command input by a user, a processing result corresponding to a command input by the user, an operation mode, an operation state, an error state,

According to an embodiment, the display 13 may be configured as a touch screen by forming a mutual layer structure with a touch pad. In this case, the display 13 may be used as an input device capable of inputting information by a user's touch in addition to the output device.

The output unit 290 may further include an audio output unit 291 for outputting an audio signal. The audio output unit 291 outputs a notification message such as a warning sound, an operation mode, an operation state, an error state, etc., information corresponding to a command input by the user, a processing result corresponding to a command input by the user, Audio can be output. The audio output unit 291 can convert an electric signal from the control unit 240 into an audio signal and output it. For this purpose, a speaker or the like may be provided.

The speech recognition apparatus 1 may further include an operation unit 181 for user input and a camera 210 capable of photographing a predetermined range around the speech recognition apparatus 1. [

The operation unit 181 includes a plurality of operation buttons, and can transmit a signal corresponding to the input button to the control unit 240.

The camera 210 photographs the surroundings of the voice recognition apparatus 1, the external environment, and the like.

For example, the camera 210 may include at least one optical lens and an image sensor (e.g., an optical sensor) configured to include a plurality of photodiodes (e.g., pixels) that are imaged by light passing through the optical lens. A CMOS image sensor, and a digital signal processor (DSP) that forms an image based on signals output from the photodiodes. The digital signal processor is capable of generating moving images composed of still frames as well as still images.

Meanwhile, the image captured by the camera 210 may be stored in the memory 250.

41 is a flowchart illustrating an operation method of the speech recognition apparatus according to an embodiment of the present invention.

Referring to Fig. 41, the speech recognition apparatus 1 can activate the speech recognition function by user input (S1510). The control unit 240 of the voice recognition device 1 can activate the microphones 221 and 222 according to user input.

Alternatively, the speech recognition apparatus 1 can automatically activate the speech recognition function in accordance with the setting for activating the speech recognition function.

For example, when the power is turned on, the speech recognition apparatus 1 can automatically activate the microphones 221 and 222 and activate the speech recognition function.

When a voice input is received from the user while the microphones 221 and 222 of the voice recognition device are activated, the microphones 221 and 222 receive the input voice and can transmit the voice to the control unit 240. [

On the other hand, the speech recognition apparatus 1 may enter a wake-up signal standby mode for inputting a wake-up voice signal including a preset caller (S1515).

When a wake-up voice signal including a preset call word is received via the microphones 221 and 222 (S1520), the voice recognition apparatus 1 switches to a command standby mode for receiving a voice command (S1525).

If the voice recognition apparatus 1 always waits for a natural language command, the power consumed in the voice recognition function, the CPU occupation rate, and the load on the server of the voice recognition server system are burdensome.

Therefore, the speech recognition apparatus 1 can transmit only the voice signal incoming from the command standby state to the server.

In addition, the speech recognition apparatus 1 gives a condition at a time of waiting for a command, and when receiving a command within a time, it can receive a sound and deliver it to the server until the completion of the command.

According to one aspect of the present invention, the speech recognition apparatus 1 performs only a speech recognition process up to whether a caller speech is input, and the speech recognition for a subsequent user speech input can be performed through the speech recognition server system 1100 have.

Meanwhile, the caller may be set by a manufacturer, and another caller may be set for each voice recognition device. For example, the " LG Hub " can be set to an alias. The caller can be changed by the user.

Meanwhile, the control unit 240 may control the voice recognition server system 1100 to transmit a user's voice command, which is input after recognizing the wake up voice signal, through the communication module 50 (S1540).

On the other hand, waiting indefinitely for a user's voice command is wasteful of system resources and does not match the intention of a user who does not input a command. Therefore, in the command standby mode, only voice commands input during a predetermined elapsed time can be set to be processed ).

As described above, in the speech recognition apparatus 1 according to the embodiment of the present invention, the keyword command including the simple keyword corresponds to itself, and the voice control through the natural language processing corresponds to the speech recognition server system 1100, . Here, the keyword command may mean a voice command including a predetermined keyword for controlling the voice recognition device 1. [

For example, the keyword command may include a keyword corresponding to an operation name such as " power save on, " " power save on, " " power on, "

In addition, the keyword command may include an instruction to request the status information of the voice recognition device 1, such as " electricity usage ", " current status "

Further, according to the embodiment, the keyword command may be composed of only keywords corresponding to the correct name for the predetermined operation mode.

According to an embodiment of the present invention, the control unit 240 can determine whether there is a matching keyword command among a plurality of keyword commands stored in the memory 250 (S1530).

If the voice command received within a predetermined elapsed time corresponds to the pre-stored keyword command, the control unit 240 may control to perform the operation corresponding to the keyword command (S1536).

The control unit 240 can control to operate in the predetermined operation mode if the keyword command is for a predetermined operation mode.

In this case, the control unit 240 can control the voice recognition device 1 in consideration of the current operation state determined by discriminating the current operation state (S1533).

For example, when the keyword instruction for the currently operating mode is received, the control unit 240 terminates the operation of the currently operating mode, and if the keyword command is not for the currently operating mode, It is possible to control to operate in the operation mode.

When the keyword recognizing apparatus 1 is in the standby mode and a keyword command including the keyword " music reproduction " is received, the control unit 240 can control to end the standby mode. That is, if there is a keyword instruction for the operation mode and the function in operation, it is possible to determine that the user desires to terminate the corresponding mode and function, and terminate the corresponding operation mode and function.

Alternatively, when a keyword instruction including the keyword " music reproduction " is received while the speech recognition apparatus 1 is currently in the standby mode, the control unit 240 turns on the " music reproduction " can do.

The speech recognition apparatus 1 according to the embodiment of the present invention first confirms whether or not a keyword command is received when a user's speech input is received, It is possible to perform an operation corresponding to the voice command immediately without transmitting the voice command.

In addition, the control unit 240 may control the audio output unit 291 to output a voice guidance message corresponding to the keyword command (S1580).

To this end, the memory 250 may store a sound source file for each keyword command-specific announcement message.

Meanwhile, when the voice command received within the previously corrected elapsed time does not correspond to the pre-stored keyword command, the control unit 240 may control to transmit the voice data including the voice command to the voice server S1540).

Accordingly, in the case of a natural language not recognizing the keyword command, the natural language voice control service can be provided through the voice recognition server system 1100 including the voice server 1110.

Therefore, according to the present embodiment, when a user issues a command with only a simple keyword, the user can quickly respond without going through a server, thereby minimizing user inconvenience through keyword recognition that is quicker than a relatively long- can do.

According to an embodiment, in the case of failing to transmit voice data including the voice command to the voice server, the control unit 240 may control to perform an operation corresponding to a keyword command most similar to the voice command have.

In this case, there is a risk that an operation not conforming to the user's intention is performed. Therefore, if the most similar keyword command is not derived, the voice guidance message for guiding the transmission failure of the voice data may be output and the specific operation may not be performed.

Further, according to the setting, after the voice guidance message for notifying the transmission failure of the voice data is outputted without discriminating the keyword command most similar to the voice command even when the voice fails, the mode is switched to the wake-up signal standby mode or the command standby mode .

On the other hand, if the voice command is not received within the preset elapsed time (S1527), the controller 240 can control to switch to the wake-up signal standby mode again.

According to an embodiment of the present invention, when the voice command is received within the preset elapsed time (S1527), the control unit 240 notifies the user that the voice recognition apparatus 1 has received the command, So as to perform an operation.

31 to 39, the voice server 1110 and the voice recognition server system 1100 including the voice server 1110 recognize and process voice data including voice commands received from the voice recognition device 1 can do.

Accordingly, when the communication module 50 receives the control signal based on the voice command from the home appliance control server 1130 (S1550), the control unit 240 controls the voice recognition device 1 to operate in accordance with the received control signal, (S1555).

When the communication module 50 receives a response signal based on the voice command from the voice server 1110 (S1560), the control unit 240 controls the audio output unit 1110 to output a voice guidance message corresponding to the received response signal (Step S1580).

The controller 240 requests the voice server 1110 for voice data in step S1575 and transmits the voice data requested by the voice server 1110 to the voice server 1110 in step S1570. It is possible to control to receive voice data.

On the other hand, according to the result of speech recognition, a signal corresponding to the speech recognition failure can be received from the speech server 1110 through the communication module 50. [ In this case, the control unit 240 may control the audio output unit 291 to output the voice guidance message requesting re-input of the voice command, and control to switch to the command standby mode again.

In accordance with the discrimination of supportability of the discriminated voice command, a signal indicating that the voice command is related to the unsupported function can be received from the voice server 1110 via the communication module 50 (S1545) . In this case, the control unit 240 may control the audio output unit 291 to output a voice guidance message informing that the voice command is related to the unsupported function (S1547).

In this case, the control unit 240 can control to switch to the wake-up signal standby mode.

Alternatively, the control unit 240 may control to switch to the command standby mode again.

On the other hand, when the voice command in the voice data corresponds to the pre-stored keyword command, the control unit 240 of the voice recognition apparatus 1 controls to perform an operation corresponding to the keyword command, It is possible to control the voice data including the voice command to be transmitted to the subsystem in the case where it does not correspond to the stored keyword command.

On the other hand, when the control unit 240 of the voice recognition apparatus 1 fails to transmit the voice data including the voice command to the voice server, the control unit 240 can control to perform an operation corresponding to the keyword command most similar to the voice command .

On the other hand, when the control unit 240 of the voice recognition device 1 receives the signal corresponding to the voice recognition failure from the voice server, the control unit 240 can control to output the voice guidance message requesting re-input of the voice command.

On the other hand, when the control unit 240 of the voice recognition apparatus 1 receives a signal from the voice server indicating that the voice command is not supported, the control unit 240 outputs a voice guidance message informing that the voice command is related to the unsupported function .

Here, the pre-stored keyword command can be updated based on the update data from the server system.

On the other hand, when any one of the automatic speech recognition server, the natural language processing server, and the linkage service server in the server system 100 fails, the control unit 240 of the speech recognition apparatus 1 controls to output the corresponding quote .

According to the present invention, by providing a voice guidance message for each situation, it is possible to accurately grasp at which stage a voice control command is not normally controlled. In addition, the degree of freedom of commands for controlling the product is high, and usability is improved.

42 is a flowchart illustrating an operation method of a smart home system including a voice recognition server system and a voice recognition apparatus according to an embodiment of the present invention.

42, the voice recognition apparatus 1 activates the voice recognition function (S1611), enters a wake-up signal standby mode for inputting a wake-up voice signal including a preset caller (S1612).

When the preset caller such as " LG Hub " is inputted through the microphones 221 and 222 (S1613), the voice recognition device 1 can be switched to the command standby mode for receiving the voice command (S1614).

Alternatively, when one of the contact switches 181a, 181b, 181c and 181d is activated, the voice recognition function is activated (S1611) and the voice recognition device 1 can be switched to the command standby mode for receiving voice commands (S1614).

In the command standby mode, it is possible to set to process only voice commands input during a predetermined elapsed time (S1615). For example, an elapsed time of 6 seconds may be set.

The control unit 240 may control the voice server 1110 to transmit the voice data including the voice command received within 6 seconds (S1621).

On the other hand, if the voice command is not received within the preset elapsed time (S1621), the control unit 240 can control to switch to the wake-up signal standby mode again.

According to one aspect of the present invention, the speech recognition apparatus 1 performs only a speech recognition process up to whether a caller speech is input, and the speech recognition for a subsequent user speech input can be performed through the speech recognition server system 1100 have.

Alternatively, according to one aspect of the present invention, the speech recognition apparatus 1 performs only a speech recognition process from whether or not a caller voice is input and whether a keyword is commanded, and voice recognition for a subsequent user voice input is performed by a voice recognition server system 1100).

In this case, the control unit 240 can determine whether there is a matching keyword instruction among a plurality of keyword instructions stored in the memory 250 (S1617).

If the voice command received within a predetermined elapsed time corresponds to a pre-stored keyword command, the control unit 240 analyzes the keyword command (S1619) and controls to perform an operation corresponding to the keyword command (S1680).

The control unit 240 may control the speech recognition apparatus 1 to operate in the predetermined operation mode if the keyword command is for a predetermined operation mode (S1680).

Also, the control unit 240 may control the audio output unit 291 to output a voice guidance message corresponding to the keyword command (S1690).

To this end, the memory 250 may store a sound source file for each keyword command-specific announcement message.

On the other hand, when voice data including a voice command is received from the voice recognition apparatus 1 (S1621), the voice server 1110 can perform a natural language processing to analyze the command and discriminate the voice command (S1622).

If the voice command is not normally analyzed (S1623), the voice server 1110 notifies the voice recognition apparatus 1 of the voice command analysis failure and the voice recognition apparatus 1 notifies the voice guidance apparatus 1 of the voice guidance message (S1662).

In this case, the re-order request and the re-order analysis process may be set to be performed only a predetermined number of times (S1661).

For example, if the normal analysis fails three times or more, the control unit 240 can again control to switch to the wake-up signal standby mode without requesting re-ordering.

On the other hand, if the voice command is normally analyzed (S1623), the voice server 1110 can transmit the voice command to the signal connection service server 1120 corresponding to the voice command.

Meanwhile, the connection service server 1120 can determine whether the voice command can be supported or not.

For example, the connection service server 1120 can determine whether the voice command is a function supported by the voice recognition apparatus 1 (S1631).

The connection service server 1120 may determine whether the voice command is a function supported by the current state of the voice recognition apparatus 1, a voice command, or the like (S1632) .

31 to 39, if the determined voice command is not a function that can be supported by the voice command, the connection service server 1120 transmits the voice command to the voice recognition apparatus 1 via the voice server 1110, It is possible to transmit a response signal indicating that the function can not be supported.

Accordingly, the voice recognition apparatus 1 can output a voice guidance message such as 'a function that is not supported' or 'a function that does not support voice' (S1671, S1672).

Also, the control unit 240 can control to switch to the wake-up signal standby mode.

On the other hand, when voice data including a voice command is received from the voice recognition apparatus 1 (S1621), the voice server 1110 can perform a natural language processing to analyze the command and discriminate the voice command (S1622).

In this case, when the voice command is the interactive command having a plurality of corresponding actions (S1640), the voice server 1110 transmits a selectable answer including a predetermined question to the voice guidance message It is possible to transmit a predetermined signal to ignite (S1650). Accordingly, the speech recognition apparatus 1 can generate a selection answer including a predetermined question as a voice guidance message (S1650).

Here, the interactive command may mean a command capable of performing a plurality of corresponding actions after a speech recognition result such as " not well received ", " too loud ".

For example, in the case of " hardly heard ", a plurality of operations can be discriminated as a corresponding operation, such as raising the setting volume and changing the playback music. In addition, when increasing the volume, the corresponding volume can be set to various change values to perform corresponding operations.

On the other hand, a command such as " Change volume to two levels " can be named as a general type command instead of an interactive command because there is one corresponding operation that changes the setting volume to two levels.

On the other hand, if the identified voice is an interactive command (S1640), the voice recognition device 1 can output a voice guidance message to the user to select and determine the decision to narrow the selection range (S1650) .

For example, when the user utteres an interactive command of " can not hear well ", the speech recognition apparatus 1 narrows the selection range such as " raise the volume? .

When the user answers the question of "Do you want to raise the volume?" To the question of the voice recognition device 1, the voice recognition device 1 again reads "Do you want to dance music?" And so on.

If the user gives a negative answer such as " NO " to the question of the voice recognition device 1, " Is it a dance music frame ?, " And so on.

By repeating this process, the user can grasp the input of the natural language more accurately and accurately perform the desired operation by the user.

Meanwhile, if the determined voice command is related to the voice recognition device 1, the connection service server 1120 can perform a corresponding operation by communicating with the home appliance control server 1130.

Alternatively, if the determined voice command is not related to the voice recognition device 1, the connection service server 1120 can perform a corresponding operation by communicating with an external service.

The connection service server 1120 may generate a request signal corresponding to the determined voice command and transmit the request signal to the home appliance control server 1130 if the determined voice command controls the voice recognition device 1 have.

The home appliance control server 1130 may receive the request signal from the linkage service server 1120 and transmit a control signal based on the request signal to the voice recognition device 1. [

Meanwhile, the speech recognition apparatus 1 may perform a corresponding operation according to the control signal received from the home appliance control server 1130 (S1680).

Also, the speech recognition apparatus 1 may transmit a signal to the home appliance control server 1130 indicating that the operation is performed after performing the requested operation.

The home appliance control server 1130 receives a response signal to the control signal from the speech recognition device 1 and transmits processing result information indicating that the operation for the request is successful to the linkage service server 1120 .

The linkage service server 1120 can transmit a signal corresponding to the processing result information to the natural language processing server 1112. The natural language processing server 1112 transmits a response signal based on the voice command of the discriminating user to the speech recognition To the device (1).

On the other hand, the voice recognition apparatus 1 can generate a voice guidance message including the announcement based on the voice data received from the voice server 1110 (S1690).

43 to 48 are diagrams referred to in explaining various operations of the speech recognition server system and the speech recognition apparatus according to an embodiment of the present invention.

43 to 48 show various examples in which the air conditioner performs a corresponding operation in response to a user's keyword voice command input and natural voice command input.

Referring to FIG. 43, a user may enter a voice command 1710, such as " current state. &Quot; The speech recognition device 1 that has received the voice command 1710 of the user through the microphones 221 and 222 can determine whether or not there is a keyword command corresponding to the voice command 1710. [

If a command for requesting status information of the speech recognition apparatus 1 is present in the memory 250 as a keyword command, such as " current status " or " , It can immediately check the status information and output a voice guidance message 1720 including status information such as " in standby mode ".

Accordingly, the status information of the voice recognition apparatus 1 can be provided to the user at a faster response speed than when the server is passed.

Referring to FIG. 44, a user may input a voice command 1810 including a keyword such as " music playback ". The speech recognition device 1 that has received the user voice command 1810 through the microphones 221 and 222 can determine whether or not there is a keyword instruction corresponding to " music reproduction ".

If " music reproduction " exists in the memory 250 with the keyword command, the speech recognition device 1 drives the music reproduction function immediately without going through the speech recognition server system 1100, A voice guidance message 1820 can be output.

Referring to FIG. 45, the user can input a voice command 1910 in a natural language such as " please entertain ". The voice recognition device 1 that has received the voice command 1910 of the user through the microphones 221 and 222 can transmit the voice command 1910 to the voice recognition server system 1100. [

The speech recognition server system 1100 may analyze the received voice command 1910 to determine the intent of the user who desires to reproduce the music. Accordingly, the speech recognition server system 1100 can transmit a control signal for performing music reproduction to the speech recognition apparatus 1 and a response signal corresponding to the operation.

The speech recognition device 1 drives the air cleaning function and can output a voice guidance message 1920 such as " play music ".

46, the user can input a keyword command 2010 including a keyword corresponding to a specific operation such as " power saving function " or " power saving function is turned on ". The speech recognition device 1 which has received the keyword instruction 2010 through the microphones 221 and 222 can directly drive the power saving function and output a voice guidance message 2020 such as & .

Referring to FIG. 47, a user may enter a voice command 2110 in a natural language such as " save electricity. &Quot; The voice recognition device 1 having received the voice command 2110 of the user through the microphones 221 and 222 can transmit the voice command 2110 to the voice recognition server system 1100.

The voice recognition server system 1100 may analyze the received voice command 2110 to determine the intention of the user who desires the power save function. Accordingly, the voice recognition server system 1100 can transmit a control signal for driving the power saving function and a response signal corresponding to the operation to the voice recognition device 1. [

The voice recognition device 1 drives the power saving function and can output a voice guidance message 2120 such as " start power saving function ".

Meanwhile, the voice recognition server system 1100 according to an embodiment of the present invention may communicate with the external service 121 to perform a corresponding operation if the voice command is not related to the voice recognition device 1 have.

Referring to FIG. 48, the user can input a voice command 2210 in a natural language such as " Today's weather. &Quot; The voice recognition device 1 that has received the voice command 2210 of the user through the microphones 221 and 222 can transmit the voice command 2210 to the voice recognition server system 1100. [

The speech recognition server system 1100 may analyze the received voice command 2210 to determine the intended intention of the user for weather information. Accordingly, the speech recognition server system 1100 can access an external service or an Internet network that provides weather information, and can request and receive weather information.

In addition, the speech recognition server system 1100 can transmit data based on the received weather information to the speech recognition apparatus 1. [

The voice recognition device 1 can output a voice guidance message 2220 including weather information such as " Seoul is raining from afternoon " based on the received data.

FIG. 49 is a flowchart illustrating an operation method of a speech recognition apparatus according to another embodiment of the present invention, and FIGS. 50A to 51F are diagrams referencing the description of the operation method of FIG.

Referring to the drawing, first, the control unit 240 determines whether or not the voice recognition mode is activated (S2310).

For example, when the voice recognition mode button 231 in the operation unit 230 of the voice recognition device 1 shown in FIG. 50A is operated, the control unit 240 of the voice recognition device 1 determines whether or not the voice recognition mode Can be controlled to be activated.

On the other hand, when the voice recognition mode is activated, the control unit 240 can control power to be supplied to the audio input unit 220.

Next, in a state in which the voice recognition mode is activated, the control unit 240 determines whether there is voice input within the first time (S2315).

When there is a voice input, the audio input unit 220 of the voice recognition device 1 can receive the user's voice, thereby converting the voice into an electric signal and outputting the voice data.

The voice data may include a caller. For example, in the call word, " LG Hub " and the like can be exemplified.

On the other hand, the voice data may include a keyword command after the caller or a natural language command.

Next, the control unit 240 of the voice recognition apparatus 1 can determine whether or not the keyword is included in the input voice data (S2320).

When the keyword is included in the input voice data, the control unit 240 of the voice recognition device 1 can control to output a sound corresponding to the keyword (S2350). If the keyword is included in the input voice data, the control unit 240 of the voice recognition device 1 can control to perform an operation corresponding to the keyword (S2355).

The keyword command is a command corresponding to the speech stored in the memory 250 in the speech recognition device 1 and is a command corresponding to the speech stored in the memory 250 in the speech recognition device 1 (e.g., " power on ", " power off & 1) corresponding to the operation unit 230 of the control unit.

The control unit 240 of the voice recognition device 1 compares the voice data input through the audio input unit 220 with the keyword stored in the memory 250 and if the voice data matches the voice data, And control to perform an operation corresponding to the keyword.

For example, when a keyword such as " power on " is included in the voice data, the control unit 240 of the voice recognition device 1 can turn on the power of the voice recognition device 1 in the standby mode . Particularly, it is possible to control the power to be supplied to the audio output portion having the largest power consumption.

As another example, when the keyword such as " power off " is included in the voice data, the control unit 240 of the voice recognition device 1 can turn off the power of the voice recognition device 1 in the operation mode. Particularly, it is possible to control so that power is not supplied to the audio output portion having the largest power consumption.

As another example, when a keyword such as " Turn on power saving function " is included in the voice data, the control unit 240 of the voice recognition device 1 operates the voice recognition device 1 in the operation mode state to the power saving mode . For example, the control unit 240 of the voice recognition device 1 can control the operation time of the audio output unit having the largest power consumption to be lowered.

The control unit 240 of the voice recognition device 1 can control to output the sound corresponding to the keyword instruction through the audio output unit 281 when the keyword instruction is included in the voice data.

For example, when a keyword command such as " power on ", " power off ", " power saving operation ", or the like is input, the control unit 240 of the voice recognition device 1 determines that " Will be off. "," Sleep Driving. " Such as &lt; / RTI &gt;

On the other hand, when the keyword is not included in the input voice data, the control unit 240 of the voice recognition device 1 can determine whether or not the connection state with the server system 1100 is unstable (S2325).

When the connection with the server system 1100 is unstable, that is, when the communication with the server system 1100 is not smooth, the control unit 240 of the voice recognition device 1 outputs the pre- (S2360).

For example, when any one of the automatic speech recognition server 1111, the natural language processing server 1112, and the linkage service server 1120 in the server system 1100 is malfunctioning, Can be controlled. This will be described with reference to Figs. 51A to 51F.

On the other hand, if neither step 2320 (S2320) nor step 2325 (S2325) are all applicable, the control unit 240 can transmit the voice data to the server system 1100 (S2330).

At this time, the control unit 240 can control to add the transmission data of the communication module 50 to the audio data from the audio input unit 220. [

Next, the control unit 240 of the voice recognition device 1 can receive the result data corresponding to the voice data transmitted from the server system 1100 (S2335).

The received result data may be voice data for speech transmitted from the server system 1100 in correspondence with the transmitted voice data.

On the other hand, the received result data further includes operation data related to the operation of the speech recognition apparatus corresponding to the speech data for speech transmitted from the server system 1100, in addition to the speech data for speech transmitted from the server system 1100 .

Accordingly, the control unit 240 of the voice recognition device 1 can control to output the sound corresponding to the received result data through the audio output unit 281 based on the received result data ( S2340).

As a result, speech data for speech corresponding to the user's natural speech can be outputted through the speech recognition device 1, thereby making it possible to increase the convenience for the user.

On the other hand, when receiving the operation data relating to the operation of the voice recognition apparatus, the control unit 240 of the voice recognition apparatus 1 performs the operation based on the operation data related to the operation of the voice recognition apparatus The driving unit 280 and the like (S2345).

Hereinafter, the operation based on the keyword instruction and the natural language instruction will be described in comparison.

50A illustrates a case where a keyword 2010 such as " turn on the power save function " is uttered. Accordingly, the control unit 240 of the voice recognition device 1 can search for the keyword stored in the inside and perform matching with the voice data of " turn on the power save function ".

When the analysis is completed, the control unit 240 of the voice recognition device 1 can control the power saving function to be performed. Then, it is possible to control to output an announcement such as " start power saving function ".

On the other hand, the control unit of the voice recognition apparatus 1 can control so that the operation period of the audio output unit becomes small so that the power saving operation is performed.

Next, Fig. 50C illustrates a case where the natural language 2110 such as " Today's weather is good &quot; is uttered.

The control unit 240 of the voice recognition apparatus 1 can search for the keyword stored in advance and perform the matching of the voice data of " What is the weather today? &Quot; If it is not matched, .

The control unit 240 of the voice recognition apparatus 1 transmits voice data 2414 corresponding to the natural language 1910 to the server system 1100 As shown in FIG.

Then, the server system 1100 can receive the result data 2418.

On the other hand, after receiving the result data, the control unit 240 of the voice recognition device 1 generates a voice guidance message 2120 including weather information such as " Seoul is raining from afternoon " ) Can be output.

50E shows a first period P1 from the keyword ignition T1 of Fig. 50A and Fig. 50B to the moment output time T2 corresponding to the keyword, and a first period P1 from the natural ignition timing Ta of Figs. 50C and 50D And the second period Pa up to the moment output time Ta corresponding to the natural language.

Referring to the drawing, it can be seen that the keyword recognition period P1 is shorter than the natural language recognition period P2.

As in the present invention, by recognizing a keyword command, which is a simple command, in the speech recognition apparatus 1, the operation of the speech recognition apparatus can be performed quickly, and a natural language command, which is a complicated command, 1100) so that accurate natural language recognition can be achieved together.

Figs. 51A to 51F illustrate various items outputted from the speech recognition apparatus, particularly, the speech recognition apparatus 1 when the result data is not smoothly received from the server system 1100. Fig.

First, FIG. 51A shows a state in which network connection between the speech recognition device 1 and the server system 1100 is not established when voice data corresponding to the natural language 2210 is transmitted.

Accordingly, the control unit 240 of the voice recognition apparatus 1 can control to output the announcement message 2610 such as " the network connection is not smooth. &Quot;

Next, FIG. 51B shows a state in which the network connection between the speech recognition device 1 and the server system 1100 is unstable at the time of transmission of voice data corresponding to the natural language 2210. FIG.

Accordingly, the control unit 240 of the voice recognition device 1 can control to output an announcement message 2620 such as " Please wait a moment. &Quot;

51C shows a delayed state of the automatic voice recognition server 1111 in the server system 1100 when voice data corresponding to the natural language 2210 is transmitted.

Accordingly, the control unit 240 of the voice recognition device 1 can control to output the announcement message 2630 such as " Sorry, please tell me again ".

Next, FIG. 51D shows the delay state of the natural language processing server 1112 in the server system 1100 at the time of audio data transmission corresponding to the natural language 2210. FIG.

Accordingly, the control unit 240 of the voice recognition device 1 can control to output an announcement message 2640 such as " An exception has occurred in the voice recognition server, please try again after a while. &Quot;

Next, FIG. 51D shows a confirmation bug state of the linkage service server 1120 in the server system 1100 at the time of audio data transmission corresponding to the natural language 2210. FIG.

Accordingly, the control unit 240 of the voice recognition apparatus 1 can control to output an announcement message 2650 such as " an exception has occurred in the voice scenario server. &Quot;

Next, FIG. 51E shows the confirmation delay state of the linked service server 1120 in the server system 1100 at the time of audio data transmission corresponding to the natural language 2210. FIG.

Accordingly, the control unit 240 of the voice recognition device 1 can control to output an announcement message 2660 such as " The network is not smooth. Please try again later. &Quot;

As described above, by outputting different messages according to the respective symptoms, the user or the like can indirectly check the state of the server system 1100.

On the other hand, the voice recognition device 1 can receive the status data of the server system 1100 and the like in the event of a failure of the server system 1100, except when the network connection is not established. Accordingly, it is possible to output the various items of Figs. 51B to 51F.

The speech recognition apparatus according to the embodiment of the present invention is not limited to the configuration and method of the embodiments described above but the embodiments can be modified so that all or some of the embodiments are selectively As shown in FIG.

Meanwhile, the operation method of the speech recognition apparatus of the present invention can be implemented as a code readable by a processor on a recording medium readable by a processor included in the speech recognition apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (6)

main body;
A cover housing coupled to an upper portion of the main body;
A grill in which a plurality of through holes are formed and which has an elongated cylindrical shape and in which the main body is disposed on the inner side and the upper end is coupled to the cover housing;
A display disposed in the cover housing and displaying corresponding information for each process of the voice input;
A window disposed above the display and having at least one through-hole;
An audio input unit for acquiring audio;
A server module that is disposed in the main body and performs voice recognition processing, the communication module transmitting voice data from the audio input unit and receiving recognition result data on the voice data from the server system; And
And a control unit for controlling the audio input unit and the communication module,
Wherein an upper surface of the main body is formed with an inclined surface having a higher rear height than the front surface, the window is inclined along the inclined surface,
At least one antenna in the communication module is disposed behind the side wall of the cover housing and spaced apart from the display,
Wherein,
When the voice command in the voice data corresponds to a pre-stored keyword command, controls to perform an operation corresponding to the keyword command, and when the voice command in the voice data does not correspond to the pre-stored keyword command, And transmits the voice data including the command to the server system. The method according to claim 1,
Wherein,
And controls to perform an operation corresponding to a keyword command most similar to the voice command when the voice data including the voice command fails to be transmitted to the voice server. The method according to claim 1,
Wherein,
And to output a voice guidance message for requesting re-input of a voice command when a signal corresponding to a voice recognition failure is received from the voice server. The method according to claim 1,
Wherein,
Upon receiving a signal indicating that the voice command is related to the unsupported function, outputs a voice guidance message informing that the voice command is related to the unsupported function. The method according to claim 1,
Wherein the pre-stored keyword command is updated based on update data from the server system. The method according to claim 1,
Wherein,
Wherein the controller is configured to control the output of the corresponding quote message when any one of the automatic speech recognition server, the natural language processing server, and the linkage service server in the server system fails.

Images