KR102218640B1 - Display device and controlling method of display device - Google Patents

Abstract

A display device capable of rotating a display based on a type of a user command for controlling the display device and a method of controlling the display device are provided. Specifically, the display device according to the present disclosure receives a user command for controlling the display device while the first content is displayed on the display of the display device, and if the received user command is for controlling the first content, If it is determined to maintain the rotation direction, and the received user command is to display the second content on the display, the rotation direction of the display is determined based on the type of the second content, and the display corresponds to the determined rotation direction of the display. Control.

Description

A display device and a control method of a display device TECHNICAL FIELD [DISPLAY DEVICE AND CONTROLLING METHOD OF DISPLAY DEVICE}

The present disclosure relates to a display device and a method of controlling the display device, and more particularly, to a display device capable of determining a rotation direction of a display based on a type of a user command for controlling the display device, and a method of controlling the display device. .

Recently, the time for users to experience content through a mobile device such as a smart phone is increasing. Accordingly, in the case of web content including social media, it is provided to match the aspect ratio of the mobile device and the gripping direction of the user on the mobile device. In addition, even in the case of video content that has been conventionally provided in the horizontal direction, the amount of content provided in the vertical direction is increasing rapidly in recent years.

However, when a user enjoys content through a mobile device such as a smart phone, due to restrictions on the display size of the mobile device, the user's viewing experience is limited compared to when viewing the content through a display device such as a TV. .

On the other hand, in the case of a display device such as a TV, since a display device having a long horizontal direction is generally provided, it is generally insufficient to enjoy content in the vertical direction. In addition, even when the display device has a display capable of rotating the display in the vertical direction, the problem that the rotation of the display does not correspond to the user's various content viewing experience is pointed out.

Accordingly, there is a need for a display device capable of providing a variety of content in a larger visual experience than a mobile device and rotating the display to meet the user's various content viewing experience.

The present disclosure has been devised according to the necessity as described above, and an object of the present disclosure is to provide a display device capable of determining a rotation direction of a display based on a type of user command for controlling the display device, and a method of controlling the display device. Is in.

According to an embodiment of the present disclosure for achieving the above object, a display device includes a display, a motor that rotates the display, a memory storing at least one instruction, and a memory for executing the at least one instruction. A processor, wherein the processor receives a user command for controlling the display device while the first content is displayed on the display, and if the received user command is for controlling the first content, the display It is determined to maintain the rotation direction of and, if the received user command is to display the second content on the display, the rotation direction of the display is determined based on the type of the second content, and the display is The motor is controlled to correspond to the determined rotation direction of the display.

Here, the display device further includes a communication unit including a circuit, and the processor provides the user command from at least one of a user terminal connected to the display device and a remote control device for controlling the display device through the communication unit. Can be received.

Here, when a user command for displaying the second content is received from a remote control device while the first content is displayed on the display, the processor may determine a rotation direction of the display as a horizontal direction.

On the other hand, when a user command for displaying the second content on the display is received while the first content is displayed on the display, the processor may transmit the second content and the user terminal from the user terminal through the communication unit. If information on the rotation direction is received and the second content corresponds to a screen displayed on the user terminal, the rotation direction of the display may be determined based on information on the rotation direction of the user terminal.

Here, the processor rotates the display when information indicating that the rotation direction of the user terminal is vertical and the second content in which the screen displayed on the user terminal is rotated in the horizontal direction are received from the user terminal through the communication unit. The received second content determines a vertical direction, controls the motor to rotate the display in the determined vertical direction, and displays the received second content in a vertical direction on the display rotated in the vertical direction. The display may be controlled to process content and display the processed second content on the display rotated in the vertical direction.

Meanwhile, when the communication connection with the user terminal is terminated while the second content is displayed on the display, the processor may determine a rotation direction of the display as a horizontal direction.

Meanwhile, the processor of claim 1, when a first user voice is received while the first content is displayed on the display, inputs the received first user voice into a first artificial intelligence model and 1 If a first user command corresponding to a user's voice is acquired, and the acquired first user command is for controlling the first content, it is determined to maintain the rotation direction of the display, and the acquired first user If the command is to display the second content on the display, the rotation direction of the display may be determined based on the type of the second content.

Here, when the second content includes a search result for a plurality of contents corresponding to the first user command, the processor determines a rotation direction of the display as a vertical direction, and the display is rotated in the determined vertical direction. When the second user voice is received while controlling the motor so that the second content is displayed on the display rotated in the vertical direction and the second content is displayed on the display rotated in the vertical direction, the The received second user voice is input to the first artificial intelligence model to obtain a second user command corresponding to the received second user voice, and the obtained second user command is displayed according to the first user command. If one of the plurality of contents is to be displayed on the display, the rotation direction of the display may be determined as a horizontal direction.

Meanwhile, the processor inputs information on the type of the second content to a second artificial intelligence model to obtain information on the rotation direction of the display corresponding to the type of the second content, and the obtained rotation direction is The rotation direction of the display may be determined based on the information.

According to an embodiment of the present disclosure for achieving the above object, a method for controlling a display device includes receiving a user command for controlling the display device while the first content is displayed on the display of the display device. Step, if the received user command is for controlling the first content, it is determined to maintain the rotation direction of the display, and if the received user command is for displaying the second content on the display, the second And determining a rotation direction of the display based on the type of content, and controlling the display to correspond to the determined rotation direction of the display.

Here, the receiving of the user command may include receiving the user command from at least one of a user terminal connected in communication with the display device and a remote control device for controlling the display device.

Here, the determining of the rotation direction of the display may include a horizontal direction when a user command for displaying the second content is received from a remote control device while the first content is displayed on the display. It may include the step of determining.

Meanwhile, when a user command for displaying the second content on the display is received while the first content is displayed on the display, information on the second content and the rotation direction of the user terminal is received from the user terminal. The step of determining the rotation direction of the display further comprises: if the second content is a content corresponding to a screen displayed on the user terminal, the display is performed based on information on the rotation direction of the user terminal. It may include the step of determining the rotation direction of.

Here, the step of determining the rotation direction of the display includes information indicating that the rotation direction of the user terminal is a vertical direction and the second content in which the screen displayed on the user terminal is rotated in the horizontal direction is received from the user terminal. Determining a rotation direction of the display in a vertical direction, and controlling the display includes controlling the display to rotate in the determined vertical direction, and the received second on the display rotated in the vertical direction It may include displaying content in a vertical direction.

Meanwhile, in determining the rotation direction of the display, when the communication connection with the user terminal is terminated while the second content is displayed on the display, the rotation direction of the display may be determined as a horizontal direction.

Meanwhile, in the receiving of the user command, when a first user voice is received while the first content is displayed on the display, the received first user voice is input to a first artificial intelligence model. 1 The step of obtaining a first user command corresponding to a user's voice, and determining a rotation direction of the display includes the rotation direction of the display if the obtained first user command is for controlling the first content. And determining the rotation direction of the display based on the type of the second content if the obtained first user command is to display the second content on the display. .

Here, the determining of the rotation direction of the display includes determining a rotation direction of the display as a vertical direction when the second content includes information on a plurality of contents corresponding to the first user command, and The controlling of the display includes controlling the motor so that the display is rotated in the determined vertical direction, and displaying the second content on the display rotated in the vertical direction. In the control method, when a second user voice is received while the second content is displayed on the display rotated in the vertical direction, the received second user voice is input to the first artificial intelligence model, Obtaining a second user command corresponding to a user's voice, and if the obtained second user command is for displaying one image content among the plurality of contents on the display, the rotation direction of the display is set to a horizontal direction. It may further include the step of determining.

On the other hand, the determining of the rotation direction of the display includes inputting information on the type of the second content into a second artificial intelligence model to obtain information on the rotation direction of the display corresponding to the type of the second content. And determining the rotation direction of the display based on the obtained rotation direction information.

According to an embodiment of the present disclosure for achieving the above object, in a computer-readable recording medium including a program for executing a method for controlling a user terminal, the method for controlling the user terminal is When a user command for transmitting the content corresponding to the screen displayed on the display to the display device is input, performing a communication connection with the display device, when information that the rotation direction of the user terminal is a vertical direction is obtained, Obtaining content in which the screen displayed on the display is rotated in a horizontal direction, and transmitting information that the rotation direction of the user terminal is a vertical direction and the obtained content to a display device connected to the user terminal do.

1 is a diagram schematically illustrating a control process of a display device according to an embodiment of the present disclosure;
2 is a block diagram schematically illustrating a configuration of a display device according to an embodiment of the present disclosure;
3 is a block diagram showing in detail the configuration of a display device according to an exemplary embodiment of the present disclosure;
4 and 5 are diagrams for specifically explaining a process of controlling the display device according to the present disclosure based on a user command according to a user's voice;
6 is a block diagram schematically showing a configuration of a user terminal according to an embodiment of the present disclosure;
FIG. 7 is a diagram specifically illustrating a process of controlling a display device according to the present disclosure based on information on a rotation direction of a user terminal;
8A and 8B are diagrams illustrating a user interface of a user terminal according to an embodiment of the present disclosure;
8C and 8D are diagrams for explaining a process of expanding or reducing content displayed on a display device through a user terminal and displaying;
9 is a view showing a remote control device according to an embodiment of the present disclosure;
10 is a diagram illustrating a user interface of a display device according to an embodiment of the present disclosure;
11 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present disclosure;
12 is a diagram for specifically explaining a speech recognition process according to an embodiment of the present disclosure, and,
13 is a block diagram illustrating a detailed configuration of a processor according to an embodiment of the present disclosure.

Since the present embodiments can apply various transformations and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiment, and it should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar elements.

In describing the present disclosure, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present disclosure, a detailed description thereof will be omitted.

In addition, the following embodiments may be modified in various other forms, and the scope of the technical idea of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to make the present disclosure more faithful and complete, and to completely convey the technical idea of the present disclosure to those skilled in the art.

The terms used in the present disclosure are only used to describe specific embodiments, and are not intended to limit the scope of rights. Singular expressions include plural expressions unless the context clearly indicates otherwise.

In the present disclosure, expressions such as "have," "may have," "include," or "may include" the presence of corresponding features (eg, elements such as numbers, functions, actions, or parts) And does not exclude the presence of additional features.

In the present disclosure, expressions such as "A or B," "at least one of A or/and B," or "one or more of A or/and B" may include all possible combinations of items listed together . For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) at least one B, Or (3) it may refer to all cases including both at least one A and at least one B.

Expressions such as "first," "second," "first," or "second," used in the present disclosure may modify various elements, regardless of order and/or importance, and one element It is used to distinguish it from other components and does not limit the components.

Some component (eg, a first component) is "(functionally or communicatively) coupled with/to)" to another component (eg, a second component) or " When referred to as "connected to", it should be understood that the certain component may be directly connected to the other component or may be connected through another component (eg, a third component).

On the other hand, when a component (eg, a first component) is referred to as being “directly connected” or “directly connected” to another component (eg, a second component), the component and the It may be understood that no other component (eg, a third component) exists between the different components.

The expression "configured to (configured to)" used in the present disclosure is, for example, "suitable for," "having the capacity to" depending on the situation. ," "designed to," "adapted to," "made to," or "capable of." The term "configured to (or set)" may not necessarily mean only "specifically designed to" in hardware.

Instead, in some situations, the expression "a device configured to" may mean that the device "can" along with other devices or parts. For example, the phrase “a processor configured (or configured) to perform A, B, and C” means a dedicated processor (eg, an embedded processor) for performing the operation, or by executing one or more software programs stored in a memory device. , May mean a generic-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

In an embodiment, the'module' or'unit' performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software. In addition, a plurality of'modules' or a plurality of'units' may be integrated into at least one module and implemented as at least one processor except for the'module' or'unit' that needs to be implemented with specific hardware.

Meanwhile, various elements and areas in the drawings are schematically drawn. Therefore, the technical idea of the present invention is not limited by the relative size or spacing drawn in the accompanying drawings.

Hereinafter, exemplary embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the embodiments.

1 is a diagram schematically illustrating a control process of a display apparatus 100 according to an exemplary embodiment of the present disclosure.

As shown in FIG. 1, the display device 100 according to an embodiment of the present disclosure may rotate the display of the display device 100. That is, the display device 100 according to the present disclosure may perform a so-called pivot function. Specifically, the display may be rotated to be placed in a horizontal direction or a vertical direction. In FIG. 1, a state in which the display is placed in a vertical direction is illustrated (110-1), and a state in which the display is placed in a horizontal direction is illustrated by a dotted line (110-2). Meanwhile, in FIG. 1, it is shown that the display rotates counterclockwise, but it goes without saying that the display may rotate clockwise.

Hereinafter, in describing the present disclosure, it is expressed that the display is pivoted to be placed in a horizontal direction or a vertical direction, and that the display is rotated in a horizontal direction or a vertical direction. Meanwhile, the display device 100 may be implemented as, for example, a digital TV or a monitor, but there is no particular limitation on the type thereof.

According to an exemplary embodiment of the present disclosure, the display device 100 receives a user command for controlling the display device 100. Specifically, the display device 100 may receive a user command through the user terminal 200 connected in communication with the display device 100, and the user through the remote control device 300 for controlling the display device 100 You can also receive commands.

Here, the user terminal 200 may communicate with the display device 100 and transmit a control signal and image content to the display device 100. The user terminal 200 may communicate with the display device 100 in a manner such as Wi-Fi or Bluetooth, but the communication method is not limited to a special method. The user terminal 200 may be implemented as, for example, a smart phone or a tablet PC, but there is no particular limitation on the type thereof.

Meanwhile, the remote control device 300 may receive a user input for controlling the display device 100 and output a control signal for controlling the display device 100 based on the received user input. The remote control device 300 may output a control signal through a communication method such as infrared communication, RF (Radio Frequency) communication, Bluetooth or UWB (Ultra-Wideband), but communication of the remote control device 300 The method is also not limited to a particular method. The remote control device 300 may be, for example, a remote controller, but is not limited thereto and may be implemented as a smart phone.

When a user command for controlling the display device 100 is received, the display device 100 may determine a rotation direction of the display based on the type of the user command. Here, determining the rotation direction of the display includes determining the rotation direction of the display horizontally, determining the rotation direction of the display vertically, and determining that the rotation direction of the display is maintained. Hereinafter, various embodiments of determining a rotation direction of a display based on a type of a user command will be described.

If the received user command is for controlling the first content being displayed on the display, the display apparatus 100 may determine to maintain the rotation direction of the display. That is, if the received user command is for maintaining the first content being displayed on the display and changing a setting related to the first content, the display apparatus 100 may determine that the rotation direction of the display is maintained. For example, if the received user command is to change the volume setting of the first content or pause playback of the first content, the display apparatus 100 may determine to maintain the rotation direction of the display.

Meanwhile, if the received user command is for displaying the second content on the display, the display apparatus 100 may determine the rotation direction of the display based on the type of the second content. That is, if the received user command is to display second content different from the first content without displaying the first content being displayed on the display, the display device 100 displays the second content based on the type of the second content. You can determine the direction of rotation.

Here, determining the rotation direction of the display based on the type of the second content is whether it is appropriate to display the second content on the display rotated in the horizontal direction or the display rotated in the vertical direction. Can be determined accordingly.

Specifically, the type of the second content is whether the second content is related to broadcast content, DVD content, game content, web page content, e-book content, In addition, it may be determined according to whether or not the content is related to a screen displayed on an external device such as the user terminal 200.

For example, if the second content is broadcast content, the display apparatus 100 may determine the rotation direction of the display as the horizontal direction. Here, the broadcast content may include content received from a server providing an online streaming site, as well as content received from a terrestrial channel, a cable channel, and a satellite channel. As another example, if the second content is web page content, the display apparatus 100 may determine the rotation direction of the display as the vertical direction only when the server providing the web page provides the web page in the mobile mode. .

Meanwhile, the type of the second content may be determined based on various attributes such as an aspect ratio of the second content and a subject providing the second content. For example, if the aspect ratio of the second content is less than 1, that is, if the horizontal length of the second content is shorter than the vertical length, the display apparatus 100 may determine the rotation direction of the display as the vertical direction.

Meanwhile, the description has been made on the premise that the second content is video content, but the second content may be audio content. That is, if a user command for outputting the second content, which is audio content, is received while the first content is displayed on the display, the display apparatus 100 may determine that the rotation direction of the display is maintained.

In the above, the process of determining the rotation direction of the display based on the type of the second content has been described above. The rotation direction of the display corresponding to the type of the second content may be previously stored in the display apparatus 100, It may be updated according to the user's settings.

In addition, the rotation direction of the display corresponding to the type of the second content may be obtained through the learned artificial intelligence model. Specifically, the display device 100 may obtain information on the rotation direction of the display corresponding to the type of the second content by inputting information on the type of the second content into the artificial intelligence model, and the obtained rotation direction The rotation direction of the display can also be determined based on the information on the display.

Meanwhile, when a user command for displaying the second content is received from the remote control device 300 while the first content is displayed on the display, the display device 100 may determine the rotation direction of the display as the horizontal direction. For example, when a channel change command for displaying the second content is received from the remote control device 300 while the first content is displayed on the display rotated in the vertical direction, the display device 100 may determine the rotation direction of the display. Is determined in the horizontal direction, the display is rotated in the determined horizontal direction, and the second content may be displayed on the display rotated in the horizontal direction.

Meanwhile, when a user command for turning on the display device is received from the remote control device 300 while the display device 100 is turned off, the display device 100 determines the rotation direction of the display as the horizontal direction. May be.

Meanwhile, the display apparatus 100 may receive content corresponding to a screen displayed on the user terminal 200 and display the received content on the display. That is, the display device 100 may perform a so-called mirroring process. In addition, when the content corresponding to the screen displayed on the user terminal 200 is displayed on the display by performing the mirroring process, the display device 100 displays the display based on information on the rotation direction of the user terminal 200. You can determine the direction of rotation.

Specifically, when a user command for displaying the second content on the display is received while the first content is displayed on the display, the display device 100 transmits the second content and the user terminal 200 from the user terminal 200. It is possible to receive information about the rotation direction of. And, if the second content is a content corresponding to a screen displayed on the user terminal 200, the display apparatus 100 may determine the rotation direction of the display based on information on the rotation direction of the user terminal 200. . For example, if the rotation direction of the user terminal 200 is a vertical direction, the display device 100 may determine the rotation direction of the display as a vertical direction, and if the rotation direction of the user terminal 200 is a horizontal direction, the display device Reference numeral 100 may determine the rotation direction of the display in the horizontal direction.

However, in the case of performing the above-described mirroring process, the screen displayed on the user terminal 200 is generally transmitted to the display apparatus 100 as a transmission image in the horizontal direction. Therefore, when the rotation direction of the user terminal 200 is in the vertical direction and the user terminal 200 displays content in the vertical direction, the user terminal 200 displays the content corresponding to the screen displayed on the user terminal 200. When the transmission image in the horizontal direction is transmitted to the display apparatus 100 without rotation, the size of the content included in the transmission image is reduced compared to the case where the transmission image in the vertical direction is transmitted. In addition, while the display apparatus 100 displays the received transmission image on a vertical display, the size of the content is enlarged, and in this case, the image included in the content may be deteriorated.

Accordingly, according to an embodiment of the present disclosure, when the rotation direction of the user terminal 200 is a vertical direction, the user terminal 200 displays the content in which the screen displayed on the user terminal 200 is rotated in the horizontal direction. After transmitting to the device 100, the display device 100 may rotate the content rotated in the horizontal direction again in the vertical direction, and display the content rotated in the vertical direction on the display in the vertical direction.

Specifically, when information that the rotation direction of the user terminal 200 is a vertical direction and content in which a screen displayed on the user terminal 200 is rotated in a horizontal direction is received from the user terminal 200, the display device 100 The rotation direction of the display can be determined in the vertical direction. Thereafter, the display apparatus 100 may rotate the display to correspond to the determined vertical direction, process the received content so that the content received on the display is displayed in the vertical direction, and display the processed content on the display. .

Meanwhile, when the communication connection with the user terminal 200 is terminated while performing the above-described mirroring process, the display apparatus 100 may determine the rotation direction of the display as the horizontal direction. In this case, the display apparatus 100 may rotate the display in the horizontal direction so as to correspond to the determined horizontal direction, and further, may display content previously stored in the display apparatus 100 on the display rotated in the horizontal direction.

As described above, when the rotation direction of the display corresponding to the type of user command is determined, the display apparatus 100 controls the display to correspond to the determined rotation direction. Here, controlling the display to correspond to the determined rotation direction means not only rotating the display to correspond to the determined rotation direction when the display is in a state that does not correspond to the determined rotation direction, but also the display corresponding to the determined rotation direction. This includes not rotating the display when in a state.

When the display is controlled to correspond to the determined rotation direction, the display apparatus 100 may display content corresponding to a user command on the display. Specifically, if the user command received while the first content is displayed on the display is for controlling the first content, the display apparatus 100 may maintain the first content displayed on the display. If the user command received while the first content is being displayed on the display is for displaying the second content, the display apparatus 100 may display the second content on the display. For example, when the display is rotated in the horizontal direction according to the determined rotation direction, the display apparatus 100 may display content corresponding to the user command on the display rotated in the horizontal direction.

Meanwhile, a user interaction for inputting a user command according to the present disclosure may be input in various ways. In particular, a user command for controlling the display device 100 may be input through a user's voice. Hereinafter, an embodiment in which a user command corresponding to the received user voice is obtained by performing voice recognition on the received user voice, and the rotation direction of the display is determined based on the type of the obtained user command will be described in detail.

Specifically, the display apparatus 100 may receive a user voice and input the received user voice into the learned artificial intelligence model to obtain a user command corresponding to the received user voice.

Here, the user's voice may be input through the display apparatus 100, and may also be input through the user terminal 200 that is communicatively connected to the display apparatus 100. In addition, voice recognition for the input user voice may be performed through an artificial intelligence model included in the display device 100 or the user terminal 200 in an on-device manner, as well as the display device 100 or the user terminal. It may be performed through an artificial intelligence model included in a server that is connected to communication with 200.

When a user command corresponding to the received user voice is obtained, as described above, the display apparatus 100 may determine a rotation direction of the display based on the type of the user command.

Specifically, when a first user voice is received while the first content is displayed on the display, the display device 100 inputs the received first user voice to the first artificial intelligence model and responds to the received first user voice. It is possible to obtain a user command to be used. In addition, if the acquired user command is for controlling the first content, the display apparatus 100 may determine to maintain the rotation direction of the display. Meanwhile, if the acquired user command is for displaying the second content on the display, the display apparatus 100 may determine the rotation direction of the display based on the type of the second content.

For example, if the second content includes information on a plurality of contents corresponding to the first user command, the display apparatus 100 may determine the rotation direction of the display as the vertical direction. In addition, the display apparatus 100 may rotate the display to correspond to the determined vertical direction, and may display the second content on the display rotated in the vertical direction.

As described above, when a second user voice is received while the second content is displayed on the display rotated in the vertical direction, the display device 100 inputs the received second user voice to the first artificial intelligence model and receives the received voice. A second user command corresponding to the second user's voice may be obtained. In addition, if the obtained second user command is to display one image content among a plurality of contents on the display, the display apparatus 100 may determine the rotation direction of the display as the horizontal direction.

According to various embodiments of the present disclosure as described above, the display device 100 provides various contents as a visual experience greater than that of the user terminal 200, and at the same time, sets the type of user command for controlling the display device 100. By rotating the display on the basis of the user's various content viewing experiences, it is possible to provide content through the rotated display.

More various embodiments according to the present disclosure will be described below with reference to FIGS. 2 to 13.

2 is a block diagram schematically illustrating a configuration of a display device 100 according to an exemplary embodiment of the present disclosure.

As shown in FIG. 2, the display device 100 according to the exemplary embodiment of the present disclosure includes a display 110, a motor 120, a memory 130, and a processor 140.

The display 110 may output image data under the control of the processor 140. Specifically, the display 110 may output an image previously stored in the memory 130 under the control of the processor 140. In particular, the display 110 may display a user interface stored in the memory 130.

The display 110 may be implemented as a Liquid Crystal Display Panel (LCD), Organic Light Emitting Diodes (OLED), and the like, and the display 110 may be implemented as a flexible display 110 or a transparent display 110 depending on the case. It is also possible to become. However, the display 110 according to the present disclosure is not limited to a specific type.

In particular, in various embodiments according to the present disclosure, the display device 100 may perform a so-called pivot function. Specifically, the display 110 may be rotated to be placed in a horizontal direction or a vertical direction. Hereinafter, in describing the present disclosure, that the display 110 is pivoted to be placed in a horizontal direction or a vertical direction is simply expressed as being rotated in a horizontal direction or a vertical direction. Meanwhile, the display 110 may not only be rotated manually by a user, but also may be rotated automatically by controlling the motor 120 for rotating the display 110 by the processor 140.

The motor 120 rotates the display 110. Specifically, the motor 120 is connected to the display 110 and is driven by the control of the processor 140 to rotate the display 110 connected to the motor 120 in a clockwise or counterclockwise direction. And, accordingly, the display 110 may be rotated in a horizontal direction or a vertical direction. The motor 120 may be implemented with various motors such as a direct current electric motor (DC motor), an alternating current electric motor (AC motor), and a brushless DC electric motor (BLDC) motor.

At least one command related to the display device 100 may be stored in the memory 130. In addition, an operating system (O/S) for driving the display device 100 may be stored in the memory 130. In addition, various software programs or applications for operating the display device 100 may be stored in the memory 130 according to various embodiments of the present disclosure. Further, the memory 130 may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

Specifically, the memory 130 may store various software modules for operating the display device 100 according to various embodiments of the present disclosure, and the processor 140 executes various software modules stored in the memory 130. Thus, the operation of the display device 100 can be controlled. That is, the memory 130 is accessed by the processor 140, and data read/write/edit/delete/update by the processor 140 may be performed.

Meanwhile, in the present disclosure, the term memory 130 is a memory 130, a ROM (not shown) in the processor 140, a RAM (not shown), or a memory card (not shown) mounted in the display device 100 (e.g. For example, it can be used to include micro SD card, memory stick).

In particular, in various embodiments of the present disclosure, information on a rotation direction of the display 110 corresponding to a type of content displayed according to a user command may be stored in the memory 130. In addition, the memory 130 may store content received from an external device such as the user terminal 200 or a broadcast receiving device. In addition, various information necessary within the range for achieving the object of the present disclosure may be stored in the memory 130, and the information stored in the memory 130 may be updated as it is received from a server or an external device or input by a user. May be.

The processor 140 controls the overall operation of the display device 100. Specifically, the processor 140 is connected to the configuration of the display device 100 including the display 110, the motor 120, and the memory 130 as described above, and stored in the memory 130 as described above. By executing at least one command, the overall operation of the display apparatus 100 may be controlled.

The processor 140 can be implemented in various ways. For example, the processor 140 is an Application Specific Integrated Circuit (ASIC), an embedded processor, a microprocessor, a hardware control logic, a hardware finite state machine (FSM), a digital signal processor (Digital Signal Processor). Processor, DSP) can be implemented in at least one. Meanwhile, in the present disclosure, the term processor 140 may be used to mean including a central processing unit (CPU), a graphical processing unit (GPU), and a main processing unit (MPU).

In particular, in various embodiments according to the present disclosure, the processor 140 may rotate the display 110 and display content on the rotated display 110. Hereinafter, the control of the processor 140 Various embodiments of the present disclosure will be described in detail.

The processor 140 receives a user command for controlling the display device 100. Specifically, the processor 140 may receive a user command through the user terminal 200 communicatively connected with the display device 100 through the communication unit 150, and control the display device 100 through the communication unit 150 It is also possible to receive a user command through the remote control device 300 for doing so.

As described above, the user terminal 200 refers to a device capable of communicating with the display device 100 and transmitting control signals and image content to the display device 100, and the remote control device 300 is a display device. Refers to a device capable of receiving a user input for controlling the device 100 and outputting a control signal for controlling the display device 100 based on the received user input.

When a user command for controlling the display apparatus 100 is received, the processor 140 may determine a rotation direction of the display based on the type of the user command. Here, determining the rotation direction of the display includes determining the rotation direction of the display horizontally, determining the rotation direction of the display vertically, and determining that the rotation direction of the display is maintained. Hereinafter, various embodiments of determining a rotation direction of a display based on a type of a user command will be described.

If the received user command is for controlling the first content being displayed on the display, the processor 140 may determine to maintain the rotation direction of the display. That is, if the received user command is for maintaining the first content being displayed on the display and changing a setting related to the first content, the processor 140 may determine to maintain the rotation direction of the display. For example, if the received user command is to change the volume setting of the first content or pause playback of the first content, the processor 140 may determine to maintain the rotation direction of the display.

Meanwhile, if the received user command is for displaying the second content on the display, the processor 140 may determine the rotation direction of the display based on the type of the second content. That is, if the received user command is for displaying the second content different from the first content without displaying the first content being displayed on the display, the processor 140 The direction of rotation can be determined.

Here, determining the rotation direction of the display based on the type of the second content is whether it is appropriate to display the second content on the display rotated in the horizontal direction or the display rotated in the vertical direction. Can be determined accordingly.

Specifically, the type of the second content is whether the second content is related to broadcast content, DVD content, game content, web page content, e-book content, In addition, it may be determined according to whether or not the content is related to a screen displayed on an external device such as the user terminal 200.

For example, if the second content is broadcast content, the processor 140 may determine the rotation direction of the display as the horizontal direction. Here, the broadcast content may include content received from a server providing an online streaming site, as well as content received from a terrestrial channel, a cable channel, and a satellite channel. As another example, if the second content is web page content, the processor 140 may determine the rotation direction of the display as the vertical direction only when the server providing the web page provides the web page in the mobile mode.

Meanwhile, the type of the second content may be determined based on various attributes such as an aspect ratio of the second content and a subject providing the second content. For example, if the aspect ratio of the second content is less than 1, that is, the horizontal length of the second content is shorter than the vertical length, the processor 140 may determine the rotation direction of the display as the vertical direction.

Meanwhile, the description has been made on the premise that the second content is video content, but the second content may be audio content. That is, if a user command for outputting the second content, which is audio content, is received while the first content is displayed on the display, the processor 140 may determine to maintain the rotation direction of the display.

In the above, the process of determining the rotation direction of the display based on the type of the second content has been described above. The rotation direction of the display corresponding to the type of the second content may be previously stored in the memory 130 and the user It may be updated according to the settings of.

In addition, the rotation direction of the display corresponding to the type of the second content may be obtained through the learned artificial intelligence model. Specifically, the processor 140 may obtain information on the rotation direction of the display corresponding to the type of the second content by inputting information on the type of the second content into the artificial intelligence model, and the obtained rotation direction The rotation direction of the display can also be determined based on the information.

Specifically, the artificial intelligence model according to the present disclosure may include at least one artificial neural network, and may be learned by deep learning. Specifically, artificial intelligence models are among deep neural networks (DNN), convolution neural networks (CNN), recurrent neural networks (RNNs), and generative adversarial networks (GANs). It may include at least one artificial neural network.

Meanwhile, when a user command for displaying the second content is received from the remote control device 300 while the first content is displayed on the display, the processor 140 may determine the rotation direction of the display as the horizontal direction. For example, when a channel change command for displaying the second content is received from the remote control device 300 while the first content is displayed on the display rotated in the vertical direction, the processor 140 determines the rotation direction of the display. It is possible to determine in the horizontal direction, rotate the display in the determined horizontal direction, and display the second content on the display rotated in the horizontal direction.

Meanwhile, when a user command for turning on the display device is received from the remote control device 300 while the display device 100 is turned off, the display device 100 determines the rotation direction of the display as the horizontal direction. May be. Meanwhile, the processor 140 may receive content corresponding to a screen displayed on the user terminal 200 and display the received content on the display 110. That is, the display device 100 may perform a so-called mirroring process. In addition, when the content corresponding to the screen displayed on the user terminal 200 is displayed on the display by performing the mirroring process, the processor 140 The direction of rotation can be determined.

Specifically, when a user command for displaying the second content on the display is received while the first content is displayed on the display, the processor 140 transmits the second content and the user terminal 200 from the user terminal 200. Information about the direction of rotation can be received. In addition, if the second content is content corresponding to a screen displayed on the user terminal 200, the processor 140 may determine the rotation direction of the display based on information on the rotation direction of the user terminal 200. For example, if the rotation direction of the user terminal 200 is a vertical direction, the processor 140 may determine the rotation direction of the display as a vertical direction, and if the rotation direction of the user terminal 200 is a horizontal direction, the processor 140 ) May determine the rotation direction of the display in the horizontal direction.

However, in the case of performing the above-described mirroring process, the screen displayed on the user terminal 200 is generally transmitted to the display apparatus 100 as a transmission image in the horizontal direction. Therefore, when the rotation direction of the user terminal 200 is in the vertical direction and the user terminal 200 displays content in the vertical direction, the user terminal 200 displays the content corresponding to the screen displayed on the user terminal 200. When the transmission image in the horizontal direction is transmitted to the display apparatus 100 without rotation, the size of the content included in the transmission image is reduced compared to the case where the transmission image in the vertical direction is transmitted. In addition, the processor 140 enlarges the size of the content in the process of displaying the received transmission image on the display 110 in the vertical direction. Therefore, in this case, the image may be deteriorated.

Accordingly, according to an embodiment of the present disclosure, when the rotation direction of the user terminal 200 is a vertical direction, the user terminal 200 displays the content in which the screen displayed on the user terminal 200 is rotated in the horizontal direction. Transmission to the device 100, the processor 140 rotates the content rotated in the horizontal direction again in the vertical direction, and controls the display 110 to display the content rotated in the vertical direction on the display 110 in the vertical direction can do.

Specifically, when information indicating that the rotation direction of the user terminal 200 is a vertical direction and content in which a screen displayed on the user terminal 200 is rotated in the horizontal direction is received from the user terminal 200, the processor 140 displays The rotation direction of 110 may be determined in the vertical direction. Thereafter, the processor 140 rotates the display 110 to correspond to the determined vertical direction, processes the received content so that the content received on the display 110 is displayed in the vertical direction, and Processed content can be displayed.

Meanwhile, in the above, the embodiment of determining the rotation direction of the display 110 based on information on the rotation direction of the user terminal 200 while performing the mirroring process has been described, but the processor 140 Regardless of the rotation direction of ), the rotation direction of the display 110 may be determined based on the attribute of the content displayed on the user terminal 200.

For example, when content corresponding to a screen displayed on the user terminal 200 is received from the user terminal 200, the processor 140 may identify whether a black area exists on the left and right of the received content. . In addition, the processor 140 may determine the rotation direction of the display 110 in the horizontal direction when there are no black areas on the left and right of the received content. On the other hand, if there are black areas on the left and right of the received content, the processor 140 may determine the rotation direction of the display 110 in the vertical direction.

Meanwhile, in the above, an embodiment in which the display apparatus 100 is connected to the user terminal 200 in communication and when the content corresponding to the screen displayed on the user terminal 200 is received and displayed has been described above. According to an embodiment of the present disclosure, when the communication connection between the display apparatus 100 and the user terminal 200 is terminated, the processor 140 displays the display based on information indicating that the communication connection with the user terminal 200 is terminated. It is also possible to determine the rotation direction of (110).

Specifically, when the communication connection between the display device 100 and the user terminal 200 is terminated while performing the mirroring process as described above, the processor 140 may determine the rotation direction of the display 110 as the horizontal direction. have. In this case, the processor 140 may rotate the display 110 in the horizontal direction so as to correspond to the determined horizontal direction, and further display the content previously stored in the memory 130 on the display 110 rotated in the horizontal direction. .

In particular, when a user performs an initial setting of the display device 100 according to the present disclosure, that is, an Out-of-Box Experience (OOBE), the OOBE will be started through the user terminal 200 that is communicatively connected with the display device 100. I can. Further, the processor 140 rotates the display 110 of the display device 100 in a horizontal direction or a vertical direction according to the type of screen for OOBE progress, and displays a screen for OOBE progress on the rotated display 110. Can be displayed. On the other hand, when an error occurs while OOBE is being performed through the user terminal 200, the processor 140 rotates the display 110 of the display device 100 in the horizontal direction to proceed with the OOBE through the display 110. And, a screen for OOBE progress may be displayed on the rotated display 110.

Meanwhile, in the above, the case where the processor 140 receives and displays the content corresponding to the screen displayed on the user terminal 200 has been described above, but according to an embodiment of the present disclosure, the processor 140 Content corresponding to a part of the screen displayed on 200 may be received and displayed. That is, when the user terminal 200 displays a plurality of contents in each of a plurality of areas divided by a multi-screen, the processor 140 receives and displays one of the plurality of contents displayed in the plurality of areas. In this case, various embodiments according to the present disclosure may be applied.

On the other hand, such as when the rotation angle of the user terminal 200 is not large or when the rotation direction of the user terminal 200 is rapidly repeatedly changed, information on the rotation direction of the user terminal 200 is reflected in real time. When the display device 100 is rotated, there may be a case against the intention of the user.

Therefore, according to an embodiment of the present disclosure, the processor 140 maintains the rotation direction of the user terminal 200 for a predetermined time based on information on the rotation direction of the user terminal 200 received for a predetermined time or longer. Is determined, and the rotation direction of the display 110 is determined based on information on the rotation direction of the user terminal 200 only when it is determined that the rotation direction of the user terminal 200 is maintained for a certain period of time By doing so, it is possible to prevent rotation of the display device 100 contrary to the intention of the user.

As described above, when the rotation direction of the display 110 corresponding to the type of user command is determined, the processor 140 controls the motor 120 so that the display 110 corresponds to the determined rotation direction. Here, controlling the motor 120 so that the display 110 corresponds to the determined rotation direction means that when the display 110 is in a state that does not correspond to the determined rotation direction, the display 110 is rotated to correspond to the determined rotation direction. In addition to making the display 110 in a state corresponding to the determined rotation direction, it includes not rotating the display 110.

When the display 110 is controlled to correspond to the determined rotation direction, the processor 140 may display content corresponding to a user command on the display 110. Specifically, if the user command received while the first content is displayed on the display is for controlling the first content, the processor 140 may maintain the first content displayed on the display. If the user command received while the first content is displayed on the display is to display the second content, the processor 140 may display the second content on the display. For example, when the display 110 is rotated in the horizontal direction to correspond to the determined rotation direction, the processor 140 may display content corresponding to the user command on the display 110 rotated in the horizontal direction.

3 is a block diagram illustrating in detail the configuration of the display device 100 according to an exemplary embodiment of the present disclosure.

As shown in FIG. 3, the display device 100 according to an embodiment of the present disclosure includes not only the display 110, the motor 120, the memory 130, and the processor 140, but also the communication unit 150, the speaker. It may further include 170 and a microphone 160. However, such a configuration is exemplary, and it is obvious that a new configuration may be added or some configurations may be omitted in addition to the above configuration in implementing the present disclosure. Since the display 110, the motor 120, the memory 130, and the processor 140 have been described above with reference to FIG. 2, the communication unit 150, the speaker 170, and the microphone 160 will be described in detail below.

The communication unit 150 includes a circuit and may communicate with a server or an external device. Specifically, the processor 140 may receive various data or information from a server or an external device connected through the communication unit 150, and may transmit various data or information to the server or an external device.

The communication unit 150 may include at least one of a WiFi module 151, a Bluetooth module 152, a wireless communication module 153, and an NFC module 154 and an IR communication module 155. Specifically, each of the WiFi module 151 and the Bluetooth module may perform communication using a WiFi method and a Bluetooth method. In the case of using the WiFi module 151 or the Bluetooth module 152, various types of connection information such as SSID may be first transmitted and received, and various types of information may be transmitted/received after communication connection using the same.

In addition, the wireless communication module 153 may perform communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), and 5th Generation (5G). I can. In addition, the NFC module 154 can perform communication in a Near Field Communication (NFC) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz. have.

In addition, the IR communication module 155 may include an IR receiving module and an IR transmitting module. The IR receiving module may receive an infrared signal output from the outside of the display device 100, and may include an infrared phototransistor for receiving infrared rays and an infrared light receiving module for demodulating the modulated infrared signal. . The IR transmission module may output an infrared signal to the outside of the display apparatus 100 and may include an infrared rays emitting diode (IRD) for generating an infrared signal.

In particular, in various embodiments according to the present disclosure, the processor 140 may receive a user command from the user terminal 200 through the communication unit 150, and from the remote control device 300 through the communication unit 150 Can receive user commands. In addition, the processor 140 transmits various information such as content corresponding to the screen displayed on the user terminal 200 from the user terminal 200 through the communication unit 150 and information on the rotation direction of the user terminal 200. Can receive.

The speaker 170 may output audio data under the control of the processor 140, and the indicator may be lit under the control of the processor 140. In particular, in various embodiments of the present disclosure, the speaker 170 may output audio content provided according to a user command.

The microphone 160 may receive an audio signal and the microphone 160 may receive an audio signal, and may convert the received audio signal into an electric signal. In particular, in various embodiments according to the present disclosure, a user command for controlling the display device 100 may be input through the microphone 160. Hereinafter, an embodiment in which a user command corresponding to the received user voice is obtained by performing voice recognition on the received user voice, and the rotation direction of the display 110 is determined based on the type of the obtained user command will be described. do.

Specifically, the processor 140 may receive a user voice through the microphone 160 and perform voice recognition on the received user voice to obtain a user command corresponding to the received user voice. More specifically, the processor 140 may receive a user voice through the microphone 160 and input the received user voice into the learned artificial intelligence model to obtain a user command corresponding to the received user voice. In addition, when a user command corresponding to the received user voice is obtained, as described above, the processor 140 may determine the rotation direction of the display 110 based on the type of the user command.

A process of controlling the display apparatus 100 according to the present disclosure based on a user command according to a user's voice will be described below with reference to FIGS. 4 and 5.

Meanwhile, a speech recognition process of acquiring a user command corresponding to the received user voice may be performed through a learned artificial intelligence model. The artificial intelligence model according to the present disclosure includes at least one artificial neural network, and may be trained by deep learning. Specifically, artificial intelligence models are among deep neural networks (DNN), convolution neural networks (CNN), recurrent neural networks (RNNs), and generative adversarial networks (GANs). It may include at least one artificial neural network.

However, the specific artificial neural network model included in the artificial intelligence model according to the present disclosure is not limited to the above-described example. The speech recognition process and artificial intelligence model according to the present disclosure will be described in detail with reference to FIGS. 12 and 13.

4 and 5 are views for explaining in detail a process of controlling the display apparatus 100 according to the present disclosure based on a user command according to a user's voice.

The user command according to the present disclosure may be obtained based on the received user voice. Specifically, the display apparatus 100 may receive a user voice and input the received user voice into the learned artificial intelligence model to obtain a user command corresponding to the received user voice.

Here, the user's voice may be input through the display apparatus 100, and may also be input through the user terminal 200 that is communicatively connected to the display apparatus 100. In addition, voice recognition for the input user voice may be performed through an artificial intelligence model included in the display device 100 or the user terminal 200 in an on-device manner, as well as the display device 100 or the user terminal. It may be performed through an artificial intelligence model included in a server that is connected to communication with 200.

When a user command corresponding to the received user voice is obtained, the display apparatus 100 may determine a rotation direction of the display based on the type of the user command.

Specifically, when a user voice is received while the first content is displayed on the display, the display apparatus 100 may input the received user voice to the artificial intelligence model to obtain a user command corresponding to the received user voice. . In addition, if the acquired user command is for controlling the first content, the display apparatus 100 may determine to maintain the rotation direction of the display. Meanwhile, if the acquired user command is for displaying the second content on the display, the display apparatus 100 may determine the rotation direction of the display based on the type of the second content.

According to an embodiment of the present disclosure, the display apparatus 100 may determine a rotation direction of the display according to whether a user command corresponding to a user's voice is for outputting audio content or displaying image content.

Specifically, if the user command corresponding to the user's voice is related to outputting audio content, the display apparatus 100 may determine to maintain the rotation direction of the display. Thereafter, the display apparatus 100 controls the display to correspond to the determined rotation direction, and may output audio content corresponding to a user command. While audio content is being output, the display apparatus 100 may maintain image content being displayed on the display or may display an image indicating that audio content is being output.

For example, as shown in FIG. 4, when a user voice such as "What is this year's A Film Festival award-winning work?" is received, the display device 100 does not change the rotation direction of the display, and "It is Love". It is possible to output the same audio content.

Meanwhile, if the user command corresponding to the user's voice is for displaying image content, the display apparatus 100 may determine the rotation direction of the display as the horizontal direction. Thereafter, the display apparatus 100 controls the display to correspond to the determined rotation direction, and may display image content corresponding to the user command on the display.

For example, as shown in FIG. 4, when a user voice such as "Show me more related information" is received, the display device 100 rotates the display horizontally and responds to a user command on the rotated display. Corresponding video content can be displayed.

According to an embodiment of the present disclosure, the display apparatus 100 determines the rotation direction of the display according to whether a user command corresponding to a user's voice is for displaying a search result for a plurality of contents or an image content. You can decide.

Specifically, if the first user command corresponding to the first user's voice is for displaying a search result for a plurality of contents, the display apparatus 100 may determine the rotation direction of the display as the vertical direction. Thereafter, the display apparatus 100 controls the display to correspond to the determined rotation direction, and may display content corresponding to the user command on the display.

For example, as illustrated in FIG. 5, when a user voice such as "Show me the song list of group ABC" is received, the display device 100 rotates the display in the vertical direction, Search results for a plurality of contents according to the first user command may be displayed on the display rotated in the vertical direction.

As described above, when a second user voice is received while the second content is displayed on the display rotated in the vertical direction, the display device 100 inputs the received second user voice to the first artificial intelligence model and receives the received voice. A second user command corresponding to the second user's voice may be obtained. And, if the acquired second user command is for displaying one image content on the display among a plurality of contents displayed according to the first user command, the display apparatus 100 may determine the rotation direction of the display as the horizontal direction. . Thereafter, the display apparatus 100 controls the display to correspond to the determined horizontal direction, and may display content corresponding to the second user command on the display.

For example, as shown in FIG. 5, when a user voice such as "Play LOVE music video" is received, the display device 100 rotates the display horizontally, Image content corresponding to the second user command may be displayed on the display rotated in the direction.

In addition, the display apparatus 100 may determine the rotation direction of the display based on types of user commands corresponding to various user voices, and the present disclosure is not limited to the above-described examples.

6 is a block diagram schematically showing a configuration of a user terminal 200 according to an embodiment of the present disclosure, and FIG. 7 is a display device according to the present disclosure based on information on a rotation direction of the user terminal 200 ( 100) is a diagram for explaining in detail the process of controlling.

As shown in FIG. 6, the user terminal 200 according to an embodiment of the present disclosure may include a communication unit 210, a display 220, a sensor 230, a memory 240, and a processor 250. have. However, such a configuration is exemplary, and it is obvious that a new configuration may be added or some configurations may be omitted in addition to the above configuration in implementing the present disclosure.

The communication unit 210 includes a circuit and may communicate with a server or an external device. Specifically, the processor 250 may receive various data or information from a server or an external device connected through the communication unit 210, and may transmit various data or information to the server or an external device. The communication unit 210 may include at least one of a WiFi module, a Bluetooth module, a wireless communication module, and an NFC module.

In particular, in various embodiments according to the present disclosure, the processor 250 transmits content corresponding to a screen displayed on the user terminal 200 and information on the rotation direction of the user terminal 200 to the display device 100. It is possible to control the communication unit 210 to transmit.

The display 220 may output image data under the control of the processor 250. Specifically, the display 220 may output an image previously stored in the memory 240 under the control of the processor 250. In particular, the display 220 may display a user interface stored in the memory 240.

The display 220 may be implemented as a Liquid Crystal Display Panel (LCD), Organic Light Emitting Diodes (OLED), or the like, and the display 220 may be implemented as a flexible display or a transparent display, depending on the case. However, the display 220 according to the present disclosure is not limited to a specific type.

In particular, according to various embodiments of the present disclosure, the display 220 may display various user interfaces through which a user command for controlling the display device 100 that is communicatively connected with the user terminal 200 can be input.

The sensor 230 may include at least one of an acceleration sensor and a gyro sensor. The acceleration sensor is a sensor capable of measuring the acceleration of the display device 100 and is also referred to as an accelerometer. The gyro sensor is a sensor capable of measuring angular velocity, and is also referred to as a gyroscope.

In particular, in various embodiments according to the present disclosure, the processor 250 may obtain information about the rotation direction of the user terminal 200 through the sensor 230. That is, the processor 250 may obtain information on whether the user terminal 200 is rotated in the horizontal direction or the vertical direction through the sensor 230.

At least one command related to the user terminal 200 may be stored in the memory 240. In addition, an O/S (Operating System) for driving the user terminal 200 may be stored in the memory 240. In addition, the memory 240 may store various software programs or applications for operating the user terminal 200 according to various embodiments of the present disclosure. Further, the memory 240 may include a semiconductor memory such as a flash memory or a magnetic storage medium such as a hard disk.

Specifically, the memory 240 may store various software modules for operating the user terminal 200 according to various embodiments of the present disclosure, and the processor 250 executes various software modules stored in the memory 240 Thus, the operation of the user terminal 200 can be controlled. That is, the memory 240 is accessed by the processor 250, and data read/write/edit/delete/update by the processor 250 may be performed.

Meanwhile, in the present disclosure, the term memory 240 refers to a memory 240, a ROM (not shown) in the processor 250, a RAM (not shown), or a memory card (not shown) mounted in the display device 100 (eg For example, it can be used to include micro SD card, memory stick).

In particular, in various embodiments according to the present disclosure, information on content corresponding to a screen displayed on the user terminal 200 and information on a rotation direction of the user terminal 200 may be stored in the memory 240. I can. In addition, various user interfaces through which a user command for controlling the user terminal 200 may be input may be stored in the memory 240.

The processor 250 controls the overall operation of the user terminal 200. Specifically, the processor 250 is connected to the configuration of the user terminal 200 including the communication unit 210, the display 220, the sensor 230 and the memory 240 as described above, the memory as described above. By executing at least one command stored in 240, the overall operation of the user terminal 200 may be controlled.

The processor 250 can be implemented in various ways. For example, the processor 250 is an Application Specific Integrated Circuit (ASIC), an embedded processor, a microprocessor, a hardware control logic, a hardware finite state machine (FSM), a digital signal processor (Digital Signal Processor). Processor, DSP) can be implemented in at least one. Meanwhile, in the present disclosure, the term processor 250 may be used to mean including a central processing unit (CPU), a graphical processing unit (GPU), and a main processing unit (MPU).

In particular, the processor 250 transmits the content corresponding to the screen displayed on the display 220 of the user terminal 200 to the display device 100, and displays it on the display 220 of the user terminal 200. The content corresponding to the screen being displayed may be displayed on the display 110 of the display device 100, which is referred to as mirroring.

However, when performing the mirroring process, a screen displayed on the display 220 of the user terminal 200 is generally transmitted to the display apparatus 100 as a transmission image in a horizontal direction. Accordingly, as shown in FIG. 7, when the rotation direction of the user terminal 200 is in the vertical direction and the user terminal 200 displays content in the vertical direction, the user terminal 200 is displayed on the user terminal 200. When the content corresponding to the screen displayed on the screen 220 is transmitted to the display device 100 as a transmission image 71 in the horizontal direction without rotating, compared to the case where the content is transmitted as a transmission image 72 in the vertical direction, The size of the content included in the transmitted image is reduced. In addition, the display apparatus 100 enlarges the size of the content in the process of displaying the received transmission image 71 on the display 110 in the vertical direction, and in this case, the image included in the content may be deteriorated. .

Accordingly, according to an embodiment of the present disclosure, when the rotation direction of the user terminal 200 is in the vertical direction, the processor 250 may display a screen displayed on the display 220 of the user terminal 200 in the horizontal direction. The rotated content 72 is transmitted to the display device 100, and the display device 100 rotates the content rotated in the horizontal direction again in the vertical direction, and the content rotated in the vertical direction is displayed in the vertical direction. Can be marked on.

Specifically, when the rotation direction of the user terminal 200 is a vertical direction, the processor 250 is displayed on the display 220 of the user terminal 200 and information that the rotation direction of the user terminal 200 is a vertical direction. Contents in which the existing screen is rotated in the horizontal direction may be transmitted to the display device 100.

More specifically, when a user command for transmitting the content corresponding to the screen displayed on the display 220 of the user terminal 200 to the display device 100 is input, the processor 250 sends the communication unit 210 Through the communication connection with the display device 100 may be performed. And, when information that the rotation direction of the user terminal 200 is the vertical direction is obtained through the sensor 230, the processor 250 obtains the content in which the screen displayed on the display 220 is rotated in the horizontal direction. , The communication unit 210 may be controlled to transmit information that the rotation direction of the user terminal 200 is a vertical direction and the acquired content to the display apparatus 100 connected to the user terminal 200.

On the other hand, such as when the rotation angle of the user terminal 200 is not large or when the rotation direction of the user terminal 200 is rapidly repeatedly changed, information on the rotation direction of the user terminal 200 is reflected in real time. When the display device 100 is rotated, there may be a case against the intention of the user.

Accordingly, according to an embodiment of the present disclosure, the processor 250 displays information on the rotation direction of the user terminal 200 only when the user terminal 200 is maintained at a predetermined angle or more for a predetermined time or longer. By transmitting to 100), it is possible to prevent rotation of the display device 100 contrary to the intention of the user.

Meanwhile, while the above-described mirroring process is performed, a guide message informing that a phone call, a text message, or an e-mail has been received may be received to the user terminal 200. In this case, the user terminal 200 displays a message inquiring whether to output information about the received phone call, text message, or email through the display device 100, and receives a call or text message according to the user's selection. Content for a message or email may be displayed on the display device 100. Meanwhile, when content for a phone call, a text message, or an email is displayed on the display device 100, whether to rotate the display included in the display device 100 may be determined according to various embodiments as described above.

Meanwhile, the control process of the processor 250 as described above can be applied to the control method of the user terminal 200 as well. Specifically, the control method of the user terminal 200 is, when a user command for transmitting the content corresponding to the screen displayed on the display 220 of the user terminal 200 to the display device is input, the display device 100 Performing a communication connection with the user terminal 200, when information that the rotation direction of the user terminal 200 is the vertical direction is obtained, acquiring content in which the screen displayed on the display 220 is rotated in the horizontal direction, and the user terminal ( And transmitting information indicating that the rotation direction of 200) is a vertical direction and the obtained content to the display apparatus 100 connected to the user terminal 200.

Meanwhile, the control method of the user terminal 200 as described above may be implemented as a program and provided to the display device. In particular, a program including a method of controlling the user terminal 200 may be stored and provided in a non-transitory computer readable medium.

Specifically, in a computer-readable recording medium including a program for executing the control method of the user terminal 200, the control method of the user terminal 200 is displayed on the display 220 of the user terminal 200. When a user command for transmitting content corresponding to the screen to the display device is input, performing a communication connection with the display device 100, and when information indicating that the rotation direction of the user terminal 200 is a vertical direction is obtained, the display ( 220) Acquiring content in which the screen displayed on the screen is rotated in the horizontal direction, and information that the rotation direction of the user terminal 200 is in the vertical direction, and the obtained content, the display device 100 connected to the user terminal 200 And transferring to.

Here, the non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short moment, such as a register, cache, and memory. Specifically, the above-described various applications or programs may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, and ROM.

8A and 8B are diagrams illustrating a user interface of a user terminal 200 according to an embodiment of the present disclosure.

In the above, the embodiment of determining the rotation direction of the display included in the display device 100 based on information on the rotation direction of the user terminal 200 has been described above, but rotating the display of the display device 100 The user command for may be directly input through the user terminal 200, and the display of the display apparatus 100 may be rotated accordingly.

Specifically, according to an embodiment of the present disclosure, the user terminal 200 in communication with the display device 100 may display a user interface for receiving an input of a user command for rotating the display of the display device 100. . In addition, when a user command for rotating the display of the display device 100 is input through the user interface, the user terminal 200 may transmit a control signal corresponding to the user command for rotating the display to the display device 100. have.

Specifically, as shown in FIG. 8A, the user interface of the user terminal 200 may include a soft button 81 for receiving a user command for rotating the display of the display device 100. In addition, as shown in FIG. 8B, the user interface of the user terminal 200 includes an icon 82 for receiving a user command for rotating the display of the display device 100, and on the display of the display device 100. An icon 83 for expanding or reducing the displayed content and an icon 84 for terminating a communication connection with the display device 100 may be included. In addition, it goes without saying that the user interface of the user terminal 200 may include various types of icons for controlling the display device 100.

8C and 8D are diagrams for explaining a process of expanding or reducing content displayed on the display device 100 through the user terminal 200 and displaying the content.

As described above, the display apparatus 100 may receive content corresponding to a screen displayed on the user terminal 200 and display the received content on the display. That is, the display device 100 may perform a so-called mirroring process. In addition, when the content corresponding to the screen displayed on the user terminal 200 is displayed on the display by performing the mirroring process, the display device 100 displays the display based on information on the rotation direction of the user terminal 200. You can determine the direction of rotation.

Meanwhile, as described above with reference to FIGS. 8A and 8B, the user terminal 200 may display a user interface for receiving a user command for rotating the display of the display device 100. Accordingly, according to an embodiment of the present disclosure, when the content corresponding to the screen displayed on the user terminal 200 is displayed on the display by performing the mirroring process, the display device 100 A user command for rotating the display may be received from the user terminal 200, and the display of the display apparatus 100 may be rotated based on the received user command.

In FIG. 8C, the rotation direction of the user terminal 200 is a vertical direction, but the rotation direction of the display device 100 is a horizontal direction. This is a user command for rotating the display horizontally during the mirroring process. 200), and accordingly, the display of the display apparatus 100 is rotated.

When the above-described mirroring process is performed, as shown in the first screen 810 of FIG. 8C, the display device 100 receives the content corresponding to the screen displayed on the user terminal 200 and receives the received content. Contents may be displayed on the display of the display device 100.

When a user command for enlarging content displayed on the display of the display device 100 is received from the user terminal 200, as shown in the second screen 820 of FIG. 8C, the display device 100 displays Contents displayed on the screen can be enlarged and displayed. In this case, an area to be enlarged and an enlargement ratio of the content may be determined differently according to the user's selection.

When a user command for displaying the image content 85 in full screen among contents displayed on the display of the display device 100 is received from the user terminal 200, as shown in the third screen 830 of FIG. 8C Likewise, the display apparatus 100 may enlarge the content displayed on the display and display the image content in full screen.

Meanwhile, FIG. 8D shows content displayed on the display device 100 through the user terminal 200 when the rotation direction of the user terminal 200 is a vertical direction and the rotation direction of the display device 100 is also a vertical direction. A diagram for explaining a process of expanding or reducing the display.

When the above-described mirroring process is performed, as shown in the first screen 840 of FIG. 8D, the content corresponding to the screen displayed on the user terminal 200 will be displayed on the display of the display device 100. I can. In this case, the notification bar 86 and the left and right black areas 87 may be displayed together on the display of the display apparatus 100. Here, the left and right black areas 87 are due to a difference in aspect ratio between the display of the user terminal 200 and the display of the display apparatus 100.

When a user command for enlarging the content displayed on the display of the display device 100 is received from the user terminal 200, the display device 100 may enlarge and display the content displayed on the display. In this case, as shown in the second screen 850 of FIG. 8D, the display device may enlarge and display the content so that the notification bar 86 and the left and right black areas 87 as described above are not displayed.

Meanwhile, although not specifically shown in FIG. 8D, as in the case of FIG. 8C, even when the display of the display device 100 performs a mirroring function while the display is rotated in the vertical direction, among contents displayed on the display A user command for displaying the image content in full screen may be input.

When a user command for displaying the image content in full screen among the contents displayed on the display of the display device 100 is received from the user terminal 200, the display device 100 will be displayed in full screen according to the user command. The display of the display device can be rotated based on the aspect ratio of the image content.

Specifically, if a user command for displaying video content in full screen among content displayed on the display is received from the user terminal 200 and the aspect ratio of the video content to be displayed in full screen is greater than 1, the display device 100 ) May be rotated in the horizontal direction, and image content may be displayed in full screen on the display rotated in the horizontal direction.

Meanwhile, in the above, only the case of expanding and displaying the content displayed on the display of the display device 100 has been described. Conversely, the content displayed on the display of the display device 100 may be reduced and displayed. Specifically, when a user command for reducing content displayed on the display of the display device 100 is received from the user terminal 200, as shown in the third screen 860 of FIG. 8D, the display device 100 ) May reduce and display the content displayed on the display. Similar to a case of expanding and displaying content, an area to be reduced among areas in which content is displayed, and a reduction ratio of the content may be differently determined according to a user's selection.

9 is a diagram illustrating a remote control device 300 according to an embodiment of the present disclosure.

As illustrated in FIG. 9, the remote control device 300 may include a plurality of buttons for controlling the display device 100. Further, each of the plurality of buttons corresponds to at least one of user commands for controlling the display apparatus 100. That is, when the user presses one of a plurality of buttons, the remote control device 300 may transmit a control signal corresponding to the button to the display device 100. 9, the plurality of buttons may include a power button 91, a volume control button 92, a play/pause button 93, a channel control button 94, and the like.

According to an embodiment of the present disclosure, when a control signal corresponding to a user command is received from the remote control device 300 for controlling the display device 100, the display device 100 The rotation direction of the display can be determined based on the function of 100).

For example, the remote control device 300 transmits a control signal corresponding to the power button 91 or the volume control button 92 to the display device 100, and the power button 91 or the display device 100 When a control signal corresponding to the volume control button 92 is received, the display device 100 may determine a rotation direction of the display corresponding to a function of the display device 100 such as power on/off or volume control in the vertical direction. .

On the other hand, the remote control device 300 transmits a control signal corresponding to the play/pause button 93 or the channel control button 94 to the display device 100, and a play/pause button on the display device 100 When a control signal corresponding to 93 or the channel control button 94 is received, the display device 100 adjusts the rotation direction of the display corresponding to the function of the display device 100 such as play/pause or channel control in the horizontal direction. Can be determined by

The example as described above is only an example of determining the rotation direction of the display corresponding to the function of the display device 100, and the rotation direction of the display corresponding to the function of each display device 100 is set by the user. Of course, it can be changed by the like.

10 is a diagram illustrating a user interface of the display device 100 according to an embodiment of the present disclosure.

The display device 100 may display a user interface. In particular, the user interface of the display device 100 may be displayed even when the power of the display device 100 is turned off. That is, the display apparatus 100 according to the present disclosure may include a function called Always on Display (AoD) or the like.

As shown in FIG. 10, the user interface of the display apparatus 100 may include a clock-shaped object 1010. The clock-shaped object included in the user interface may represent the current time.

Meanwhile, the user interface of the display apparatus 100 may be received from the user terminal 200. In addition, the display apparatus 100 may store the received user interface, and when the power of the display apparatus 100 is terminated, the previously stored user interface may be displayed.

Meanwhile, when a plurality of user interfaces are stored in the display device 100, the display device 100 may display one user interface among the plurality of previously stored user interfaces when the power of the display device 100 is turned off. Thereafter, when a user command for changing the displayed user interface to another user interface is input, the display apparatus 100 may change and display the displayed user interface to another user interface according to the user command.

Meanwhile, as shown in FIG. 10, the user interface of the display apparatus 100 may include a guide message 1020. Specifically, the user interface may include a guide message 1020 guiding the rotation of the display. For example, the guidance message 1020 may be a message such as "This function is available only in landscape mode. The TV rotates in landscape mode."

Although not illustrated in FIG. 10, the user interface of the display apparatus 100 may include an object for receiving an inquiry message regarding whether the display is rotated and a user command regarding whether the display is rotated. For example, an inquiry message about whether or not the display is rotated may be a message such as "This function is only available in landscape mode. Would you like to rotate the TV in landscape mode?" The object to receive may include messages such as "yes" and "no". In this case, when a user command for selecting an object of "Yes" is input, the display apparatus 100 may rotate the display.

In addition to the above-described examples, the user interface of the display device 100 may display various types of user interfaces related to control of the display device 100.

11 is a flowchart illustrating a method of controlling the display apparatus 100 according to an exemplary embodiment of the present disclosure.

As shown in FIG. 11, the display device 100 according to an embodiment of the present disclosure receives a user command for controlling the display device 100 while the first content is displayed on the display of the display device ( S1110). Specifically, the display device 100 may receive a user command through the user terminal 200 connected in communication with the display device 100, and the user through the remote control device 300 for controlling the display device 100 You can also receive commands.

When a user command for controlling the display device 100 is received, the display device 100 determines a rotation direction of the display based on the type of the user command. Specifically, if the received user command is for controlling the first content, the display apparatus 100 determines to maintain the rotation direction of the display, and if the received user command is for displaying the second content on the display, 2 The rotation direction of the display may be determined based on the type of content (S1120).

Specifically, if the received user command is for maintaining the first content being displayed on the display and changing a setting related to the first content, the display apparatus 100 may determine to maintain the rotation direction of the display. For example, if the received user command is to change the volume setting of the first content or pause playback of the first content, the display apparatus 100 may determine to maintain the rotation direction of the display.

Meanwhile, if the received user command is for displaying second content different from the first content without displaying the first content being displayed on the display, the display device 100 displays the second content based on the type of the second content. You can determine the direction of rotation.

Here, determining the rotation direction of the display based on the type of the second content is whether it is appropriate to display the second content on the display rotated in the horizontal direction or the display rotated in the vertical direction. Can be determined accordingly.

Specifically, the type of the second content is whether the second content is related to broadcast content, DVD content, game content, web page content, e-book content, In addition, it may be determined according to whether or not the content is related to a screen displayed on an external device such as the user terminal 200.

For example, if the second content is broadcast content, the display apparatus 100 may determine the rotation direction of the display as the horizontal direction. Here, the broadcast content may include content received from a server providing an online streaming site, as well as content received from a terrestrial channel, a cable channel, and a satellite channel. As another example, if the second content is web page content, the display apparatus 100 may determine the rotation direction of the display as the vertical direction only when the server providing the web page provides the web page in the mobile mode. .

Meanwhile, the type of the second content may be determined based on various attributes such as an aspect ratio of the second content and a subject providing the second content. For example, if the aspect ratio of the second content is less than 1, that is, if the horizontal length of the second content is shorter than the vertical length, the display apparatus 100 may determine the rotation direction of the display as the vertical direction.

Meanwhile, the description has been made on the premise that the second content is video content, but the second content may be audio content. That is, if a user command for outputting the second content, which is audio content, is received while the first content is displayed on the display, the display apparatus 100 may determine that the rotation direction of the display is maintained.

In the above, the process of determining the rotation direction of the display based on the type of the second content has been described above. The rotation direction of the display corresponding to the type of the second content may be previously stored in the display apparatus 100, It may be updated according to the user's settings.

In addition, the rotation direction of the display corresponding to the type of the second content may be obtained through the learned artificial intelligence model. Specifically, the display device 100 may obtain information on the rotation direction of the display corresponding to the type of the second content by inputting information on the type of the second content into the artificial intelligence model, and the obtained rotation direction The rotation direction of the display can also be determined based on the information on the display.

Meanwhile, when a user command for displaying the second content is received from the remote control device 300 while the first content is displayed on the display, the display device 100 may determine the rotation direction of the display as the horizontal direction. For example, when a channel change command for displaying the second content is received from the remote control device 300 while the first content is displayed on the display rotated in the vertical direction, the display device 100 may determine the rotation direction of the display. Is determined in the horizontal direction, the display is rotated in the determined horizontal direction, and the second content may be displayed on the display rotated in the horizontal direction.

Meanwhile, the display apparatus 100 may receive content corresponding to a screen displayed on the user terminal 200 and display the received content on the display. That is, the display device 100 may perform a so-called mirroring process. In addition, when the content corresponding to the screen displayed on the user terminal 200 is displayed on the display by performing the mirroring process, the display device 100 displays the display based on information on the rotation direction of the user terminal 200. You can determine the direction of rotation.

Specifically, when a user command for displaying the second content on the display is received while the first content is displayed on the display, the display device 100 transmits the second content and the user terminal 200 from the user terminal 200. It is possible to receive information about the rotation direction of. And, if the second content is a content corresponding to a screen displayed on the user terminal 200, the display apparatus 100 may determine the rotation direction of the display based on information on the rotation direction of the user terminal 200. . For example, if the rotation direction of the user terminal 200 is a vertical direction, the display device 100 may determine the rotation direction of the display as a vertical direction, and if the rotation direction of the user terminal 200 is a horizontal direction, the display device Reference numeral 100 may determine the rotation direction of the display in the horizontal direction.

On the other hand, when information indicating that the rotation direction of the user terminal 200 is in the vertical direction and content in which the screen displayed on the user terminal 200 is rotated in the horizontal direction is received from the user terminal 200, the display device 100 The direction of rotation of can be determined in the vertical direction. Thereafter, the display apparatus 100 may rotate the display to correspond to the determined vertical direction, process the received content so that the content received on the display is displayed in the vertical direction, and display the processed content on the display. .

Meanwhile, a user command according to the present disclosure may be input through a user's voice. Specifically, when a first user voice is received while the first content is displayed on the display, the display device 100 inputs the received first user voice to the first artificial intelligence model and responds to the received first user voice. It is possible to obtain a user command to be used. In addition, if the acquired user command is for controlling the first content, the display apparatus 100 may determine to maintain the rotation direction of the display. Meanwhile, if the acquired user command is for displaying the second content on the display, the display apparatus 100 may determine the rotation direction of the display based on the type of the second content.

As described above, when the rotation direction of the display is determined, the display apparatus 100 controls the display to correspond to the determined rotation direction (S1130). Here, controlling the display to correspond to the determined rotation direction means not only rotating the display to correspond to the determined rotation direction when the display is in a state that does not correspond to the determined rotation direction, but also the display corresponding to the determined rotation direction. This includes not rotating the display when in a state.

When the display is controlled to correspond to the determined rotation direction, the display apparatus 100 may display content corresponding to a user command on the display. Specifically, if the user command received while the first content is displayed on the display is for controlling the first content, the display apparatus 100 may maintain the first content displayed on the display. If the user command received while the first content is being displayed on the display is for displaying the second content, the display apparatus 100 may display the second content on the display.

Meanwhile, the method for controlling the display device according to the above-described embodiment may be implemented as a program and provided to the display device. In particular, a program including a method for controlling a display device may be stored and provided in a non-transitory computer readable medium.

Specifically, in a computer-readable recording medium including a program for executing the control method of the display device 100, the control method of the display device 100 is, when a user command for controlling the display device 100 is received. , Determining a rotation direction of the display included in the display apparatus 100 based on the type of the user command, controlling the display to correspond to the determined rotation direction, and displaying content corresponding to the user command on the display Includes steps.

Here, the non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short moment, such as a register, cache, and memory. Specifically, the above-described various applications or programs may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, and ROM.

In the above, the control method of the display device 100 and the computer-readable recording medium including a program for executing the control method of the display device 100 have been briefly described, but this is only for omitting the redundant description, and the display It goes without saying that various embodiments of the device 100 may be applied to a computer-readable recording medium including a program that executes a method of controlling the display device 100 and a method of controlling the display device 100.

12 is a diagram specifically illustrating a speech recognition process according to an embodiment of the present disclosure.

The speech recognition process according to an embodiment of the present disclosure may be performed through an artificial intelligence agent system as shown in FIG. 12. That is, according to an embodiment of the present disclosure, the display apparatus 100 may obtain a user command corresponding to the received user voice, and such a voice recognition process may be performed through an artificial intelligence model. According to an embodiment of the present disclosure, the voice recognition system may be stored in a memory of the display apparatus 100. However, this is only an embodiment, and at least one included in the voice recognition system may be included in at least one external server.

As shown in FIG. 12, the speech recognition system includes an automatic speech recognition (ASR) module 1210, a natural language understanding (NLU) module 1220, and a dialog manager ( DM) module 1230 and a natural language generator (NLG) module 1240. In addition, the speech recognition system may further include a path planner module or an action planner module.

The automatic speech recognition (ASR) module 1210 may convert a user's speech received from the display device 100 into text data. In addition, the automatic speech recognition module 1210 may include a speech recognition module, and the speech recognition module may include an acoustic model and a language model. In particular, the acoustic model may obtain information on acoustic characteristics of the user's voice.

Specifically, the acoustic model may include information related to speech, and the language model may include information on a combination of unit phoneme information and unit phoneme information. In addition, the speech recognition module may convert the user speech into text data by using information related to speech and information on unit phoneme information. Information about the acoustic model and the language model may be stored, for example, in an automatic speech recognition database (ASR DB) 1215.

When information on the acoustic characteristics of the user's voice is obtained based on the automatic speech recognition module 1210 as described above, in particular, the acoustic model, the automatic speech recognition module 1210 Based on the information, information about the user's emotions may be obtained.

For example, the automatic speech recognition module 1210 inputs information on user acoustic characteristics into an artificial intelligence model including a convolution neural network (CNN), etc., and divides and classifies emotion factors included in the user speech. Information on the user's emotions may be obtained by using a method of doing so.

The natural language understanding module 1220 may grasp user intention by performing syntactic analysis or semantic analysis.

The natural language understanding module 1220 may divide the user input into grammatical units (eg, words, phrases, morphemes, etc.) and perform grammatical analysis by grasping which grammatical elements the divided units have.

The natural language understanding module 1220 may perform semantic analysis using semantic matching, rule matching, and formula matching. Accordingly, the natural language understanding module 1220 may obtain a domain, an intent, or a parameter (or a slot) necessary for expressing an intention in which the user input is.

The natural language understanding module 1220 may determine the user's intention and parameters by using a matching rule divided into a domain, an intention, and a parameter (or a slot) necessary to determine the intention. have.

For example, one domain (e.g., alarm) can contain multiple intents (e.g., set an alarm, clear an alarm, etc.), and one intent can contain multiple parameters (e.g. time, number of repetitions, alarm sounds, etc.) ) Can be included. In addition, the plurality of rules may include one or more essential element parameters. Meanwhile, the matching rule may be stored in a natural language understanding database (NLU DB) 1225.

The natural language understanding module 1220 grasps the meaning of the word extracted from the user input by using linguistic features (eg, grammatical elements) such as morphemes and phrases, and matches the meaning of the identified word with a domain and intention You can determine your intentions.

For example, the natural language understanding module 1220 may determine the user intention by calculating how many words extracted from the user input are included in each domain and intention. According to an embodiment, the natural language understanding module 1220 may determine a parameter of a user input using a word that is a basis for grasping an intention.

In addition, the natural language understanding module 1220 may determine the user's intention by using the natural language recognition database 1225 in which linguistic features for determining the intention of the user input are stored.

The natural language understanding module 1220 may generate a pass rule based on an intention and a parameter of a user input. For example, the natural language understanding module 1220 may select an app to be executed based on the intention of a user input and determine an operation to be performed in the selected app.

The natural language understanding module 1220 may generate a pass rule by determining a parameter corresponding to the determined operation. According to an embodiment, the pass rule generated by the natural language understanding module 1220 may include information on an app to be executed, an operation to be executed in the app, and a parameter required to execute the operation.

The natural language understanding module 1220 may generate one pass rule or a plurality of pass rules based on the intention and parameter of the user input. For example, the natural language understanding module 1220 may determine a pass rule by receiving a pass rule set corresponding to the display apparatus 100 from the pass planner module, and mapping the intention and parameters of the user input to the received pass rule set. have.

In this case, the pass rule may include information on an operation (or operation) for performing a function of the app or information on a parameter necessary to execute the operation. In addition, the pass rule may include an operation order of the app. The display apparatus 100 may receive the pass rule, select an app according to the pass rule, and execute an operation included in the pass rule in the selected app.

The natural language understanding module 1220 may generate one pass rule or a plurality of pass rules by determining an app to be executed, an operation to be executed in the app, and a parameter required to execute the operation based on the intention and parameter of the user input.

For example, the natural language understanding module 1220 arranges an app to be executed and an operation to be executed in the app in the form of an ontology or a graph model according to the intention of the user input using the information of the display device 100 By doing so, you can create a pass rule. In addition, the generated path rule may be stored in a path rule database through a path planner module. The generated pass rule may be added to the pass rule set of the database 1225.

The natural language understanding module 1220 may select at least one pass rule from among a plurality of generated pass rules. For example, the natural language understanding module 1220 may select an optimal pass rule for a plurality of pass rules. For another example, the natural language understanding module 1220 may select a plurality of pass rules when only some motions are specified based on the user's speech. The natural language understanding module 1220 may determine one of a plurality of pass rules according to an additional input from a user.

The conversation manager module 1230 may determine whether the user's intention identified by the natural language understanding module 1220 is clear. For example, the conversation manager module 1230 may determine whether the user's intention is clear based on whether the parameter information is insufficient. The conversation manager module 1230 may determine whether a parameter identified by the natural language understanding module 1220 is sufficient to perform the task.

According to an embodiment, when the user's intention is not clear, the conversation manager module 1230 may perform feedback requesting necessary information from the user. For example, the conversation manager module 1230 may perform feedback requesting information on a parameter for identifying the user's intention. In addition, the conversation manager module 1230 may generate and output a message for confirming a user inquiry including text changed by the natural language understanding module 1220.

According to an embodiment, the conversation manager module 1230 may include a content provider module. The content providing module may generate a result of performing a task corresponding to a user input when it can perform an operation based on the intention and parameter identified by the natural language understanding module 1220.

The natural language generation module (NLG module) 1240 may change designated information into a text format. The information changed in the text form may be in the form of natural language speech. Here, the designated information may be information for an additional input, information for guiding the completion of an operation corresponding to a user input, or information for guiding an additional input by a user (eg, feedback information for a user input).

Information changed in text form may be displayed on the display of the display apparatus 100 or may be changed into a voice form by a text-to-speech module (TTS module).

13 is a block diagram illustrating a detailed configuration of a processor according to an embodiment of the present disclosure.

Referring to FIG. 13, the processor 140 according to some embodiments may include a data learning unit 1310 and a data recognition unit 1320.

The data learning unit 1310 may learn a criterion for acquiring a user command corresponding to a received user voice and acquiring information on a rotation direction of a display corresponding to a type of content according to the present disclosure. The data learning unit 1310 determines which data is used to acquire user commands corresponding to the received user voice and information on the rotation direction of the display corresponding to the type of content, and the user voice received using the data. It is possible to learn a criterion for how to obtain a user command corresponding to and obtain information on a rotation direction of a display corresponding to a type of content. The data learning unit 1310 acquires data to be used for learning and applies the acquired data to an artificial intelligence model, thereby acquiring a user command corresponding to the received user voice and the rotation direction of the display corresponding to the type of content. You can learn the criteria for acquiring information about this.

The data recognition unit 1320 may output a result of obtaining a user command corresponding to the received user voice and obtaining information on a rotation direction of the display corresponding to the type of the received content. The data recognition unit 1320 uses the learned artificial intelligence model to obtain a user command corresponding to a user voice received from predetermined data and a result of obtaining information on a rotation direction of the display corresponding to the type of content. Can be printed.

Specifically, the data recognition unit 1320 acquires predetermined data according to a preset criterion through learning, and uses an artificial intelligence model using the acquired data as an input value, thereby generating a user command corresponding to the received user voice. A result of obtaining information on the rotation direction of the display corresponding to the acquisition and type of content may be output. Also, a result value output by the data recognition model using the acquired data as an input value may be used to update the artificial intelligence model.

At least one of the data learning unit 1310 and the data recognition unit 1320 may be manufactured in the form of at least one hardware chip and mounted on the display device. For example, at least one of the data learning unit 1310 and the data recognition unit 1320 may be manufactured in the form of a dedicated hardware chip for artificial intelligence (AI), or an existing general-purpose processor (eg, a CPU Alternatively, it may be manufactured as a part of an application processor) or a graphics dedicated processor (eg, a GPU) and mounted on the aforementioned various display devices.

In this case, the data learning unit 1310 and the data recognition unit 1320 may be mounted on one display device 100 or may be mounted on separate display devices, respectively. For example, one of the data learning unit 1310 and the data recognition unit 1320 may be included in the display apparatus 100 and the other may be included in a server.

In addition, the data learning unit 1310 and the data recognition unit 1320 may provide model information built by the data learning unit 1310 to the data recognition unit 1320 through wired or wireless communication, or the data recognition unit ( The data input to 1320 may be provided to the data learning unit 1310 as additional learning data.

Meanwhile, at least one of the data learning unit 1310 and the data recognition unit 1320 may be implemented as a software module. When at least one of the data learning unit 1310 and the data recognition unit 1320 is implemented as a software module (or a program module including an instruction), the software module is a computer-readable non-transitory It may be stored in a non-transitory computer readable media.

In addition, in this case, at least one software module may be provided by an operating system (OS) or a predetermined application. Alternatively, some of the at least one software module may be provided by an operating system (OS), and the remaining part may be provided by a predetermined application.

According to various embodiments of the present disclosure as described above, the display device 100 provides various contents as a visual experience greater than that of the user terminal 200, and at the same time, sets the type of user command for controlling the display device 100. By rotating the display on the basis of the user's various content viewing experiences, it is possible to provide content through the rotated display.

Each of the constituent elements (eg, a module or a program) according to various embodiments of the present disclosure as described above may be composed of a singular or a plurality of entities, and some sub-elements of the aforementioned sub-elements are omitted. Alternatively, other sub-elements may be further included in various embodiments. Alternatively or additionally, some constituent elements (eg, a module or a program) may be integrated into one entity, and functions performed by each corresponding constituent element prior to the consolidation may be performed identically or similarly.

Operations performed by modules, programs, or other components according to various embodiments may be sequentially, parallel, repetitively or heuristically executed, or at least some operations may be executed in a different order, omitted, or other operations may be added. I can.

Meanwhile, the term "unit" or "module" used in the present disclosure includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits. I can. The "unit" or "module" may be an integrally configured part or a minimum unit performing one or more functions or a part thereof. For example, the module may be configured as an application-specific integrated circuit (ASIC).

Various embodiments of the present disclosure may be implemented with software including instructions stored in a machine-readable storage medium (eg, a computer). The device calls instructions stored from the storage medium. And, as a device capable of operating according to the called command, it may include a display device (for example, the display device 100) according to the disclosed embodiments.

When the command is executed by the processor, the processor may perform a function corresponding to the command directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or interpreter.

A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here,'non-transient' means that the storage medium does not contain a signal and is tangible, but does not distinguish between semi-permanent or temporary storage of data in the storage medium.

According to an embodiment, a method according to various embodiments disclosed in the present document may be provided in a computer program product. Computer program products can be traded between sellers and buyers as commodities.

The computer program product may be distributed online in the form of a device-readable storage medium (eg, compact disc read only memory (CD-ROM)) or through an application store (eg, Play Store ^TM ). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a storage medium such as a server of a manufacturer, a server of an application store, or a memory of a relay server.

In the above, preferred embodiments of the present disclosure have been illustrated and described, but the present disclosure is not limited to the specific embodiments described above, and is generally used in the technical field to which the disclosure belongs without departing from the gist of the disclosure claimed in the claims. Of course, various modifications may be made by those with knowledge of, and these modifications should not be understood individually from the technical idea or prospect of the present disclosure.

100: display device 110: display
120: motor 130: memory
140: processor 150: communication unit
160: microphone 170: speaker
200: user terminal 300: remote control device

Claims (16)

In the display device,
Communication department;
display;
A motor rotating the display;
A memory for storing at least one instruction; And
A processor that executes the at least one instruction; Including,
The processor,
When transmission image data corresponding to a screen displayed on the user terminal and having a horizontal direction standard and information indicating that the rotation direction of the user terminal is a vertical direction are received from a user terminal connected to the display device through the communication unit, Controlling the motor to rotate the display in the vertical direction,
A display device that controls the display to display first content in a vertical direction generated by rotating the received transmission image data by 90 degrees.
delete The method of claim 1,
The processor,
While the first content is displayed on the display, when transmission image data corresponding to the second content and having a horizontal standard and information indicating that the rotation direction of the user terminal is horizontal are received, the display Control the motor to rotate in the horizontal direction,
A display device that controls the display to display the second content.
delete The method of claim 1,
MIC; Including more,
The processor,
Receiving a user command for controlling the display device while the first content is displayed on the display,
The user command is obtained by inputting a user voice received through the microphone into a learned artificial intelligence model while the first content is displayed on the display.
The method of claim 1,
The processor,
When the communication connection with the user terminal is terminated while the first content is displayed on the display, the display device controls the motor to rotate the display in a horizontal direction.
In the non-transitory computer-readable recording medium comprising a program for executing a control method of a user terminal,
The control method of the user terminal,
Receiving a user input for transmitting content corresponding to a screen displayed on the display of the user terminal to a display device connected to the user terminal;
Generating transmission image data in which content corresponding to a screen displayed on the display is rotated in a horizontal direction when information indicating that the rotation direction of the user terminal is a vertical direction is obtained; And
Transmitting the transmitted image data and information indicating that the rotation direction of the user terminal is a vertical direction to the display device; Computer-readable recording medium comprising a.
The method of claim 7,
The transmitted image data is transmitted to the display device in a horizontal image standard,
Generating the transmission image data,
Rotating content corresponding to a screen displayed on the display by 90 degrees to correspond to the horizontal image standard; Computer-readable recording medium further comprising a.
The method of claim 8,
The control method of the user terminal,
Generating transmission image data in which the orientation of the content corresponding to the screen displayed on the display is maintained when information indicating that the rotation direction of the user terminal is a horizontal direction is obtained; And
Transmitting, to the display device, transmission image data in which the orientation of the content corresponding to the screen displayed on the display is maintained; Computer-readable recording medium further comprising a.
The method of claim 7,
The user input is a computer-readable recording medium that is received through a user interface displayed on the display.
The method of claim 7,
The user input is a computer-readable recording medium received from the display device.
In the control method of the user terminal,
Receiving a user input for transmitting content corresponding to a screen displayed on the display of the user terminal to a display device connected to the user terminal;
Generating transmission image data in which content corresponding to a screen displayed on the display is rotated in a horizontal direction when information indicating that the rotation direction of the user terminal is a vertical direction is obtained; And
Transmitting the transmitted image data and information indicating that the rotation direction of the user terminal is a vertical direction to the display device; Control method of a user terminal comprising a.
The method of claim 12,
The transmitted image data is transmitted to the display device in a horizontal image standard,
Generating the transmission image data,
Rotating content corresponding to a screen displayed on the display by 90 degrees to correspond to the horizontal image standard; Control method of a user terminal further comprising a.
The method of claim 13,
The control method of the user terminal,
Generating transmission image data in which the orientation of the content corresponding to the screen displayed on the display is maintained when information indicating that the rotation direction of the user terminal is a horizontal direction is obtained; And
Transmitting, to the display device, transmission image data in which the orientation of the content corresponding to the screen displayed on the display is maintained; Control method of a user terminal further comprising a.
The method of claim 12,
The user input is received through a user interface displayed on the display.
The method of claim 12,
The user input is a control method of a user terminal received from the display device.

Images