KR102241289B1 - Display apparatus and the control method thereof - Google Patents

Abstract

A display device is disclosed. The device generates stream data according to the execution of the first application when there is a storage unit for storing a plurality of applications and an execution request of a first application among the plurality of applications, and uses the generated stream data to run the first application. And a control unit that executes the second application by using at least part of the generated stream data when there is a request for execution of the second application among the plurality of applications.

Description

Display device and its control method {DISPLAY APPARATUS AND THE CONTROL METHOD THEREOF}

The present invention relates to a display device and a control method thereof, and more particularly, to a display device that executes an application using stream data and a control method thereof.

A display device refers to a device that displays an image transmitted from a broadcasting station or the like through a display unit such as CRT, PDP, LCD, or OLED. In recent years, display devices are being developed from traditional analog TVs to DTV (Digital TV) that can output high-definition images and high-quality sound, and in addition to this, they have rapidly developed into IPTV (Internet Protocol TV), etc. have.

In addition to the digital broadcasting reception function, recent display devices provide various functions such as a reception function of an Electronic Program Guide (EPG), a two-way communication function, and an Internet connection function. In addition, it has become possible to take charge of server functions in a home network environment or a ubiquitous environment.

On the other hand, IPTV is distinguished from conventional TV in that it is possible to select and view or edit a desired broadcast. In other words, IPTV has various advantages in that it is possible to watch programs broadcasted by broadcasting stations through the Internet, as well as to receive various contents provided on the Internet without having to operate a PC separately. Because of these advantages, IPTV capable of two-way communication is expected to become more popular.

Accordingly, there is a need for future display devices to provide more diverse and convenient functions, away from the conventional simple content display function.

The present invention is in accordance with the above-described necessity, and an object of the present invention is to provide a display device for executing a plurality of applications using one stream data and a method for controlling the same.

In order to achieve the above object, the display device according to an embodiment of the present invention includes a storage unit for storing a plurality of applications, and a stream according to the execution of the first application when there is a request to execute a first application among the plurality of applications. A control unit that generates data, executes a first application using the generated stream data, and executes a second application using at least a portion of the generated stream data when there is a request to execute a second application among a plurality of applications. Includes.

Also, the second application may be a plurality of different applications.

In addition, the plurality of applications may be any one of a camera application, a gesture recognition application, a voice recognition application, and a video call application.

Also, the controller may execute the first or second application by pre-processing the stream data according to a preset method.

In addition, the stream data includes video stream data or audio stream data.

In addition, the pretreatment may include a plurality of different pretreatments.

In addition, the control unit may copy at least a part of stream data on which a plurality of different preprocesses have been performed by the execution of the first application and use it to execute the second application.

In addition, when there is a request for execution of one of the plurality of applications, the control unit includes a first module that generates stream data, a second module that performs preprocessing of a preset type on the generated stream data, and the stream data on which the preprocess is performed. It may include a third module that determines an application to be used.

Also, the controller may determine a preprocessing type required for execution of each of the plurality of applications from a header file included in each of the plurality of applications.

In addition, the controller may match a plurality of applications and a preprocessing type requested by each of the plurality of applications and store them in the table.

In addition, the pre-processing includes at least one of noise removal, image synthesis, and cropping for the video stream data, and at least one of noise removal, echo cancellation, and beamforming for the voice stream data. It can contain one.

On the other hand, the control method of the display device according to an embodiment of the present invention, when there is a request for execution of a first application among a plurality of applications, generating stream data according to execution of the first application and using the generated stream data. And executing the second application by using at least a part of the generated stream data when there is a request for execution of the second application among the plurality of applications while executing the first application.

According to at least one of the embodiments of the present invention, since a plurality of applications are executed using one stream data, operations of each application may be executed simultaneously or sequentially.

In addition, since pre-processing commonly required for executing a plurality of applications only needs to be performed once, waste of processing can be reduced.

In addition, since one stream data can be used to run multiple applications, there is an effect of expanding the USB bandwidth.

Further scope of the applicability of the present invention will become apparent from the detailed description below. However, since various changes and modifications within the spirit and scope of the present invention can be clearly understood by those skilled in the art, specific embodiments such as the detailed description and preferred embodiments of the present invention should be understood as being given by way of example only.

1 is an example of a diagram for explaining communication between a display device and an external device according to an embodiment of the present invention;
2 is an example of a block diagram of a broadcast transmission device according to an embodiment of the present invention;
3 is an example of a block diagram of a display device according to an embodiment of the present invention;
4 is an example of a conceptual diagram for explaining a method of executing a plurality of applications according to a conventional method;
5 is an example of a conceptual diagram for explaining a method of executing a plurality of applications according to an embodiment of the present invention;
6 is an example of a block diagram of a method for controlling a display device according to an embodiment of the present invention;
7 to 11 are various examples of drawings for explaining the operation of the display device according to an embodiment of the present invention;
12 is an example of an internal block diagram of a control unit in a display device according to an embodiment of the present invention;
13 to 16 are various examples of diagrams illustrating a process in which a pre-processing process required for execution of each application is executed in the display device according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "unit" for constituent elements used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves. In addition, in describing the embodiments disclosed in the present specification, when it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed in the present specification is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another component.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. It should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In the present application, terms such as "comprises" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features or It is to be understood that the presence or addition of numbers, steps, actions, components, parts, or combinations thereof does not preclude the possibility of preliminary exclusion.

The display device described herein may include analog TV, DTV, IPTV, Smart TV, 3D TV, projection TV, and other various monitors, as well as desktop computers and digital signage.

However, the configuration according to the embodiment described in this specification is a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistants (PDA), a portable multimedia device (PMP), except when applicable only to a TV. player), navigation, slate PC, tablet PC, ultrabook, wearable device (e.g., smartwatch, smart glass), It will be readily apparent to those skilled in the art that it may also be applied to mobile terminals such as HMD (head mounted display).

1 is a diagram for describing a process in which the display device 100 according to the present invention communicates with an external device.

As shown in FIG. 1, the display device 100 according to an embodiment of the present invention may communicate with a broadcasting station 10, a network server 20, or an external device 30. In addition, although not shown in FIG. 1, a remote controller (not shown) for controlling the display device 100 may be further included.

Meanwhile, it should be clearly stated that the display device 100 disclosed in this document is not limited to a TV. That is, the display device 100 may be a settop box (STB), Internet Protocol TV (IPTV), a personal computer, etc., except for the case where the configuration according to the embodiment described herein is applicable only to the TV. have.

The display apparatus 100 may receive a broadcast signal including an image signal transmitted from the broadcasting station 10. The display device 100 may process an image signal, an audio signal, or a data signal included in a broadcast signal to be suitable for output from the display device 100. The display apparatus 100 may output an image or audio based on the processed image signal.

Meanwhile, the display device 100 may communicate with the network server 20. The network server 20 is a device capable of transmitting and receiving signals to and from the display device 100 through an arbitrary network. For example, the network server 20 may be a mobile phone terminal that can be connected to the display apparatus 100 through a wired or wireless base station. In addition, the network server 20 may be a device capable of providing content to the display device 100 through an Internet network. The content provider may provide content to the display device 100 using a network server. In addition, the network server 20 may be a device capable of providing various web services and other information to the display device 100 through an Internet network.

Meanwhile, the display device 100 may communicate with the external device 30. The external device 30 is a device capable of directly transmitting and receiving signals with the display device 100 by wire or wirelessly. For example, the external device 30 may be a media storage device or a playback device used by a user. That is, the external device 30 may correspond to a camera, a DVD player, a Blu-ray player, a personal computer, or the like.

The broadcasting station 10, the network server 20, or the external device 30 may transmit a signal including an image signal to the display device 100. The display apparatus 100 may display an image based on an image signal included in an input signal. In addition, the display device 100 may transmit a signal transmitted from the broadcasting station 10 or the network server 20 to the display device 100 to the external device 30. In addition, a signal transmitted from the external device 30 to the display device 100 may be transmitted to the broadcasting station 10 or the network server 20. That is, the display device 100 not only plays the content included in the signals transmitted from the broadcasting station 10, the network server 20, and the external device 30 directly, but also has a function of delivering the content. Includes.

2 is a block diagram of a broadcast transmission device 50 according to an embodiment of the present invention. FIG. 2 shows a broadcast transmission device 50 included in the broadcasting station 10 shown in FIG. 1 as an example.

The broadcast transmission device 50 according to an embodiment of the present invention may include a broadcast content storage unit 51, a GUI information generation unit 52, a broadcast data conversion unit 53, and a transmission unit 54. have.

The broadcast content storage unit 51 stores at least one broadcast content to be transmitted to the display device 100. The broadcast content storage unit 51 may receive and store broadcast content generated externally, or may generate and store broadcast content to be transmitted. Broadcast content may include at least one of video, audio, and data. In general, it is referred to as video broadcasting, audio broadcasting, and data broadcasting according to the type of broadcasting content. If broadcast content is expressed differently, it can be referred to as multimedia content.

The GUI information generator 51 may generate and store at least one GUI information to be transmitted to the display device 100. The GUI information may include at least one of image information, color information, menu information, text information, and screen composition information.

Image information is information on various images to be used in the GUI. The image may include at least one of a still image, a moving picture, a flash, and an animation. Color information is information on image characteristics including various colors, brightness, and saturation to be used in the GUI. The menu information is information on the type or configuration of a menu to be displayed on the GUI. The text information is information about the color, font, size, etc. of text to be used in the GUI. The screen composition information is information on the composition of images, menus, and texts to be used in the GUI.

The GUI information stored in the GUI information generator 52 may include unique GUI information of the broadcasting station 10. For example, the GUI information may include a logo representing the broadcasting station 10 or representing a specific channel provided by the broadcasting station 10. The logo may include an image. In addition, the GUI information may include unique GUI information corresponding to specific broadcast content generated by the broadcasting station 10.

Meanwhile, the GUI information may include at least one of a graphic element and the audio element. In addition, the GUI information may include location information indicating a path of a place in which at least one of a graphic element and an audio element is stored. For example, at least one of a graphic element and an audio element is stored in a web server operated by the broadcasting station 10, and the GUI information stored in the GUI information generating unit 52 is a graphic element or an audio element. It may include location information indicating a path stored in. For example, the location information may include a uniform resource locator (URL) address or a uniform resource identifier (URI).

When the display apparatus 100 receives GUI information including location information, it may download a graphic element or an audio element with reference to the location information.

The broadcast data conversion unit 53 may convert broadcast content stored in the broadcast content storage unit 51 and GUI information output from the GUI information generation unit 52 into a transmittable broadcast data format and output. In addition, the generated broadcast signal may be packetized and output according to a broadcast signal transmission principle or broadcast standard.

The transmission unit 54 may transmit the broadcast signal generated by the broadcast data conversion unit 53 through a transmission network.

3 is a diagram for explaining the configuration of the display device 100 according to the present invention. Hereinafter, descriptions of parts that overlap with the above description will be omitted.

3, the display apparatus 100 according to an embodiment of the present invention includes a display unit 171 displaying an image and a driving unit supplying a driving signal to the display unit 171 in response to a received broadcast signal ( 170).

The display unit 171 may be referred to as a display panel.

The driver 170 may control image display and audio output of the display apparatus 100. The driving unit 170 may include a receiving unit 110, an external device interface unit 130, a storage unit 120, a user input interface unit 140, a control unit 160, and a command input unit 150.

The driving unit 170 and the display unit 171 may be integrally formed. Alternatively, the driving unit 170 and the display unit 171 may be separately modularized, and may perform wired or wireless communication.

In addition, the display apparatus 100 according to the present invention includes a sound output unit 172 for outputting sound, a sound sensing unit 173 for sensing sound, and a motion sensing unit for sensing movement of a user ( 174).

The display device 100 according to the present invention will be described in more detail as follows.

The receiving unit 110 may include a tuner 111, a demodulation unit 112, and a network interface unit 113. If necessary, it is possible to design the tuner 111 and the demodulation unit 112 so that the network interface unit 113 is not included. Conversely, the tuner 111 and the demodulation unit ( It is also possible to design not to include 112).

The tuner 111 may select a channel selected by a user from among radio frequency (RF) broadcast signals received through an antenna or an RF broadcast signal corresponding to all previously stored channels. Also, the selected RF broadcast signal is converted into an intermediate frequency signal or a baseband video or audio signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it may be converted to a digital IF signal (DIF), and if the selected RF broadcast signal is an analog broadcast signal, it may be converted to an analog baseband video or audio signal (CVBS/SIF). That is, the tuner 111 can process both a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS/SIF) output from the tuner 111 may be directly input to the controller 160.

The demodulator 112 may perform a demodulation operation by receiving the digital IF signal DIF converted by the tuner 111.

For example, when the digital IF signal output from the tuner 111 is the ATSC method, the demodulator 112 may perform, for example, 8-VSB (8-Vestigal Side Band) demodulation. Also, the demodulator 112 may perform channel decoding. To this end, the demodulation unit 112 includes a Trellis decoder, a de-interleaver, a Reed Solomon decoder, etc. Decryption can be performed.

For example, when the digital IF signal output from the tuner 111 is a DVB type, the demodulator 112 may perform, for example, Coded Orthogonal Frequency Division Modulation (COFDMA) demodulation. Also, the demodulator 112 may perform channel decoding. To this end, the demodulator 112 may include a convolution decoder, a deinterleaver, a Reed-Soloman decoder, and the like to perform convolutional decoding, deinterleaving, and Reed-Soloman decoding.

The demodulator 112 may output a stream signal TS after performing demodulation and channel decoding. In this case, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal and a Dolby AC-3 standard audio signal are multiplexed. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

The stream signal output from the demodulator 112 may be input to the controller 160.

After performing demultiplexing, image/audio signal processing, and the like, the controller 160 may output an image to the display unit 171 and output an audio to the sound output unit 172.

The external device interface unit 130 may connect the external device and the display device 100 according to the present invention. To this end, the external device interface unit 130 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 may be connected to an external device such as a digital versatile disk (DVD), a Blu-ray device, a game device, a camcorder, a computer (laptop), etc. by wire or wirelessly. The external device interface unit 135 may transmit a video, audio, or data signal input from the outside through a connected external device to the controller 160 of the display device 100. In addition, the image, audio, or data signal processed by the controller 160 may be output to a connected external device. To this end, the external device interface unit 130 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The network interface unit 113 may provide an interface for connecting the display device 100 to a wired/wireless network including an Internet network. The network interface unit 113 may be provided with, for example, an Ethernet terminal for connection with a wired network, and for connection with a wireless network, for example, a wireless LAN (WLAN) (Wi-Fi). ), Wireless broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA) communication standards, and the like may be used.

The network interface unit 113 may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network.

Meanwhile, the network interface unit 113 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, it is possible to transmit or receive data with the server. In addition, content or data provided by a content provider or network operator may be received. That is, content such as movies, advertisements, games, VODs, broadcast signals, and related information provided from a content provider or a network provider may be received through a network. In addition, it is possible to receive update information and update files of firmware provided by the network operator. It can also send data to the Internet or content provider or network operator.

The storage unit 120 may store a program for processing and controlling each signal in the controller 160, or may store a signal-processed video, audio, or data signal.

In addition, the storage unit 120 may perform a function for temporary storage of a video, audio, or data signal input from the external device interface unit 130 or the network interface unit 113. In addition, the storage unit 120 may store information on a predetermined broadcast channel through a channel memory function.

The storage unit 120 includes, for example, a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (eg, SD or XD memory). Etc.), RAM, and ROM (EEPROM, etc.).

The display device 100 may reproduce and provide a content file (movie file, still image file, music file, document file, application file, etc.) stored in the storage unit 120 to a user.

3 illustrates a case in which the storage unit 120 is provided separately from the control unit 160, the storage unit 120 may be included in the control unit 160.

The command input unit 150 may include an input key for a user to input a command. The command input unit 150 may include a wired input unit 151 for inputting a command by wire and a wireless input unit 200 for wirelessly inputting a command.

The command input unit 150 may input various commands such as power on/off, channel selection, screen setting, volume control, movement of a cursor on the screen, and menu selection.

Here, the wireless input unit 200 may be a remote controller for remote control.

The user input interface unit 140 may transmit a signal input by the user through the command input unit 150 to the control unit 160 or may transmit a signal from the control unit 160 to the command input unit 150.

If the user inputs a predetermined command through the wired input unit 151, the input command may be directly transmitted to the control unit 160 without passing through the user input interface unit 140.

The user input interface unit 140 receives and processes a command input from the wireless input unit 200 according to various communication methods such as a radio frequency (RF) communication method and an infrared (IR) communication method, or controls the control unit 160 The signal may be processed to be transmitted to the wireless input unit 200.

In addition, for example, the user input interface unit 140 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting key of the command input unit 150 to the controller 160. have.

The control unit 160 demultiplexes the input stream or processes the demultiplexed signals through the tuner 111 or the demodulation unit 112 or the external device interface unit 130 to provide a signal for video or audio output. Can be created and printed.

The image signal processed by the controller 160 may be input to the display unit 171 and may be displayed as an image corresponding to the corresponding image signal. In addition, the image signal processed by the controller 160 may be input to an external output device through the external device interface unit 130.

The audio signal processed by the control unit 160 may be audio output to the sound output unit 172. In addition, the voice signal processed by the controller 160 may be input to an external output device through the external device interface unit 130.

Although not shown in FIG. 3, the control unit 160 may include a demultiplexer, an image processing unit, and the like.

In addition, the controller 160 may control the overall operation of the display apparatus 100. For example, the controller 160 may control the tuner 111 to select (Tuning) a channel selected by the user or an RF broadcast corresponding to a previously stored channel.

In addition, the controller 160 may control the display apparatus 100 according to a user command or an internal program input through the user input interface 140. In particular, it is possible to access a network to download an application or an application list desired by a user into the display device 100.

For example, the control unit 160 controls the tuner 111 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 140. Then, the video, audio, or data signal of the selected channel is processed. The control unit 160 enables channel information selected by the user to be output through the display unit 171 or the sound output unit 172 together with the processed image or audio signal.

As another example, the controller 160 may receive a video signal or an audio signal from an external device or camcorder input through the external device interface unit 130 according to an external device video playback command received through the user input interface unit 140. It can be output through the display unit 171 or the sound output unit 172.

The controller 160 may control the display unit 171 to display an image. For example, a broadcast image input through the tuner 111, an external input image input through the external device interface unit 130, an image input through the network interface unit, or an image stored in the storage unit 120 is displayed on the display unit ( 171). In this case, the image displayed on the display unit 171 may be a still image or a moving image, and may be a 2D image or a 3D image.

The controller 160 may control to play content. In this case, the content may be content stored in the display device 100, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

In addition, the control unit 160 searches for a user terminal connected to the display device and a network through the network interface unit 113, outputs the searched user terminal list through the display unit 171, and outputs the searched user terminal list through the user input interface unit 140. It is possible to control to receive a selection signal of a user terminal used as a user controller from the searched user terminal list.

In addition, the controller 160 may control to output player information corresponding to each user terminal through the display unit 171.

The display unit 171 converts an image signal, a data signal, an OSD signal processed by the control unit 160, or an image signal and a data signal received from the external device interface unit 130 into R, G, and B signals, respectively. It can generate a drive signal.

The display unit 171 may be a PDP, LCD, OLED, flexible display, 3D display, or the like.

Meanwhile, the display unit 171 may be configured as a touch screen and used as an input device in addition to an output device.

The sound output unit 172 may receive a signal processed by the control unit 160, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and output the sound as sound. The sound output unit 172 may be implemented with various types of speakers.

The sound sensing unit 173 may sense sound generated inside or outside the display apparatus 100.

For example, the sound sensing unit 173 may sense various sounds such as a phone ring sound, a doorbell sound, a water sound, and a user's voice generated outside the display apparatus 100. To this end, the sound sensing unit 173 may include a voice sensor or a microphone.

The motion sensing unit 174 may sense a user's movement. To this end, the motion sensing unit 174 may include a sensor unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor. The signal sensed by such a sensor unit may be transmitted to the control unit 160.

In addition, the motion sensing unit 174 may include a photographing unit (not shown) such as a camera. Image information captured by the photographing unit (not shown) may be input to the control unit 160.

Alternatively, the motion sensing unit 174 may include a sensor unit and a photographing unit together.

The control unit 160 may detect a user's gesture by combining or combining an image captured from a photographing unit (not shown) or a signal sensed from a sensing unit (not shown).

In addition, the motion sensing unit 174 may sense not only the user's motion, but also information such as the shape of the user's face and the direction the user's face faces.

Meanwhile, the wireless input unit 200 may transmit a user input to the user input interface unit 140. To this end, the wireless input unit 200 may use Bluetooth, Radio Frequency (RF) communication, infrared (IR) communication, Ultra Wideband (UWB), ZigBee, or the like.

In addition, the wireless input unit 200 may receive an image, audio, or data signal output from the user input interface unit 140, and display the received information on the wireless input unit 200 or output audio or vibration.

On the other hand, the display device 100 does not include a tuner 111 and a demodulator 112, and receives video content through the network interface unit 113 or the external device interface unit 130, unlike FIG. 3. And play it back.

Meanwhile, although not shown in the drawing, a channel browsing processing unit for generating a thumbnail image corresponding to a channel signal or an external input signal may be further provided.

The channel browsing processing unit may receive a stream signal TS output from the demodulation unit 112 or a stream signal output from the external device interface unit 130 and extract an image from the input stream signal to generate a thumbnail image. have. The generated thumbnail image may be input to the controller 160 as it is or after being encoded. In addition, the generated thumbnail image may be encoded in the form of a stream and input to the controller 160. The controller 160 may display a thumbnail list including a plurality of thumbnail images on the display unit 171 by using the input thumbnail images. Meanwhile, the thumbnail images in the thumbnail list may be updated sequentially or simultaneously. Accordingly, the user can easily grasp the contents of a plurality of broadcast channels.

4 is an example of a conceptual diagram for explaining a method of executing a plurality of applications according to a conventional method.

Any platform among the display devices may be stored or mounted in the storage unit 62 or the control unit 61, respectively, and such a platform may include a plurality of applications 63 and 64. Hereinafter, a case where the platforms for the plurality of applications 63 and 64 are stored in the storage unit 62 will be described. In addition, in the following, the application program will be briefly referred to as an application.

Referring to FIG. 4A, the storage unit 62 includes first and second applications 63 and 64. Here, when execution of the first application 63 is requested, the controller 61 may generate stream data and execute the first application 63 by using the stream data.

Here, the stream data means composed of one or more samples, and the stream data memory allocation may be specified in units of bytes. Here, the sample may mean information at a specific point in time. The sample refers to information at a specific point in time when information is newly updated, and may be a unit in which information is newly updated. Since the stream data is a known matter, a detailed description will be omitted.

Meanwhile, while the first application 63 is being executed, the execution of the second application 64 may be requested. The second application 64 may use the same stream data as the stream data used to execute the first application 63. In this case, as shown in FIG. 4B, the controller 61 may execute the second application 64 using the stream data after stopping or terminating the execution of the first application 63.

However, according to this conventional method, there may be restrictions on the number of applications to be executed. That is, there may be a problem that a plurality of applications using the same stream data cannot be executed at the same time.

In addition, even if the first application 63 is executed by pre-processing the stream data, in order to execute the second application 64, the same pre-processing or some of the pre-processes that have already been performed must be performed again, thereby reducing waste of processing. Can result.

Accordingly, there is a need for stream data used to execute one application to be used for execution of another application. That is, as illustrated in FIG. 5, when the first and second applications 181 and 182 use the same stream data, it is necessary to copy one stream data as many as the number of applications to be executed.

5 is an example of a conceptual diagram illustrating a method of executing a plurality of applications according to an embodiment of the present invention. Referring to FIG. 5, the controller 160 may execute a first application 181 stored in the storage 120 by using stream data. Thereafter, when there is a request for execution of the second application 182, the controller 160 may copy the stream data used to execute the first application 181 and use it for execution of the second application 182. .

Hereinafter, a method of executing a plurality of applications according to an embodiment of the present invention will be described in detail.

6 is an example of a block diagram of a method for controlling the display apparatus 100 according to an embodiment of the present invention.

First, the display device 100 is turned on. In this case, the display device 100 may be turned on by a remote control or a power button formed outside the display device 100.

In addition, the display device 100 may be turned on by a user gesture. Accordingly, even when the display device 100 is turned off, the camera 174 for recognizing a user gesture may be activated.

Likewise, the display device 100 may be turned on by a user's voice. Accordingly, even when the display apparatus 100 is turned off, a microphone for recognizing a user's voice may be activated.

After that, the user may request execution of one application from the display apparatus 100. Specifically, a plurality of applications are stored in the storage unit 120, and when the display device 100 is turned on, the controller 160 is a first application among a plurality of applications stored in the storage unit 120 by a user command. Can be executed.

In this case, a plurality of applications stored in the storage unit 120 may be executed using stream data. For example, the plurality of applications may be a camera application, a gesture recognition application, a voice recognition application, a video call application, and the like.

Meanwhile, when there is a request for execution of the first application by the user, the controller 160 may generate stream data (S610). For example, when the camera 174 is activated by the execution of the first application, the controller 160 may generate stream data for an image received through the camera 174. Similarly, when the microphone is activated by the execution of the first application, the controller 160 may generate stream data for voice received through the microphone.

Accordingly, the controller 160 may execute the first application using the generated stream data (S620). For example, when the first application is executed, the controller 160 may display an image according to the image stream data on at least a part of the display unit 171 or transmit it through the network interface unit 113. Likewise, the controller 160 may output voice according to the voice stream data to a speaker or transmit it through the network interface unit 113.

In this case, the controller 160 may perform pre-processing in a preset manner on the generated stream data, which will be described in detail with reference to FIGS. 12 to 16.

Meanwhile, after executing the first application, the user may request the display apparatus 100 to execute the second application. In this case, the controller 160 may execute the second application by using at least some of the generated stream data (S630). That is, the controller 160 may execute the second application by using at least some of the stream data generated by the execution request of the first application. In this case, the controller 160 may execute the second application by using the preprocessed stream data as it is in the execution of the first application or by performing additional preprocessing.

Meanwhile, the user may request to execute the second application at the same time as the request to execute the first application. In this case, the controller 160 generates stream data and may perform pre-processing commonly required for execution of the first application and the second application on the generated stream data. Accordingly, the controller 160 may execute the second application while executing the first application.

7 to 11 are various examples of drawings for explaining the operation of the display apparatus 100 according to an embodiment of the present invention. Hereinafter, a detailed method of executing a plurality of applications executed using stream data will be described.

Referring to FIG. 7, the display device 100 is in a turned-on state. In this case, the user may request execution of the camera application. In addition, even if there is no execution request from the user, the camera application can be automatically executed by setting.

Accordingly, the controller 160 may generate image stream data, and as shown in FIG. 7, may display an image according to the generated image stream data on the display unit 171.

Meanwhile, while the camera application is running, the user may request execution of the gesture recognition application. In this case, the controller 160 may use image stream data generated by a request for execution of the camera application. That is, the controller 160 may copy the first stream data generated by the execution of the camera application and execute the gesture recognition application by using the generated second stream data.

Therefore, as shown in FIG. 8, an image according to the execution of the camera application is displayed on the first area 171-1 of the display unit 171, and the gesture image recognized according to the execution of the gesture recognition application is displayed on the display unit ( It may be displayed in the second area 171-2 of 171.

In this case, the recognized gesture image is not displayed, and a function according to the execution of the gesture recognition application may be immediately performed. For example, it is assumed that a broadcast program for a specific channel is displayed when the user makes a gesture of opening a hand.

Accordingly, as shown in FIG. 9, an image according to execution of a camera application is displayed in the first area 171-1 of the display unit 171, and a broadcast program for a specific channel is displayed in the second area 171-2. Can be displayed. In addition, a broadcast program for a specific channel may be displayed on the entire area of the display unit 171.

As described above, when there is a request to execute the gesture recognition application while the camera application is being executed, the image stream data acquired through the camera may be simultaneously used not only to execute the camera application but also to execute the gesture recognition application. Therefore, when the execution of the second application using the same stream data is requested while the first application is being executed using the stream data, it is possible to solve a conventional problem in which execution of the previously executed first application is terminated or stopped.

Meanwhile, FIG. 10 illustrates a case in which a video call is performed. While the camera application is running, the user may request execution of the video call application. In this case, the controller 160 may use image stream data generated by a request for execution of the camera application. That is, the controller 160 may copy the first stream data generated by the execution of the camera application and execute the video call application by using the generated second stream data.

Accordingly, as illustrated in FIG. 10, images of users participating in a video call may be displayed on respective regions 171-1 and 171-2 of the display unit 171 according to the execution of the video call application.

In this case, while the video call application is being executed, the gesture recognition application may be executed. That is, it is assumed that a user makes a specific gesture while a video call is being made. As in the above example, it is assumed that when a user makes a gesture of opening a hand, a broadcast program for a specific channel is displayed.

Therefore, when a user makes a gesture of opening a hand during a video call, as shown in FIG. 11, the first and second regions 171-1 and 171-2 of the display unit 171 display images of users participating in the video call. Is displayed, and a broadcast program for a specific channel may be displayed in the third area 171-3.

As described above, when the execution of the second application using the same stream data is requested while the first application is being executed using the stream data, it is possible to solve the conventional problem that the execution of the previously executed first application is terminated or stopped. .

12 is an example of an internal block diagram of the controller 160 in the display device 100 according to an embodiment of the present invention. Hereinafter, descriptions of parts that overlap with the above description will be omitted. Referring to FIG. 12, the controller 160 includes a first module 161, a second module 162, and a third module 163.

The first module 161 may generate stream data. In this case, as described above, when execution of an application using stream data is requested, the first module 161 may generate stream data.

For example, the first module 161 may generate stream data corresponding to an image received through the camera 174. Similarly, the first module 161 may generate stream data corresponding to voice or sound received through a microphone.

Meanwhile, the second module 162 may perform pre-processing of a preset type on the stream module generated by the first module 161. In this case, the second module 162 may store a preprocessing type required for an application for which execution is requested.

For example, assuming that first and second pre-processing are required for execution of the first application, the second module 162 performs the first and second pre-processes on the stream module generated by the first module 161. You can create stream data. Similarly, assuming that the execution of the second application requires the first and third preprocessing, the second module 162 performs the first and third preprocessing on the stream module generated by the first module 161. Can be created.

Meanwhile, the pre-processing may differ depending on whether the stream data is related to an image or an audio. That is, the second module 162 may perform pre-processing such as noise removal, image synthesis, and cropping on the image stream data. In addition, the second module 162 may perform pre-processing such as noise removal, echo cancellation, and beamforming on the voice stream data. Since the above pretreatment method is known, a detailed description will be omitted. In addition, it goes without saying that pre-processing of video or audio stream data in a variety of known methods may be performed.

Meanwhile, the third module 163 may determine an application in which the preprocessed stream data is to be used. In this case, a preprocessing type required for execution of the application may be recorded in the header file of the application. Accordingly, the third module 163 may determine an application in which stream data for which a specific preprocess is performed is to be used from a header file of an application that has received an execution request.

In this way, the stream data preprocessed by the second module 162 may be used to execute an application determined by the third module 163. In the above example, the first and second applications may commonly perform the first preprocessing on the stream data generated by the first module 161. Therefore, when the execution of the first and second applications is requested at the same time, the execution of the second application is requested during execution of the first application, or the execution of the first application is requested during execution of the second application, the second module 162 may copy the stream data on which the first pre-processing has been performed in response to the execution request of the first application. Accordingly, the third module 163 may determine that the copied stream data is used to execute the second application.

Hereinafter, the above description will be described as a specific example.

13 to 16 are various examples of diagrams illustrating a process in which a preprocessing process required for execution of each application is executed in the display device 100 according to an embodiment of the present invention.

13 is a table in which a plurality of applications and types of preprocessing required for execution of each application are matched. As shown in FIG. 13, first to third pre-processing should be performed for the execution of the first application, the first pre-processing for the execution of the second application, and the first and the second pre-processing for the execution of the third application, respectively. can do.

14 illustrates a process of pre-processing stream data for execution of a plurality of applications according to the table of FIG. 13.

As shown in FIG. 14, when there is a request for execution of the first application 181, the controller 160 may sequentially perform first to third preprocessing 191 to 193 on the stream data.

Here, as shown in FIG. 13, the second application 182 requires the first pre-processing 191 for the stream data. Accordingly, when there is a request for execution of the second application 182, the second application 182 may use the first preprocessing 191 performed according to the execution request of the first application 181. That is, the controller 160 may copy the first preprocessed stream data 191 according to the execution request of the first application 181 and use it to execute the second application 182.

Similarly, as illustrated in FIG. 13, the third application 183 requires first and second preprocessing 191 and 192 for stream data. Accordingly, when there is a request for execution of the third application 183, the third application 183 may use the first and second preprocessing 191 and 192 performed according to the execution request of the first application 181. That is, the controller 160 may copy the first and second preprocessed stream data 191 and 192 according to the execution request of the first application 181 and use it to execute the third application 183.

Meanwhile, an example different from that illustrated in FIGS. 13 to 14 will be described below.

15 is a table in which a plurality of applications and types of preprocessing required for execution of each application are matched. As shown in FIG. 15, first to third preprocessing is performed in the execution of the first application 181, the first, fourth, and fifth pre-processing of the second application 182, and the third application 183 are performed. In execution, the first, fourth, and sixth preprocessing may be performed on the stream data, respectively.

16 illustrates a process of pre-processing stream data for execution of a plurality of applications according to the table of FIG. 15.

As illustrated in FIG. 16, when there is a request for execution of the first application 181, the controller 160 may sequentially perform first to third preprocessing 191 to 193 on the stream data.

Here, as shown in FIG. 15, the second application 182 requires first, fourth, and fifth pre-processing 191, 194, and 195 for stream data. When there is a request for execution of the second application 182, the second application 182 may use the first preprocessing 191 performed according to the execution request of the first application 181. That is, the controller 160 may copy the first preprocessed stream data 191 according to the execution request of the first application 181 and use it to execute the second application 182. Accordingly, the control unit 160 may perform the fourth and fifth pre-processes 194 and 195 of the stream data subjected to the first pre-processing 191 to execute the second application 182.

Similarly, as shown in FIG. 15, the third application 183 requires first, fourth, and sixth preprocessing 191, 194, and 196 for stream data. When there is a request for execution of the third application 183, the third application 183 may use the first and fourth preprocesses 191 and 194 performed according to the execution request of the second application 182. That is, the controller 160 may copy the first and fourth preprocessed stream data 191 and 194 according to the execution request of the second application 182 and use it to execute the third application 183. Accordingly, the control unit 160 can use the first and fourth preprocessed stream data 191 and 194 to execute the third application 183 by performing the sixth preprocessing 196.

The present invention described above can be implemented as a computer-readable code on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAM, CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. Also, it includes a carrier wave (for example, transmission through the Internet). In addition, the computer may include the controller 180 of the display device. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

100: display device 110: receiver
120: storage unit 130: external device interface unit
140: user input interface unit 150: command input unit
160: control unit 170: driving unit

Claims (12)

In the display device,
A storage unit for storing a plurality of applications; And
When there is a request to execute a first application among the plurality of applications, stream data according to the execution of the first application is generated, the first application is executed using the generated stream data, and a first application among the plurality of applications is 2 When there is a request to execute an application, a control unit that executes the second application using at least part of the generated stream data; includes,
The control unit,
Pre-processing the stream data according to a preset method to execute the first or second application,
The pretreatment includes a plurality of different pretreatments,
The control unit,
Matching the plurality of applications and the preprocessing type requested by each of the plurality of applications, and storing them in a table,
The control unit,
Fetching a first preprocessing type requested by the first application from the table, applying the first preprocessing type to the generated stream data,
The control unit,
The second preprocessing type requested by the second application is loaded from the table, the second preprocessing type is applied to the generated stream data to which the first preprocessing type is applied, and the first preprocessing type and the second A display device that executes the second application by using the generated stream data to which a preprocessing type is applied. The method of claim 1,
The second application,
A display device comprising a plurality of different applications. The method of claim 1,
The plurality of applications,
A display device comprising any one of a camera application, a gesture recognition application, a voice recognition application, and a video call application. delete The method of claim 1,
The stream data,
A display device comprising video stream data or audio stream data. delete The method of claim 1,
The control unit,
And applying the second preprocessing type by copying at least a part of stream data to which the first preprocessing type has been applied by executing the first application. The method of claim 1,
The control unit,
A first module generating the stream data when there is a request to execute one of the plurality of applications;
A second module that performs pre-processing of a preset type on the generated stream data; And
And a third module for determining an application in which the pre-processed stream data is to be used. The method of claim 1,
The control unit,
And determining the preprocessing type required for execution of each of the plurality of applications from a header file included in each of the plurality of applications. delete The method of claim 5,
The pretreatment is,
Including at least one of noise removal, image synthesis, and cropping of the image stream data,
And at least one of noise removal, echo cancellation, and beamforming for the voice stream data. In the control method of the display device,
Generating stream data according to execution of the first application when there is a request to execute a first application among a plurality of applications; And
Executing the first application using the generated stream data, and executing the second application using at least a portion of the generated stream data when there is a request to execute a second application among the plurality of applications; Including,
The step of executing the second application,
Executing the first or second application by pre-processing the stream data according to a preset method;
Matching the plurality of applications and a preprocessing type requested by each of the plurality of applications and storing them in a table;
Fetching a first preprocessing type requested by the first application from the table and applying the first preprocessing type to the generated stream data;
Fetching a second preprocessing type requested by the second application from the table;
Applying the second preprocessing type to the generated stream data to which the first preprocessing type has been applied; And
And executing the second application by using the generated stream data to which the first pre-processing type and the second pre-processing type are applied.

Images