KR20170090103A - Mobile device, display device and method for controlling the same - Google Patents
Mobile device, display device and method for controlling the same Download PDFInfo
- Publication number
- KR20170090103A KR20170090103A KR1020160010553A KR20160010553A KR20170090103A KR 20170090103 A KR20170090103 A KR 20170090103A KR 1020160010553 A KR1020160010553 A KR 1020160010553A KR 20160010553 A KR20160010553 A KR 20160010553A KR 20170090103 A KR20170090103 A KR 20170090103A
- Authority
- KR
- South Korea
- Prior art keywords
- mobile device
- digital
- digital device
- signal
- service
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
-
- H04L67/36—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W48/00—Access restriction; Network selection; Access point selection
- H04W48/16—Discovering, processing access restriction or access information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q2209/00—Arrangements in telecontrol or telemetry systems
- H04Q2209/40—Arrangements in telecontrol or telemetry systems using a wireless architecture
Abstract
A mobile device according to an embodiment of the present invention includes a display module, a touch sensor that senses a touch of a user, a wireless communication module that is capable of communicating with at least one of the digital devices, a display module, And a controller for controlling the module. In particular, the controller may control the wireless communication module to detect at least one or more digital devices connectable through a wireless network and to control the display module to identify each of the at least one or more detected digital devices And displays the first image data and the second image data identifying the mobile device.
Description
The present invention relates to a mobile device and a digital device (whether or not a display is provided), and particularly to a mobile device and at least one digital device in a wireless communication mode.
Recently, with the development of network technology, products related to Internet of Things (IoT) are increasing exponentially. Therefore, home-installed TVs, air conditioners, and vacuum cleaners are also equipped with wireless network functions.
However, when a mobile device searches for a digital device connectable via Wi-Fi, which is an example of a wireless network, it is difficult to determine a specific digital device to which a mobile device wants to connect because a plurality of devices have the same name there was.
An embodiment of the present invention aims to provide a technology for prioritizing and listing digital devices connectable to a mobile device according to predetermined conditions.
Another embodiment of the present invention is directed to defining a protocol that shares real-time captured image data of a retrieved digital device for faster access to a specific digital device that the mobile device is intended to connect.
Another embodiment of the present invention aims at providing a process for processing specific video or audio data in a digital device to be connected according to the touch strength (or pressure) recognized by the mobile device.
According to another embodiment of the present invention, there is provided a solution for displaying information identifying a plurality of digital devices capable of wireless communication with a mobile device on the mobile device according to a position of the plurality of digital devices, .
The technical problem to be solved by the present invention is not limited to the above-described technical problems and other technical problems which are not mentioned can be clearly understood by those skilled in the art from the following description .
A mobile device according to an embodiment of the present invention includes a display module, a touch sensor for sensing a touch of a user, a wireless communication module capable of communicating with at least one digital device, And a controller for controlling the communication module. In particular, the controller may control the wireless communication module to detect at least one or more digital devices connectable through a wireless network and to control the display module to identify each of the at least one or more detected digital devices And displays the first image data and the second image data identifying the mobile device.
A method of controlling a mobile device according to an embodiment of the present invention includes the steps of executing wireless communication, detecting at least one digital device capable of communicating through the executed wireless communication, And displaying second image data identifying the mobile device and first image data to cool each of the one or more digital devices.
According to another aspect of the present invention, there is provided a display device including: a tuner for receiving a broadcast signal; a display module for outputting video data included in the received broadcast signal; A wireless communication module capable of communicating with the mobile device, and a controller for controlling the tuner, the display module, and the wireless communication module. In particular, the controller controls the speaker in response to a first request signal received from the mobile device to output a specific audio signal, and in response to a second request signal received from the mobile device, And outputs a specific video signal.
According to an embodiment of the present invention, there is provided a technology for prioritizing and registering digital devices connectable to a mobile device according to a predetermined condition, thereby providing a technology for increasing data processing speed and reducing unnecessary memory usage It is effective.
According to another embodiment of the present invention, a protocol is defined that shares real-time captured image data of a retrieved digital device in order to enable quick access to a specific digital device to which the mobile device is to connect, And there is a technical effect that can reduce unnecessary memory usage.
According to another embodiment of the present invention, there is provided a process for processing specific video or audio data in a digital device to be connected according to a touch strength (or pressure) recognized by a mobile device, There is a technical effect that can reduce unnecessary memory usage.
According to another embodiment of the present invention, there is provided a technology for providing a solution for displaying information identifying a plurality of digital devices connectable to a mobile device in a wireless communication manner on the mobile device according to a position of the plurality of digital devices It is effective.
It should be understood, however, that the technical advantages of the present invention are not limited to those described above, and the technical effect of the present invention is also obvious to those skilled in the art based on the overall contents of the present application.
1 is a schematic diagram illustrating a service system including a digital device according to an exemplary embodiment of the present invention.
2 is a block diagram illustrating a digital device according to an exemplary embodiment of the present invention.
3 is a block diagram illustrating a digital device according to another embodiment of the present invention.
4 is a block diagram illustrating a digital device according to another embodiment of the present invention.
FIG. 5 is a block diagram illustrating a detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention. Referring to FIG.
Figure 6 is a diagram illustrating an input means coupled to the digital device of Figures 2 through 4, in accordance with an embodiment of the present invention.
7 is a diagram illustrating a Web OS architecture according to an embodiment of the present invention.
FIG. 8 is a diagram illustrating an architecture of a Web OS device according to an exemplary embodiment of the present invention. Referring to FIG.
9 is a diagram illustrating a graphical composition flow in a web OS device according to an embodiment of the present invention.
FIG. 10 is a diagram illustrating a media server according to an embodiment of the present invention. Referring to FIG.
11 is a block diagram illustrating a configuration of a media server according to an embodiment of the present invention.
FIG. 12 is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.
13 is a block diagram illustrating a mobile device and at least one digital device in accordance with one embodiment of the present invention.
14 shows a process of listing a plurality of digital devices connectable with a mobile device according to a predetermined priority according to the first embodiment of the present invention.
15 shows a GUI for displaying captured image data identifying a plurality of digital devices connectable with a mobile device, according to a second embodiment of the present invention.
Figure 16 illustrates a process for displaying captured image data identifying each of a plurality of digital devices connectable with a mobile device, according to a second embodiment of the present invention.
17 is a diagram for explaining a process of generating a different feedback signal depending on whether a digital device connectable to a mobile device is displayed according to the third embodiment of the present invention.
FIG. 18 is a diagram for explaining a process of changing IDs identifying connectable digital devices according to the strength (or pressure) of a touch recognized by the mobile device according to the third embodiment of the present invention.
19 is a flowchart illustrating a signal processing process of a mobile device and a digital device according to an embodiment of the present invention.
20 is a flowchart illustrating a method of controlling a mobile device according to an embodiment of the present invention.
FIG. 21 shows a location where a mobile device and a plurality of digital devices actually exist according to another embodiment of the present invention.
22 shows a GUI in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
23 shows a fourth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
FIG. 24 shows a fifth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
FIG. 25 shows a sixth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
FIG. 26 shows a seventh embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
Fig. 27 shows an eighth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
28 is a flowchart showing an example of a method of controlling a mobile device according to another embodiment of the present invention.
29 is a flowchart showing another example of a method of controlling a mobile device according to another embodiment of the present invention.
Hereinafter, various embodiments (s) of a digital device according to the present invention and a method of processing application data in the digital device will be described in detail with reference to the drawings.
The suffix "module "," part ", and the like for components used in the present specification are given only for ease of specification, and both may be used as needed. Also, even when described in ordinal numbers such as " 1st ", "2nd ", and the like, it is not limited to such terms or ordinal numbers.
In addition, although the terms used in the present specification have been selected from the general terms that are widely used in the present invention in consideration of the functions according to the technical idea of the present invention, they are not limited to the intentions or customs of the artisan skilled in the art, It can be different. However, in certain cases, some terms are arbitrarily selected by the applicant, which will be described in the related description section. Accordingly, it should be understood that the term is to be interpreted based not only on its name but on its practical meaning as well as on the contents described throughout this specification.
It is to be noted that the contents of the present specification and / or drawings are not intended to limit the scope of the present invention.
The term " digital device " as used herein refers to a device that transmits, receives, processes, and outputs data, content, service, And includes all devices that perform at least one or more. The digital device can be paired or connected (hereinafter, referred to as 'pairing') with another digital device, an external server, or the like through a wire / wireless network, Can be transmitted / received. At this time, if necessary, the data may be appropriately converted before the transmission / reception. The digital device may be a standing device such as a network TV, a Hybrid Broadcast Broadband TV (HBBTV), a Smart TV, an IPTV (Internet Protocol TV), a PC (Personal Computer) And a mobile device or handheld device such as a PDA (Personal Digital Assistant), a smart phone, a tablet PC, a notebook, and the like. In order to facilitate understanding of the present invention and to facilitate the description of the present invention, FIG. 2, which will be described later, describes a digital TV, and FIG. 3 illustrates and describes a mobile device as an embodiment of a digital device. In addition, the digital device described in this specification may be a configuration having only a panel, a configuration such as a set-top box (STB), a device, a system, etc. and a set configuration .
The term " wired / wireless network " as used herein collectively refers to communication networks that support various communication standards or protocols for pairing and / or data transmission / reception between digital devices or digital devices and external servers. Such a wired / wireless network includes all of the communication networks to be supported by the standard now or in the future, and is capable of supporting one or more communication protocols therefor. Such a wired / wireless network includes, for example, a USB (Universal Serial Bus), a Composite Video Banking Sync (CVBS), a Component, an S-Video (Analog), a DVI (Digital Visual Interface) A communication standard or protocol for a wired connection such as an RGB or a D-SUB, a Bluetooth standard, a radio frequency identification (RFID), an infrared data association (IrDA), an ultra wideband (UWB) (ZigBee), DLNA (Digital Living Network Alliance), WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) A long term evolution (LTE-Advanced), and Wi-Fi direct, and a communication standard or protocol for the network.
In addition, when the term is simply referred to as a digital device in this specification, the meaning may mean a fixed device or a mobile device depending on the context, and may be used to mean both, unless specifically stated otherwise.
Meanwhile, a digital device is an intelligent device that supports, for example, a broadcast receiving function, a computer function or a support, at least one external input, and the like. The digital device may be an e-mail, web browsing, Banking, game, application, and so on. In addition, the digital device may include an interface for supporting at least one input or control means (hereinafter, " input means ") such as a handwriting input device, a touch- .
In addition, the digital device can use a standardized general-purpose OS (Operating System), but in particular, the digital device described in this specification uses the Web OS as an embodiment. Therefore, a digital device can handle adding, deleting, amending, and updating various services or applications on a general-purpose OS kernel or a Linux kernel. And through which a more user-friendly environment can be constructed and provided.
Meanwhile, the above-described digital device can receive and process an external input. The external input is connected to an external input device, that is, the digital device, through the wired / wireless network, An input means or a digital device. For example, the external input may be a game device such as a high-definition multimedia interface (HDMI), a playstation or an X-Box, a smart phone, a tablet PC, a pocket photo devices such as digital cameras, printing devices, smart TVs, Blu-ray device devices and the like.
In addition, the term "server" as used herein refers to a digital device or system that supplies data to or receives data from a digital device, that is, a client, and may be referred to as a processor do. The server provides a Web server, a portal server, and advertising data for providing a web page, a web content or a web content or a web service, An advertising server, a content server for providing content, an SNS server for providing a social network service (SNS), a service server provided by a manufacturer, a video on demand (VoD) server, A service server providing a Multichannel Video Programming Distributor (MVPD) for providing a streaming service, a pay service, and the like.
In addition, in the following description for convenience of explanation, only the application is described in the context of the present invention, and the meaning may include not only the application but also the service based on the context and the like. In addition, the application may refer to a web application according to the webOS platform.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.
1 is a schematic diagram illustrating a service system including a digital device according to an exemplary embodiment of the present invention.
1, a service system includes a
The
The
The
The above-described
The
The
Meanwhile, the
In addition, the
In FIG. 1, the
2 is a block diagram illustrating a digital device according to an exemplary embodiment of the present invention.
The digital device described herein corresponds to the
The
The
The TCP /
The
The
The
The audio /
The application manager may include, for example, the
The
The
The
The
The
The
The SI &
The SI &
Meanwhile, the
3 is a block diagram illustrating a digital device according to another embodiment of the present invention.
If the above-described Fig. 2 is described with an example of a digital device as a fixing device, Fig. 3 shows a mobile device as another embodiment of a digital device.
3, the
Hereinafter, each component will be described in detail.
The
The
The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the
The broadcast-related information may exist in various forms, for example, in the form of an EPG (Electronic Program Guide) or an ESG (Electronic Service Guide).
The
The broadcast signal and / or broadcast related information received through the
The
The
The short-
The
The A /
The image frame processed by the
The
The
The
The
The
The
Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the
There may be two or
The
The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the
If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits corresponding data to the
A
Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.
Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.
The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.
The
The
The
The
The
The
The identification module is a chip for storing various information for authenticating the usage right of the
The
The
The
The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.
According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, a controller, micro-controllers, microprocessors, and an electrical unit for performing other functions. In some cases, the implementation described herein Examples may be implemented by the
According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Here, the software code is stored in the
4 is a block diagram illustrating a digital device according to another embodiment of the present invention.
Another example of the
The
For example, if the received RF broadcast signal is a digital broadcast signal, the signal is converted into a digital IF signal (DIF). If the received RF broadcast signal is an analog broadcast signal, the signal is converted into an analog baseband image or a voice signal (CVBS / SIF). That is, the
In addition, the
The
The
The stream signal output from the
The external
The external
The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog) terminal, A DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.
The wireless communication unit can perform short-range wireless communication with another digital device. The
Also, the external
Meanwhile, the external
The
The
Meanwhile, the
In addition, the
The
The
The
In addition, the
The
4 illustrates an embodiment in which the
The user
For example, the user
In addition, the user
The user
The
The video signal processed by the
The audio signal processed by the
Although not shown in FIG. 4, the
The
The
For example, the
The
On the other hand, the
In addition, the
On the other hand, when entering the application view item, the
The
Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided.
The channel browsing processing unit receives a stream signal TS output from the
The
The
Meanwhile, the
The
In order to detect the gesture of the user, a sensing unit (not shown) having at least one of a touch sensor, a voice sensor, a position sensor, and an operation sensor may be further included in the
On the other hand, a photographing unit (not shown) for photographing a user may be further provided. The image information photographed by the photographing unit (not shown) may be input to the
The
The
Particularly, it is possible to supply power to a
To this end, the
The
Also, the
The
In addition, the digital device according to the present invention may further include a configuration that omits some of the configuration shown in FIG. On the other hand, unlike the above, the digital device does not have a tuner and a demodulator, and can receive and reproduce the content through the network interface unit or the external device interface unit.
FIG. 5 is a block diagram illustrating a detailed configuration of the control unit of FIGS. 2 to 4 according to an embodiment of the present invention. Referring to FIG.
An example of the control unit includes a
The
The
The video decoder 425 decodes the demultiplexed video signal, and the
The
On the other hand, the video signal decoded by the
The
The
A frame rate conversion unit (FRC) 555 converts a frame rate of an input image. For example, the frame
The
On the other hand, the voice processing unit (not shown) in the control unit can perform the voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing various audio formats. For example, even when a voice signal is coded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, or BSAC, a corresponding decoder can be provided.
In addition, the voice processing unit (not shown) in the control unit can process the base, the treble, the volume control, and the like.
A data processing unit (not shown) in the control unit can perform data processing of the demultiplexed data signal. For example, the data processing unit can decode the demultiplexed data signal even when it is coded. Here, the encoded data signal may be EPG information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.
On the other hand, the above-described digital device is an example according to the present invention, and each component can be integrated, added, or omitted according to specifications of a digital device actually implemented. That is, if necessary, two or more components may be combined into one component, or one component may be divided into two or more components. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and devices thereof do not limit the scope of rights of the present invention.
Meanwhile, the digital device may be a video signal processing device that performs signal processing of an image stored in the device or an input image. Other examples of the video signal processing device include a set-top box (STB), a DVD player, a Blu-ray player, a game device, a computer Etc. can be further exemplified.
FIG. 6 is a diagram illustrating input means coupled to the digital device of FIGS. 2 through 4 according to one embodiment of the present invention.
A front panel (not shown) or a control means (input means) provided on the
The control means includes a
The input means may be a communication protocol such as Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (UDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA) At least one can be employed as needed to communicate with the digital device.
The
The
Since the
On the other hand, the control means such as the
The digital device described in this specification uses the Web OS as an OS and / or platform. Hereinafter, the processing such as the configuration or algorithm based on the web OS can be performed in the control unit of the above-described digital device or the like. Here, the control unit includes the control unit in FIGS. 2 to 5 described above and uses it as a broad concept. Accordingly, in order to process services, applications, contents, and the like related to the web OS in the digital device, the hardware and components including related software, firmware, and the like are controlled by a controller Named and explained.
Such a web OS-based platform is intended to enhance development independence and function expandability by integrating services, applications, and the like based on, for example, a luna-service bus, Productivity can be increased. Also, multi-tasking can be supported by efficiently utilizing system resources and the like through a Web OS process and resource management.
Meanwhile, the web OS platform described in this specification can be used not only in fixed devices such as a PC, a TV, and a set-top box (STB) but also in mobile devices such as mobile phones, smart phones, tablet PCs, notebooks, wearable devices .
The structure of the software for digital devices is based on a single process and a closed product based on multi-threading with conventional problem solving and market-dependent monolithic structure, And has been pursuing new platform-based development since then, has pursued cost innovation through chip-set replacement, UI application and external application development efficiency, and developed layering and componentization Layer structure and an add-on structure for add-ons, single-source products, and open applications. More recently, the software architecture provides a modular architecture for functional units, a Web Open API (Application Programming Interface) for echo-systems, and a game engine And a native open API (Native Open API), and thus, a multi-process structure based on a service structure is being created.
7 is a diagram illustrating a Web OS architecture according to an embodiment of the present invention.
Referring to FIG. 7, the architecture of the Web OS platform will be described as follows.
The platform can be largely divided into a kernel, a system library based Web OS core platform, an application, and a service.
The architecture of the Web OS platform is layered structure, with the OS at the lowest layer, the system library (s) at the next layer, and the applications at the top.
First, the lowest layer includes a Linux kernel as an OS layer, and can include Linux as an OS of the digital device.
The OS layer is provided with a BOS (Board Support Package) / HAL (Hardware Abstraction Layer) layer, a Web OS core modules layer, a service layer, a Luna-Service layer Bus layer, Native Developer's Kit (NDK) / QT layer (Enyo framework / NDK / QT layer), and Application layer in the uppermost layer.
Meanwhile, some layers of the above-described web OS layer structure may be omitted, and a plurality of layers may be one layer, or one layer may be a plurality of layer structures.
The web OS core module layer is composed of a Luna Surface Manager (LSM) for managing surface windows and the like, a System & Application Manager (SAM) for managing the execution and execution status of applications, and a WebKit And a WAM (Web Application Manager) for managing web applications and the like.
The LSM manages an application window displayed on the screen. The LSM manages display hardware (Display HW) and provides a buffer for rendering contents necessary for applications. The LSM composes the results of rendering by a plurality of applications, Can be output.
The SAM manages various conditional execution policies of the system and the application.
WAM, on the other hand, is based on the Enyo Framework, which can be regarded as a basic application for web applications.
The use of an application's service is done via a luna-service bus, a new service can be registered on the bus, and an application can find and use the service it needs.
The service layer may include various service level services such as TV service and Web OS service. Meanwhile, the web OS service may include a media server, a Node.JS, and the like. In particular, the Node.JS service supports, for example, javascript.
Web OS services can communicate over a bus to a Linux process that implements function logic. It can be divided into four parts. It is developed from TV process and existing TV to Web OS, services that are differentiated by manufacturer, service which is manufacturer's common service and JavaScript, and is used through Node.js Node.js service.
The application layer may include all applications that can be supported in a digital device, such as a TV application, a showcase application, a native application, a web application, and the like.
An application on the Web OS can be divided into a Web application, a PDK (Palm Development Kit) application, a QT (Qt Meta Language or Qt Modeling Language) application and the like depending on an implementation method.
The web application is based on a WebKit engine and is executed on a WAM runtime. These web applications can be based on the ENI framework, or they can be developed and implemented on the basis of regular HTML5, CSS (Cascading Style Sheets), and JavaScript.
The PDK application includes a native application developed in C / C ++ based on a PDK provided for third-party or external developers. The PDK refers to a development library and a tool set provided for a third party such as a game to develop a native application (C / C ++). For example, PDK applications can be used to develop applications where performance is critical.
The QML application is a Qt-based native application and includes a basic application provided with a web OS platform such as a card view, a home dashboard, a virtual keyboard, and the like. Here, QML is a mark-up language in the form of a script instead of C ++.
In the meantime, the native application is an application that is developed and compiled in C / C ++ and executed in a binary form. The native application has a high speed of execution.
FIG. 8 is a diagram illustrating an architecture of a Web OS device according to an exemplary embodiment of the present invention. Referring to FIG.
8 is a block diagram based on the runtime of the Web OS device, which can be understood with reference to the layered structure of FIG.
The following description will be made with reference to FIGS. 7 and 8. FIG.
Referring to FIG. 8, services and applications and WebOS core modules are included on the system OS (Linux) and system libraries, and communication between them can be done via the Luna-Service bus.
E-mail, contact, calendar, etc. Node.js services based on HTML5, CSS, java script, logging, backup, file notify notify, database (DB), activity manager, system policy, audio daemon (AudioD), update, media server, TV services such as Electronic Program Guide (PVD), Personal Video Recorder (PVR), data broadcasting, voice recognition, Now on, Notification, search, , CP services such as Auto Content Recognition (ACR), Contents List Browser (CBOX), wfdd, DMR, Remote Application, download, Sony Philips Digital Interface Format (SDPIF), PDK applications, , QML applications, etc. And the enyo framework based on the TV UI-related applications and web applications, Luna - made the process via the Web OS core modules, such as the aforementioned SAM, WAM, LSM via the service bus. Meanwhile, in the above, TV applications and web applications may not necessarily be UI-based or UI-related.
CBOX can manage the list and metadata of external device contents such as USB, DLNA, cloud etc. connected to TV. Meanwhile, the CBOX can output a content listing of various content containers such as a USB, a DMS, a DVR, a cloud, etc. to an integrated view. In addition, CBOX can display various types of content listings such as pictures, music, video, and manage the metadata. In addition, the CBOX can output the contents of the attached storage in real-time. For example, when a storage device such as a USB is plugged in, the CBOX must be able to immediately output the content list of the storage device. At this time, a standardized method for processing the content listing may be defined. In addition, CBOX can accommodate various connection protocols.
The SAM is intended to improve module complexity and scalability. For example, the existing system manager processes various functions such as system UI, window management, web application runtime, and UX constraint processing in one process to separate the main functions to solve the large implementation complexity, Clarify the implementation interface by clarifying the interface.
LSM supports independent development and integration of system UX implementations such as card view, launcher, etc., and supports easy modification of product requirements. LSM can make multi-tasking possible by utilizing hardware resources (HW resources) when synthesizing a plurality of application screens such as an application in-app, A window management mechanism can be provided.
LSM supports implementation of system UI based on QML and improves its development productivity. Based on MVC, QML UX can easily construct views for layouts and UI components, and can easily develop code for handling user input. On the other hand, the interface between the QML and the Web OS component is via the QML extension plug-in, and the graphic operation of the application can be based on the wayland protocol, luna-service call, etc. have.
LSM is an abbreviation of Luna Surface Manager, as described above, which functions as an Application Window Compositor.
LSM synthesizes independently generated applications, UI components, etc. on the screen and outputs them. In this regard, when components such as recents applications, showcase applications, launcher applications, etc. render their own contents, the LSM defines the output area, interworking method, etc. as a compositor. In other words, the compositor LSM handles graphics synthesis, focus management, input events, and so on. At this time, the LSM receives events, focus, etc. from the input manager. These input managers can include HIDs such as remote controllers, mouse & keyboards, joysticks, game pads, application remotes, and pen touches.
As such, LSM supports multiple window models, which can be performed simultaneously in all applications due to the nature of the system UI. In this regard, it is also possible to provide various functions such as launcher, resent, setting, notification, system keyboard, volume UI, search, finger gesture, Voice Recognition (STT (Sound to Text), TTS LSM can support a pattern gesture (camera, mobile radio control unit (MRCU), live menu, ACR (Auto Content Recognition), etc.) .
9 is a diagram illustrating a graphic composition flow in a web OS device according to an embodiment of the present invention.
9, the graphic composition processing includes a
When the web application-based graphic data (or application) is generated as a UI process in the
The
On the other hand, the full-screen application is passed directly to the
The graphical manager processes all the graphic data in the web OS device, including the data through the LSM GM surface described above, the data through the WAM GM surface, as well as the GM surface such as data broadcasting application, caption application, And processes the received graphic data appropriately on the screen. Here, the functions of the GM compositor are the same or similar to those of the compositor described above.
FIG. 10 is a view for explaining a media server according to an embodiment of the present invention, FIG. 11 is a view for explaining a configuration block diagram of a media server according to an embodiment of the present invention, and FIG. 12 Is a diagram illustrating a relationship between a media server and a TV service according to an embodiment of the present invention.
The media server supports the execution of various multimedia in the digital device and manages the necessary resources. The media server can efficiently use hardware resources required for media play. For example, the media server requires an audio / video hardware resource for multimedia execution and can efficiently utilize the resource usage status by managing it. In general, a fixed device having a larger screen than a mobile device needs more hardware resources to execute multimedia, and a large amount of data must be encoded / decoded and transmitted at a high speed. On the other hand, the media server is a task that performs broadcasting, recording and tuning tasks in addition to streaming and file-based playback, recording simultaneously with viewing, and simultaneously displaying the sender and recipient screens at the time of video call And so on. However, the media server is limited in terms of hardware resources such as an encoder, a decoder, a tuner, and a display engine, and thus it is difficult to execute a plurality of tasks at the same time. For example, And processes it.
The media server may be robust in system stability because, for example, a pipeline in which an error occurs during media playback can be removed and restarted on a per-pipeline basis, Even if it does not affect other media play. Such a pipeline is a chain that links each unit function such as decoding, analysis, and output when a media reproduction request is made, and the necessary unit functions may be changed according to a media type and the like.
The media server may have extensibility, for example, adding a new type of pipeline without affecting existing implementations. As an example, the media server may accommodate a camera pipeline, a video conference (Skype) pipeline, a third-party pipeline, and the like.
The media server can process general media playback and TV task execution as separate services because the interface of the TV service is different from the case of media playback. In the above description, the media server supports operations such as 'setchannel', 'channelup', 'channeldown', 'channeltuning', and 'recordstart' in relation to the TV service, ',' stop ', and so on, so that they can support different operations for both, and can be processed as separate services.
The media server can control or integrally manage the resource management function. The allocation and recall of hardware resources in the device are performed integrally in the media server. In particular, the TV service process transfers the running task and the resource allocation status to the media server. The media server obtains resources and executes the pipeline each time each media is executed, and permits execution by a priority (e.g., policy) of the media execution request, based on the resource status occupied by each pipeline, and And performs resource recall of other pipelines. Here, the predefined execution priority and necessary resource information for the specific request are managed by the policy manager, and the resource manager can communicate with the policy manager to process the resource allocation, the number of times, and the like.
The media server may have an identifier (ID) for all playback related operations. For example, the media server may issue a command to indicate a particular pipeline based on the identifier. The media server may separate the two into pipelines for playback of more than one media.
The media server may be responsible for playback of the HTML 5 standard media.
In addition, the media server may follow the TV restructuring scope of the TV pipeline as a separate service process. The media server can be designed regardless of the TV restructuring scope. If the TV is not a separate service process, it may be necessary to re-execute the entire TV when there is a problem with a specific task.
The media server is also referred to as uMS, i.e., a micro media server. Here, the media player is a media client, which is a media client, for example, a web page for an HTML5 video tag, a camera, a TV, a Skype, a second screen, It can mean a kit (Webkit).
In the media server, management of micro resources such as a resource manager, a policy manager, and the like is a core function. In this regard, the media server also controls the playback control role for the web standard media content. In this regard, the media server may also manage pipeline controller resources.
Such a media server supports, for example, extensibility, reliability, efficient resource usage, and the like.
In other words, the uMS or media server may be a web OS device, such as a resource, such as a cloud game, a MVPD (pay service), a camera preview, a second screen, a Skype, And manage and control the use of resources for proper processing in an overall manner so as to enable efficient use. On the other hand, each resource uses, for example, a pipeline in its use, and the media server can manage and control the generation, deletion, and use of a pipeline for resource management as a whole.
Here, the pipeline refers to, for example, when a media associated with a task starts a series of operations, such as parsing of a request, a decoding stream, and a video output, . For example, with respect to a TV service or an application, watching, recording, channel tuning, and the like are each individually handled under the control of resource utilization through a pipeline generated according to the request .
The processing structure and the like of the media server will be described in more detail with reference to FIG.
10, an application or service is connected to a
The application or service can have various clients depending on its characteristics and can exchange data with the
The client includes, for example, a uMedia client (web kit) and a RM (resource manager) client (C / C ++) for connection with the
The application including the uMedia client is connected to the
Here, the video operation relates to the video state, and the loading, unloading, play, playback, or reproduce, pause, stop, Data may be included. Each operation or state of such video can be processed through individual pipeline generation. Accordingly, the uMedia client sends the state data associated with the video operation to the
The
On the other hand, the
The
In addition, the pipeline may include, for example, a service-based pipeline (its own pipeline) and a URI-based pipeline (media pipeline).
Referring to FIG. 10, an application or service including an RM client may not be directly connected to the
Accordingly, the application or service can respond to the request of the RM client by receiving the resource management of the
On the other hand, the URI-based pipeline is performed through the
On the other hand, the interface method between application and media services may be as follows.
It is a way to interface with a service in a web application. This is a way of using Luna Call using the Palm Service Bridge (PSB), or using Cordova, which extends the display to video tags. In addition, there may be a method using the HTML5 standard for video tags or media elements.
And, it is a method of interfacing with PDK using service.
Alternatively, it is a method of using the service in the existing CP. It can be used to extend existing platform plug-ins based on Luna for backward compatibility.
Finally, it is a way to interface in the case of non-web OS. In this case, you can interface directly by calling the Luna bus.
Seamless change is handled by a separate module (eg TVWIN), which is the process for displaying and streamlining the TV on the screen without Web OS, before or during WebOS boot . This is because the boot time of WebOS is delayed, so it is used to provide the basic function of the TV service first for quick response to the user's power on request. In addition, the module is part of the TV service process and supports quick boot and null change, which provides basic TV functions, and factory mode. In addition, the module may also switch from the Non-Web OS mode to the Web OS mode.
Referring to FIG. 11, a processing structure of a media server is shown.
11, the solid line box represents the process processing configuration, and the dashed box represents the internal processing module during the process. In addition, the solid line arrows represent inter-process calls, that is, Luna service calls, and the dotted arrows may represent notifications or data flows such as register / notify.
A service or a web application or a PDK application (hereinafter 'application') is connected to various service processing components via a luna-service bus, through which an application is operated or controlled.
The data processing path depends on the type of application. For example, when the application is image data related to the camera sensor, the image data is transmitted to the
Alternatively, when the application includes audio data, the audio processing unit (AudioD) 1140 and the audio module (PulseAudio) 1150 can process the audio. For example, the
Alternatively, when the application includes or processes (includes) DRM-attached content, the DRM service processing unit 1170 transmits the content data to the DRM
Hereinafter, processing in the case where the application is media data or TV service data (e.g., broadcast data) will be described.
FIG. 12 shows only the media server processing unit and the TV service processing unit in FIG. 11 described above in more detail.
Therefore, the following description will be made with reference to FIGS. 11 and 12. FIG.
First, when the application includes TV service data, it is processed in the TV
The TV
In this specification, the TV service processing unit may have a configuration as shown in Fig. 11 or 12, or may be implemented by a combination of both, in which some configurations are omitted or some configurations not shown may be added.
The TV
Alternatively, a json (JavaScript standard object notation) file or a file created in c is processed by a TV broadcast handler and transmitted to a TV pipeline manager through a TV broadcast interface to generate and process a TV pipeline. In this case, the TV broadcast interface unit may transmit the data or the file that has passed through the TV broadcast handler to the TV pipeline manager based on the TV service policy and refer to it when creating the pipeline.
On the other hand, the TV pipeline manager can be controlled by the TV resource manager in generating one or more pipelines according to a TV pipeline creation request from a processing module in a TV service, a manager, or the like. Meanwhile, the TV resource manager can be controlled by the TV policy manager to request the status and allocation of resources allocated for the TV service according to the TV pipeline creation request of the TV pipeline manager, and the media
Meanwhile, the BSP supports, for example, backward compatibility with existing digital devices.
The TV pipelines thus generated can be appropriately operated according to the control of the path manager in the process. The path manager can determine and control the processing path or process of the pipelines by considering not only the TV pipeline but also the operation of the pipeline generated by the media
Next, when the application includes media data, rather than TV service data, it is processed by the media
In this specification, the resource manager in the media
13 is a block diagram illustrating a mobile device and at least one digital device in accordance with one embodiment of the present invention. The
The
The
The
In particular, the
For example, unlike the prior art, the image data is received from each
Further, the image data received from the first
When specific image data among image data identifying each of the at least one detected digital device is selected through the
Further, the
The
The
The
Particularly, the
Further, the
The data to be displayed may be output through at least one of the
Therefore, according to an embodiment of the present invention, a mobile device can list up a connectable digital device having a high priority based on at least one of the same network, existence of connection history, and signal strength among digital devices searched through a wireless network .
Further, according to another embodiment of the present invention, by designing the searched device (digital device) to capture a screen being output and transmitting the screen to the searched device (mobile device), the mobile device can display the current state of the connectable digital device There is a technical effect that can be confirmed in real time. However, it is another feature of the present invention that, in consideration of a digital device without a display, in this case, a photograph of the corresponding model is transmitted.
According to another embodiment of the present invention, when a searched device is selected, a specific indication is displayed on the screen of the searched device to give a feedback effect. However, another feature of the present invention is that, in consideration of a digital device without a display, in this case, it is designed to generate specific audio data as a feedback signal.
As a result, there is a technical effect of increasing the processing speed of connecting to a specific digital device using a mobile device and increasing the accuracy of guaranteeing connection to a specific digital device desired by the user.
14 shows a process of listing a plurality of digital devices connectable with a mobile device according to a predetermined priority according to the first embodiment of the present invention.
As shown in FIG. 14, when the mobile device 1400 turns on the wireless network function, an ID identifying each of a plurality of connectable
For example, for each of the retrieved devices (digital devices), priority is given to each searched device by checking whether they are connected through the same network, whether or not there is a previously connected history, and signal strength.
More specifically, for example, a digital device having a history (history) connected to the same network and having a previously connected history is given the highest priority, and if there are a plurality of digital devices having the same condition, .
Furthermore, when displaying each of the connectable digital devices, it is also within the scope of the present invention to adjust not only the position but also the font size and color of the name or ID corresponding to each digital device.
The first
The third
Finally, since the fifth digital device 1450 and the sixth
15 shows a GUI for displaying captured image data identifying a plurality of digital devices connectable with a mobile device, according to a second embodiment of the present invention.
As described above, one of the problems in the related art is that it is difficult for the user to display a desired digital device by simply displaying the name of the connectable digital device. Even the same name is displayed for multiple connectable digital devices.
On the other hand, according to the second embodiment shown in FIG. 15, when the
The
However, for a digital device that does not have a display or a screen, it can be solved by receiving and displaying a representative model photograph stored in each memory.
For example, when displaying a connectable external digital device, the
Further, there is a possibility that the screen displayed on the digital device having the display and the captured image data displayed on the
The specific data format required for implementing the above-described embodiment in FIG. 15 will be described later with reference to FIG.
Figure 16 illustrates a process for displaying captured image data identifying each of a plurality of digital devices connectable with a mobile device, according to a second embodiment of the present invention.
In order for two devices (for example, a mobile device and a digital device) to search (wireless communication connection) with each other, when a device to be searched broadcasts a packet called probe request, the device receiving the probe request transmits a probe response And transmits the packet to the mobile device as a device to be searched.
In the probe response packet, the mac information, the listen channel information, and the device name of the corresponding device are included. In particular, according to the embodiment of the present invention, it is designed to transmit the captured image data of the current screen together.
That is, as shown in FIG. 16A, the
However, even in the above-described embodiment, if the same channel is being watched on, for example, a plurality of TVs, the same captured image data will be displayed on the mobile device. In such a case, it is expected that the user will have difficulty in specifying the TV to be connected. The solution for solving this will be described later in more detail in Fig. 17 and Fig.
17 is a diagram for explaining a process of generating a different feedback signal depending on whether a digital device connectable to a mobile device is displayed according to the third embodiment of the present invention.
The third embodiment is advantageous in that when a specific device to be connected is selected, a specific indication is displayed on the selected device, thereby giving a feedback effect in advance.
As shown in Fig. 17 (a), the
For example, when selecting the
That is, when the specific projector 17012 shown in FIG. 17 (a) is selected, the
17, the case of selecting a specific device is not separately described. However, only when a touch is recognized under a predetermined strength (pressure), it is implemented as shown in FIG. 17 (b) or (c) It is also within the scope of the present invention to design a communication connection with the digital device immediately without a feedback signal.
FIG. 18 is a diagram for explaining a process of changing IDs identifying connectable digital devices according to the strength (or pressure) of a touch recognized by the mobile device according to the third embodiment of the present invention.
As shown in Fig. 18 (a), the
On the other hand, as shown in FIG. 18 (b), the
19 is a flowchart illustrating a signal processing process of a mobile device and a digital device according to an embodiment of the present invention.
In order for the two
Accordingly, the device (mobile device) 1900 receiving the probe response can know information such as the MAC information, the listen channel, and the device name of the corresponding device based on the information in the packet, (S1903). As described above, unlike the prior art, the displayed list is designed to include the currently captured image data of the connectable digital device.
If the name of the specific device is mildly touched within the searched list (S1904), the
The
20 is a flowchart illustrating a method of controlling a mobile device according to an embodiment of the present invention. With reference to the previous drawings, those skilled in the art can supplement the flow chart shown in Fig.
The mobile device according to an embodiment of the present invention performs wireless communication (S2010), and displays image data identifying each of at least one or more digital devices capable of communicating through the wireless communication performed (S2020).
The mobile device determines whether specific image data among the image data identifying each of the at least one or more digital devices is selected (S2030).
If the determination result is YES, at least one of video data or audio data for notification is transmitted to a specific digital device corresponding to the specific image data (S2040).
Although not shown in FIG. 20, according to another embodiment of the present invention, it is possible to further include receiving the image data from each of the digital devices.
20, according to another embodiment of the present invention, the image data received from the first digital device having the display may correspond to the captured image data of the current screen being output through the display And the image data received from the second digital device having no display corresponds to the image data previously stored in the memory of the second digital device.
13 to 20, a process of capturing and outputting a screen currently being output in each digital device in the process of searching for an external digital device connectable to a wireless communication according to an embodiment of the present invention has been described in detail have.
21, which will be described later, describes a process of reflecting the actual position of each digital device in the process of searching for an external digital device capable of wireless communication connection, according to another embodiment of the present invention I will. Of course, those skilled in the art can combine the embodiment described in FIGS. 13 to 20 with another embodiment described later in FIGS. 21 to 29, which is also within the scope of the present invention.
FIG. 21 shows a location where a mobile device and a plurality of digital devices actually exist according to another embodiment of the present invention.
As shown in FIG. 21, a plurality of digital devices are located in a house or a building. Accordingly, the
22 shows a GUI in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
First, the
The functions of the respective components will be described in detail with reference to FIG.
The
The
Particularly, the feature of the present invention resides in that the position where the first image data and the second image data shown in Fig. 22 are displayed is changed according to the signal intensity recognized in the course of detec- tion of each of the digital devices by the mobile device Change.
An embodiment for indicating the position of each digital device capable of communicating with the mobile device according to the signal strength will be described later in more detail in Fig. However, an embodiment for supplementing the above will be described later in more detail with reference to FIG.
Further, the
The
On the other hand, when the specific digital device is selected to exceed the predetermined touch pressure, the
Further, as shown in FIG. 22, the
When the
When the
When the
23 shows a fourth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
As shown in FIG. 23 (a), the
Thus, for example, if the
Meanwhile, as shown in FIG. 23B, the
Thus, for example, if the
FIG. 24 shows a fifth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
As shown in FIG. 24A, when the
24 (a), when the mobile device according to another embodiment of the present invention recognizes the touch of the
FIG. 25 shows a sixth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
25, the mobile device 2500 according to another embodiment of the present invention may include a
FIG. 26 shows a seventh embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
First, suppose that the B digital device and the F digital device disappear in Fig. Even if any one of the wireless communication-enabled digital devices stored in the memory is searched, a map stored in the memory is displayed.
However, if it is ascertained that any digital device is not capable of wireless communication, the
Fig. 27 shows an eighth embodiment in which a mobile device according to another embodiment of the present invention displays a plurality of digital devices according to their locations.
When there are a large number of digital devices capable of wireless communication in the home, there is a limitation in displaying them in the portrait mode of the mobile device. A solution to this problem corresponds to the eighth embodiment of FIG.
For example, when the
On the other hand, when the
28 is a flowchart showing an example of a method of controlling a mobile device according to another embodiment of the present invention.
23, when the
In response to the received probe request signal, the digital device 2810 displays its name or simply outputs a blinking LED signal or a specific sound (S2802).
Meanwhile, the digital device 2810 transmits a probe response signal to the mobile device 2800 (S2803), and the
29 is a flowchart showing another example of a method of controlling a mobile device according to another embodiment of the present invention. Those skilled in the art will be able to make additional interpretations with reference to the preceding figures.
The mobile device according to another embodiment of the present invention executes wireless communication (S2910), and detects at least one digital device capable of communicating through the executed wireless communication (S2920).
In operation S2930, the first image data for detecting each of the detected at least one digital device and the second image data for identifying the mobile device are displayed.
The position where the first image data and the second image data are displayed is changed according to the intensity of the recognized signal in the process of detec- tion of each of the digital devices by the mobile device. In this regard, a redundant description as described above in detail with reference to FIG. 24 is omitted.
Although not shown in FIG. 29, it is possible to further include recognizing a command to select a specific digital device among the connectable at least one digital device.
In addition, the mobile device according to another embodiment of the present invention transmits a first message to the specific digital device when the specific digital device is selected to be equal to or less than a preset touch pressure, If overpressure is selected, it is designed to transmit the second message to the particular digital device. The first message and the second message are different and are described above in connection with FIG.
29, a display device capable of wireless communication with a mobile device includes a tuner, a display module, a speaker, a wireless communication module, and a controller that can control them. Those skilled in the art will be able to interpret it with reference to FIG.
The tuner receives a broadcast signal, and the display module outputs video data included in the received broadcast signal.
The speaker outputs the audio data included in the received broadcast signal, and the wireless communication module is designed to be able to communicate with the mobile device according to another embodiment of the present invention.
In particular, the controller controls the speaker in response to a first request signal received from the mobile device to output a specific audio signal, and in response to a second request signal received from the mobile device, And outputs a specific video signal. The first request signal is generated, for example, when the mobile device recognizes a touch under a predetermined touch pressure, and the second request signal is generated when the mobile device recognizes a touch with a predetermined touch pressure exceeding Is generated in one case. This has been described above in FIG. 23 above.
Meanwhile, the operation method of the digital device disclosed in this specification can be implemented as a code readable by a processor in a recording medium readable by a processor included in the digital device. The processor-readable recording medium includes all kinds of recording devices in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include ROM (Read Only Memory), RAM (Random Access Memory), CD-ROM, magnetic tape, floppy disk, optical data storage device, And may be implemented in the form of a carrier-wave. In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Of the right. Further, such modifications are not to be understood individually from the technical idea of the present invention.
1300: Mobile device
1301: Display module
1302: Touch sensor
1303: Wireless communication module
1304: Controller
1310, 1320, 1330: Digital device
1321: Tuner
1322: Display module
1323: Speaker
1324: Wireless communication module
1325: Controller
Claims (11)
A display module;
A touch sensor for sensing a touch of a user;
A wireless communication module capable of communicating with at least one digital device;
And a controller for controlling the display module, the touch sensor, and the wireless communication module,
The controller comprising:
Controlling the wireless communication module to detect at least one digital device connectable via a wireless network,
Controls the display module to display first image data identifying each of the at least one or more detected digital devices and second image data identifying the mobile device.
Wherein the position at which the first image data and the second image data are displayed,
Wherein the mobile device changes according to a recognized signal intensity in the process of detecting each of the digital devices.
The touch sensor includes:
And recognizes a command to select a particular digital device among at least one or more digital devices connectable via the wireless network.
If the particular digital device is selected to be below a predetermined touch pressure,
The controller comprising:
And controls the wireless communication module to transmit the first message to the specific digital device.
If the particular digital device is selected to exceed the preset touch pressure,
The controller comprising:
Wherein the first message and the second message are different from each other by controlling the wireless communication module to transmit a second message to the specific digital device.
Executing wireless communication;
Detecting at least one digital device capable of communicating through the executed wireless communication; And
Displaying the first image data to browse each of the at least one or more detected digital devices and the second image data to identify the mobile device
And a control unit for controlling the mobile device.
Wherein the position at which the first image data and the second image data are displayed,
Wherein the mobile device is changed according to a recognized signal intensity in the process of detecting each of the digital devices.
Recognizing a command for selecting a specific digital device among the connectable at least one digital device
The method comprising the steps of:
Transmitting a first message to the particular digital device if the particular digital device is selected to be below a predetermined touch pressure; And
And transmitting a second message to the particular digital device if the particular digital device is selected to exceed a predetermined touch pressure,
Wherein the first message and the second message are different from each other.
A tuner for receiving a broadcast signal;
A display module for outputting video data included in the received broadcast signal;
A speaker for outputting audio data included in the received broadcast signal;
A wireless communication module capable of communicating with a mobile device; And
A controller for controlling the tuner, the display module, and the wireless communication module,
The controller comprising:
In response to a first request signal received from the mobile device, controlling the speaker to output a specific audio signal,
And controls the display module to output a specific video signal in response to a second request signal received from the mobile device.
Wherein the first request signal is generated when the mobile device recognizes the touch at a predetermined touch pressure or less,
Wherein the second request signal is generated when the mobile device recognizes the touch with a predetermined touch pressure exceeding the predetermined value.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160010553A KR20170090103A (en) | 2016-01-28 | 2016-01-28 | Mobile device, display device and method for controlling the same |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160010553A KR20170090103A (en) | 2016-01-28 | 2016-01-28 | Mobile device, display device and method for controlling the same |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20170090103A true KR20170090103A (en) | 2017-08-07 |
Family
ID=59653919
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160010553A KR20170090103A (en) | 2016-01-28 | 2016-01-28 | Mobile device, display device and method for controlling the same |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20170090103A (en) |
-
2016
- 2016-01-28 KR KR1020160010553A patent/KR20170090103A/en unknown
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101567832B1 (en) | Digital device and method for controlling the same | |
KR102413328B1 (en) | Main speaker, sub speaker and system comprising main speaker and sub speaker | |
KR101632221B1 (en) | Digital device and method for processing service thereof | |
KR20160066268A (en) | Multimedia device and method for controlling the same | |
KR102364674B1 (en) | Display device, and controlling method thereof | |
KR20160023089A (en) | Digital device and method for controlling the same | |
KR20160062417A (en) | Multimedia device and method for controlling the same | |
KR20170031370A (en) | Mobile terminal and method for controlling the same | |
KR102381141B1 (en) | Display device and method for controlling the same | |
KR102367882B1 (en) | Digital device and method of processing application data thereof | |
KR20170090102A (en) | Digital device and method for controlling the same | |
KR102396035B1 (en) | Digital device and method for processing stt thereof | |
KR20170087307A (en) | Display device and method for controlling the same | |
KR102356780B1 (en) | Display device and method for controlling the same | |
KR20170126645A (en) | Digital device and controlling method thereof | |
KR20170092408A (en) | Digital device and method for controlling the same | |
KR20170138788A (en) | Digital device and controlling method thereof | |
KR20160048430A (en) | Digital device and method of processing data thereof | |
KR20200079026A (en) | A digital device and method for controlling the same | |
KR20170059094A (en) | Digital device and method for controlling the same | |
KR20170075486A (en) | Digital device and method for controlling the same | |
KR20150101902A (en) | Digital device and method of controlling thereof | |
KR20160028226A (en) | Display device and method of processing content thereof | |
KR20170090103A (en) | Mobile device, display device and method for controlling the same | |
KR102268751B1 (en) | Digital device and method for controlling the same |