KR102471913B1 - Digital device and method of processing data the same - Google Patents

Abstract

In this specification, a digital device and a data processing method in the digital device are disclosed. Here, the digital device according to an embodiment of the present invention includes a memory for storing key mapping data related to text data input by a user using a keyboard, a keyboard output request, and a user interface unit for receiving a first touch input with respect to the keyboard. , an output unit that outputs a text window including text data according to the requested keyboard and the first touch input on a screen, and the received first touch input corresponds to a first key button and a second key button in the keyboard and a controller configured to determine one key button by referring to the stored key mapping data and control the output unit to output grapheme data corresponding to the determined key button on the text window.

Description

Digital device and data processing method in the digital device {DIGITAL DEVICE AND METHOD OF PROCESSING DATA THE SAME}

The present invention relates to a digital device, and more particularly, when data is input using a virtual keyboard in a digital device, it meets the user's intention and typographical errors occur. It is about data processing to minimize.

Following the development of conventional standing devices such as PCs (Personal Computers) and TVs (Televisions), recently mobile devices such as smart phones, tablet PCs, and wearable devices ( The development of mobile devices is remarkable. Along with the development of these mobile devices, mutual data communication and technology development related thereto are actively developed according to the boom of digital convergence.

Recently, a mobile device plays a central role in data communication with other device(s), but has a small display size compared to a conventional PC or TV, and thus has inconvenience in data input function. In order to improve this, a virtual keyboard similar to a physical keyboard used in a PC is used. Due to the limitation of the display size itself, in using the virtual keyboard, between key buttons There is a problem in that inputs frequently occur unintended by the user or due to typos due to intervals between .

In the present specification, a digital device and a data processing method in the digital device are disclosed in order to solve the above problems.

In a digital device using a virtual keyboard, the present invention minimizes typographical error probability in response to a user's input to key button(s) of the virtual keyboard, One task is to process to meet the user's intention.

Another object of the present invention is to perform adaptive processing according to circumstances by updating key mapping data according to key button input through learning in units of devices or applications.

The present invention provides an arrangement, size, color, etc. of key button(s) based on key mapping data in response to a user's key button access when a virtual keyboard is provided or after the virtual keyboard is provided. Control is another task.

The technical problem to be achieved in the present invention is not limited to the above-mentioned technical problem, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. .

In the present specification, various exemplary embodiment(s) of a digital device and a data processing method in the digital device are disclosed.

A data processing method in a digital device according to an embodiment of the present invention includes storing key mapping data related to text data input by a user using a keyboard, receiving a keyboard output request, and outputting the requested keyboard on a screen. Step of receiving a first touch input for the output keyboard, If the received first touch input is a boundary between a first key button and a second key button in the keyboard, referring to the stored key mapping data The method includes determining one key button and outputting grapheme data corresponding to the determined key button on a text window.

A data processing method in a digital device according to another embodiment of the present invention includes receiving a keyboard output request, outputting the requested keyboard on a screen, receiving a first touch input for the output keyboard, Displaying grapheme data of a key button corresponding to the received touch input on a text window, receiving a second touch input and a third touch input for the output keyboard, and the received second touch input outputting the corrected text data on the text window according to the third touch input if it is a correction key button for correcting the text data output on the text window, and the first to third touch inputs and storing key mapping data for text data according to the method.

A digital device according to an embodiment of the present invention includes a memory for storing key mapping data related to text data input by a user using a keyboard, a user interface unit for receiving a keyboard output request and a first touch input with respect to the keyboard, the If an output unit outputs a text window including the requested keyboard and text data according to the first touch input on the screen, and the received first touch input is a boundary between the first key button and the second key button in the keyboard , A control unit for determining one key button by referring to the stored key mapping data and controlling the output unit to output grapheme data corresponding to the determined key button on the text window.

A digital device according to another embodiment of the present invention includes a memory, a keyboard output request, a user interface receiving first to third touch inputs to the keyboard, and the keyboard and the first to third touch inputs. An output unit that outputs a text window including text data according to an input, and determines whether the second touch input is a modify key button for modifying text data output on the text window, and if the determination result is a modify key button, the The output unit is controlled to output modified text data on the text window according to a third touch input, and the memory is controlled to store key mapping data for text data according to the first to third touch inputs. It includes a control unit that

The technical solutions obtainable in the present invention are not limited to the above-mentioned solutions, and other solutions not mentioned will become clear to those skilled in the art from the description below. You will be able to understand.

The effects of the present invention are as follows.

According to one embodiment of various embodiments of the present invention, processing to minimize the typographical error probability and meet the user's intention in response to the user's input to the key button (s) There are effects that can be done.

According to another embodiment among various embodiments of the present invention, adaptive processing can be performed according to circumstances by updating keymap data according to key button input through learning in units of devices or applications. It works.

According to another embodiment among various embodiments of the present invention, arrangement and size of key button(s) based on key mapping data in response to a user's key button access when a virtual keyboard is provided or after the virtual keyboard is provided (size), color (color), etc. can be controlled.

The effects obtainable in the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

1 is a diagram schematically showing a service system according to an embodiment of the present invention;
Figure 2 is a block diagram showing a digital device according to an embodiment of the present invention;
FIG. 3 is a block diagram of another configuration or detailed configuration of FIG. 2;
Figure 4 is a block diagram showing an external device according to an embodiment of the present invention;
5 is a block diagram illustrating a digital device or an external device according to another embodiment of the present invention;
6 is a diagram showing a control means for controlling a digital device according to an embodiment of the present invention;
7 is a flowchart illustrating a QWERTY keyboard input sequence processing according to an embodiment of the present invention;
8 is a flowchart illustrating a QWERTY keyboard input sequence processing based on learning data according to another embodiment of the present invention;
9 is a flowchart illustrating a QWERTY keyboard input sequence processing based on learning data according to another embodiment of the present invention; and
10 to 29 are diagrams illustrating QWERTY keyboard input processing scenarios according to embodiments of the present invention.

Hereinafter, various example(s) of a digital device and a data processing method in the digital device according to the present invention will be described with reference to the drawings.

The suffixes "module", "unit", etc. for the components used in this specification are only given in consideration of the ease of writing the specification, and both may be used interchangeably, if necessary. In addition, even when ordinal numbers such as "first-" and "second-" are described, they are merely for convenience of explanation of the terms rather than meaning the order, and are not limited to such terms or ordinal numbers. In addition, the terminology used in this specification has also been selected as a general term that is currently widely used as much as possible in consideration of the function according to the technical idea of the present invention, but this is based on the intention or custom of a person skilled in the art or the emergence of new technology. It can vary. However, in certain cases, there are terms arbitrarily selected by the applicant, but their meanings will be described in the related description. Therefore, it is revealed that the term should be interpreted based on the actual meaning it has and the contents described throughout this specification, not just the name. On the other hand, the contents described in this specification or / and drawings are not limited thereto as a preferred embodiment according to the present invention, and the scope of rights should be determined through the claims.

In this specification, a “digital device” includes, for example, all devices that perform at least one of receiving, processing, and outputting content. The digital device may stream or download the content or information about the content through a server such as a broadcasting station or an external input. The digital device may transmit/receive data including the content to the server and the like through a wired/wireless network. The digital device may be any one of a standing device and a mobile device or handheld device. The fixed device may include a network TV (Network TV), a hybrid broadcast broadband TV (HBBTV), a smart TV (Smart TV), an Internet Protocol TV (IPTV), a personal computer (PC), and the like. And, as the mobile device, a personal digital assistant (PDA), a smart phone, a tablet PC, a notebook, a digital broadcasting terminal, a portable multimedia player (PMP), a navigation device, and a slate. PC (Slate PC), Ultrabook (Ultrabook), wearable device (for example, watch type terminal (smart watch), glass type terminal (smart glass), HMD (head mounted display)), etc. may be included. . Here, FIGS. 2 and 3 show a digital TV, which is one of the fixed devices, and FIGS. 4 and 5 show a mobile terminal and a wearable device (eg, a smart watch) as examples of digital devices, respectively, as one of the mobile devices. and is described in detail in the relevant section. On the other hand, if the digital device is a fixed device, it may be in the form of a signage having only a display panel, or a set with other components, for example, a set-top box (STB). (SET) form.

On the other hand, the wired / wireless network includes all hardware and / or software for connecting or pairing, data communication, etc. between the above-described server and digital device, and standard Also includes networks that are currently supported by or will be supported in the future. Meanwhile, the wired/wireless network may support one or more communication protocols for data communication. Such wired/wireless networks include, for example, Universal Serial Bus (USB), Composite Video Banking Sync (CVBS), Component (Component), S-Video (Analog), Digital Visual Interface (DVI), High Definition Multimedia Interface (HDMI), Network for wire connection such as RGB and D-SUB, communication standard or protocol for it, Bluetooth, WLAN (Wireless LAN) (Wi-Fi), Wi-Fi direct, RFID (Radio Frequency Identification), infrared communication (IrDA: Infrared Data Association), UWB (Ultra Wideband), ZigBee, DLNA (Digital Living Network Alliance), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), It may be formed by a network for wireless connection such as High Speed Downlink Packet Access (HSDPA), Long Term Evolution/LTE-Advanced (LTE/LTE-A), and communication standards or protocols for it.

On the other hand, digital devices may use a general-purpose OS (Operating System), webOS (Web OS), etc., and add various services or applications to a general-purpose OS kernel, Linux kernel, etc. , deleting, amending, updating, etc. can be processed, through which a more user-friendly environment can be provided.

1 is a diagram schematically illustrating a service system according to an embodiment of the present invention.

Referring to FIG. 1 , the service system may be implemented by basically including a server 105 and a digital TV 110 . Here, the digital TV 110 may be replaced by a mobile terminal 120 or a wearable device 130 . Alternatively, the service system may be implemented by further including a mobile terminal 120 or a wearable device 130 in addition to the server 105 and the digital TV 110 . Meanwhile, the operation of the digital TV 110 may be controlled by a control means such as a dedicated remote controller 115 .

A digital device according to an embodiment of the present invention includes a memory for storing key mapping data related to text data input by a user using a keyboard, a user interface unit for receiving a keyboard output request and a first touch input with respect to the keyboard, the If an output unit outputs a text window including the requested keyboard and text data according to the first touch input on the screen, and the received first touch input is a boundary between the first key button and the second key button in the keyboard , A control unit for determining one key button by referring to the stored key mapping data and controlling the output unit to output grapheme data corresponding to the determined key button on the text window.

A digital device according to another embodiment of the present invention includes a memory, a keyboard output request, a user interface receiving first to third touch inputs to the keyboard, and the keyboard and the first to third touch inputs. An output unit that outputs a text window including text data according to an input, and determines whether the second touch input is a modify key button for modifying text data output on the text window, and if the determination result is a modify key button, the The output unit is controlled to output modified text data on the text window according to a third touch input, and the memory is controlled to store key mapping data for text data according to the first to third touch inputs. It includes a control unit that

2 is a block diagram illustrating a digital TV according to an embodiment of the present invention.

The digital TV 200 includes a network interface 201, a TCP/IP manager 202, a service delivery manager 203, an SI decoder 204, A demuxer or demultiplexer 205, an audio decoder 206, a video decoder 207, a display A/V and OSD module 208, a service control manager (service control manager) 209, service discovery manager 210, SI & metadata database (SI & metadata DB) 211, metadata manager 212, service manager 213, It may be configured to include the UI manager 214 or the like.

The network interface unit 201, through the network, IP packet (s) (Internet Protocol (IP) packet (s)) or IP datagram (s) (IP datagram (s) (hereinafter 'IP packet (s)) ') is received from the server 105 or transmitted to the server 105. For example, the network interface unit 201 may receive services, applications, content, and the like from the service provider 20 of FIG. 1 through a network.

The TCP/IP manager 202 transfers packets between IP packets received by the digital TV 200 and IP packets transmitted by the digital TV 200, that is, between a source and a destination. involved in packet delivery. The TCP/IP manager 202 classifies the received packet(s) to correspond to an appropriate protocol, and the service delivery manager 205, service discovery manager 210, service control manager 209, and metadata manager 212 ), etc. to output the classified packet(s).

The service delivery manager 203 is in charge of controlling received service data. For example, the service delivery manager 203 may use RTP/RTCP when controlling real-time streaming data. When the real-time streaming data is transmitted using RTP, the service delivery manager 203 parses the received data packet according to RTP and transmits the data to the demultiplexer 205 or under the control of the service manager 213. It is stored in the SI & metadata database 211 according to. And the service delivery manager 203 feeds back the network received information to the server providing the service using RTCP.

The demultiplexer 205 demultiplexes the received packets into audio, video, system information (SI) data, and the like, and transmits them to the audio/video decoders 206/207 and the SI decoder 204, respectively.

The SI decoder 204 demultiplexes SI data, that is, PSI (Program Specific Information), PSIP (Program and System Information Protocol), DVB-SI (Digital Video Broadcasting-Service Information), DTMB / CMMB (Digital Television Terrestrial Multimedia Decodes service information such as Broadcasting/Coding (Mobile Multimedia Broadcasting). In addition, the SI decoder 204 may store decoded service information in the SI & metadata database 211 . The stored service information may be read and used by a corresponding component at the request of a user, for example.

The audio/video decoders 206/207 decode each of the demultiplexed audio data and video data. The audio and video data thus decoded are provided to the user through the display unit 208 .

The application manager includes, for example, a UI manager 214 and a service manager 213, and may perform a control function of the digital TV 200. In other words, the application manager may manage the overall state of the digital TV 200, provide a user interface (UI), and manage other managers.

The UI manager 214 provides a graphical user interface (GUI)/UI for a user using an on screen display (OSD) or the like, receives a key input from the user, and performs a device operation according to the input. For example, the UI manager 214 transmits the key input signal to the service manager 213 upon receiving a key input for channel selection from the user.

The service manager 213 controls managers associated with services, such as the service delivery manager 203, the service discovery manager 210, the service control manager 209, and the metadata manager 212. In addition, the service manager 213 creates a channel map and controls channel selection and the like using the generated channel map according to a key input received from the UI manager 214 . The service manager 213 receives service information from the SI decoder 204 and sets the audio/video PID (Packet Identifier) of the selected channel in the demultiplexer 205. The PID thus set can be used in the demultiplexing process described above. Accordingly, the demultiplexer 205 filters audio data, video data, and SI data using the PID (PID or section filtering).

The service discovery manager 210 provides information necessary for selecting a service provider that provides a service. Upon receiving a signal about channel selection from the service manager 213, the service discovery manager 210 searches for a service using the information.

The service control manager 209 is in charge of selection and control of services. For example, the service control manager 209 uses IGMP or RTSP when a user selects a live broadcasting service such as a conventional broadcasting method, and selects a service such as VOD (Video on Demand). uses RTSP to perform service selection and control. The RTSP protocol may provide a trick mode for real-time streaming. In addition, the service control manager 209 may initialize and manage a session through the IMS gateway 250 using IP Multimedia Subsystem (IMS) and Session Initiation Protocol (SIP). The above protocols are examples, and other protocols may be used according to implementation examples.

The metadata manager 212 manages metadata associated with services and stores the metadata in the SI & metadata database 211 .

The SI & metadata database 211 selects service information decoded by the SI decoder 204, metadata managed by the metadata manager 212, and service providers provided by the service discovery manager 210 stores the information needed to In addition, the SI&metadata database 211 may store set-up data for the system and the like. The SI & metadata database 211 may be implemented using non-volatile memory (NVRAM) or flash memory.

Meanwhile, the IMS gateway 250 is a gateway in which functions necessary for accessing an IMS-based IPTV service are gathered.

FIG. 3 is a block diagram of another configuration or detailed configuration of FIG. 2 .

Referring to FIG. 3A, a digital TV includes a broadcast receiving unit 305, an external device interface unit 316, a storage unit 318, a user input interface unit 320, a control unit 325, a display unit 330, an audio It may include an output unit 335, a power supply unit 340, and a photographing unit (not shown). Here, the broadcast receiver 305 may include at least one tuner 310, a demodulator 312, and a network interface unit 314. However, in some cases, the broadcast receiving unit 305 may include the tuner 310 and the demodulation unit 312 but may not include the network interface unit 314, or vice versa. In addition, although not shown, the broadcast receiving unit 305 includes a multiplexer, and the signal demodulated by the demodulation unit 312 through the tuner 310 and the received signal through the network interface unit 314 can be multiplexed. In addition, although not shown, the broadcast reception unit 305 may include a demultiplexer to demultiplex the multiplexed signal or demultiplex the demodulated signal or the signal passing through the network interface unit 314.

The tuner 310 tunes a radio frequency (RF) broadcast signal received through an antenna to a channel selected by a user or all pre-stored channels to receive an RF broadcast signal. In addition, the tuner 310 converts the received RF broadcast signal into an intermediate frequency (IF) signal or a baseband signal. For example, if the received RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if it is an analog broadcast signal, it is converted into an analog baseband video or audio signal (CVBS/SIF). That is, the tuner 310 can process both digital broadcasting signals and analog broadcasting signals. An analog baseband video or audio signal (CVBS/SIF) output from the tuner 310 may be directly input to the controller 325. Also, the tuner 310 can receive RF broadcast signals of a single carrier or multiple carriers. Meanwhile, the tuner 310 sequentially tunes and receives RF broadcast signals of all broadcast channels stored through a channel storage function among RF broadcast signals received through an antenna, and converts them into intermediate frequency signals or baseband signals (DIF: Digital Intermediate frequency or baseband signal).

The demodulator 312 may receive and demodulate the digital IF signal (DIF) converted by the tuner 310, and perform channel decoding. To this end, the demodulation unit 312 includes a Trellis decoder, a deinterleaver, a Reed-Solomon decoder, or the like, or a convolution decoder, a deinterleaver, and a lead. -Solomon decoder and the like can be provided. The demodulator 312 may output a stream signal TS after performing demodulation and channel decoding. In this case, the stream signal may be a signal in which a video signal, an audio signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 Transport Stream (TS) in which an MPEG-2 standard video signal and a Dolby AC-3 standard audio signal are multiplexed. A stream signal output from the demodulation unit 312 may be input to the control unit 325 . The control unit 325 may control demultiplexing, video/audio signal processing, and the like, and control output of video through the display unit 330 and output of audio through the audio output unit 335 .

The external device interface unit 316 provides an interfacing environment between the digital TV and various external devices. To this end, the external device interface unit 316 may include an A/V input/output unit (not shown) or a wireless communication unit (not shown). The external device interface unit 316 is a DVD (Digital Versatile Disk), Blu-ray, game device, camera, camcorder, computer (laptop), tablet PC, smart phone, Bluetooth device (Bluetooth It can be connected wired/wireless to an external device such as a device, cloud, etc. The external device interface unit 316 transmits a signal including data such as image, video, and audio input through the connected external device to the control unit 325 of the digital TV. The controller 325 may control the processed image, video, audio, etc. to be output to a data signal connected to an external device. To this end, the external device interface unit 316 may further include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit has USB terminal, CVBS (Composite Video Banking Sync) terminal, component terminal, S-video terminal (analog), DVI (digital) so that video and audio signals from external devices can be input to the digital TV. Visual Interface) terminal, HDMI (High Definition Multimedia Interface) terminal, RGB terminal, D-SUB terminal, etc. may be included.

The wireless communication unit may perform short-range wireless communication with other digital devices. Digital TV, for example, communication such as Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network Alliance (DLNA) Depending on the protocol, it can be networked with other digital devices.

In addition, the external device interface unit 316 is connected to the set-top box (STB) through at least one of the above-described various terminals, and may perform input/output operations with the set-top box (STB). Meanwhile, the external device interface unit 316 may receive an application or an application list in an adjacent external device and transfer the received application to the control unit 325 or the storage unit 318 .

The network interface unit 314 provides an interface for connecting the digital TV to a wired/wireless network including an Internet network. The network interface unit 314 may include, for example, an Ethernet terminal for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi-Fi Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, etc. can be used. The network interface unit 314 may transmit or receive data with other users or other digital devices through a connected network or another network linked to the connected network. In particular, some content data stored in the digital TV may be transmitted to other users pre-registered in the digital TV or to a selected user or selected digital device among other digital devices. Meanwhile, the network interface unit 314 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, data can be transmitted or received with a corresponding server. In addition, content or data provided by a content provider or a network provider may be received. That is, content such as movies, commercials, games, VOD, and broadcast signals provided from a content provider or a network provider and related information may be received through a network. In addition, firmware update information and an update file provided by a network operator may be received. It can also transmit data to the Internet or to a content provider or network provider.

Also, the network interface unit 314 may select and receive a desired application from among applications opened through a network.

The storage unit 318 may store programs for each signal processing and control in the control unit 325, or may store signal-processed video, audio, or data signals. In addition, the storage unit 318 may perform a function for temporarily storing video, audio, or data signals input from the external device interface unit 316 or the network interface unit 314 . The storage unit 318 may store information about a predetermined broadcasting channel through a channel storage function. The storage unit 318 may store applications or application lists input from the external device interface unit 316 or the network interface unit 314 . In addition, the storage unit 318 may store various platforms described later. The storage unit 318 may be, for example, a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (eg SD or XD). memory, etc.), RAM (RAM), and ROM (EEPROM, etc.) may include at least one type of storage medium. The digital TV can reproduce and provide content files (video files, still image files, music files, document files, application files, etc.) stored in the storage unit 318 to users. 3A shows an embodiment in which the storage unit 318 is provided separately from the control unit 325, but the present invention is not limited thereto. In other words, the storage unit 318 may be included in the control unit 325.

The user input interface unit 320 transfers a signal input by the user to the control unit 325 or transfers a signal from the control unit 325 to the user. For example, the user input interface unit 320 controls power on/off, channel selection, screen setting, etc. from the remote control device 345 according to various communication methods such as an RF communication method and an infrared (IR) communication method. A signal may be received and processed, or a control signal of the control unit 325 may be processed to be transmitted to the remote control device 345 . In addition, the user input interface unit 320 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a setting value to the control unit 325 . The user input interface unit 320 transmits a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 325 or transmits a signal of the control unit 325 to the sensing unit. (not shown). Here, the sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, a motion sensor, and the like.

The control unit 325 demultiplexes the stream input through the tuner 310, the demodulation unit 312 or the external device interface unit 316 or processes the demultiplexed signals to generate a signal for outputting video or audio and can be output. The video signal processed by the controller 325 may be input to the display unit 330 and displayed as an image corresponding to the corresponding video signal. Also, the image signal processed by the control unit 325 may be input to an external output device through the external device interface unit 316 . The audio signal processed by the control unit 325 may be output as audio to the audio output unit 335 . Also, the voice signal processed by the control unit 325 may be input to an external output device through the external device interface unit 316 . Although not shown in FIG. 3A , the controller 325 may include a demultiplexer, an image processor, and the like. The controller 325 may control overall operations of the digital TV. For example, the controller 325 may control the tuner 310 to tune an RF broadcast corresponding to a channel selected by a user or a pre-stored channel. The control unit 325 may control the digital TV according to a user command input through the user input interface unit 320 or an internal program. In particular, by accessing a network, a user may download a desired application or application list into a digital TV. For example, the control unit 325 controls the tuner 310 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 320 . Then, the video, audio or data signal of the selected channel is processed. The control unit 325 allows the channel information selected by the user to be output through the display unit 330 or the audio output unit 335 together with the processed video or audio signal. As another example, the control unit 325 receives an external device video playback command received through the user input interface unit 320 from an external device input through the external device interface unit 316, for example, a camera or camcorder. , the video signal or audio signal can be output through the display unit 330 or the audio output unit 335. Meanwhile, the controller 325 may control the display unit 330 to display an image. For example, broadcasting video input through the tuner 310, external input video input through the external device interface unit 316, video input through the network interface unit, or video stored in the storage unit 318 , can be controlled to be displayed on the display unit 330. At this time, the image displayed on the display unit 330 may be a still image or a moving image, and may be a 2D image or a 3D image. In addition, the controller 325 may control to reproduce content. The content at this time may be content stored in the digital TV, received broadcasting content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file. Meanwhile, when entering the application view item, the controller 325 may control to display an application or application list downloadable from the digital TV or an external network. The controller 325 may control to install and run applications downloaded from an external network along with various user interfaces. In addition, it is possible to control an image related to an executed application to be displayed on the display unit 330 according to a user's selection.

Meanwhile, although not shown in the drawings, the digital TV may further include a channel browsing processing unit that generates a thumbnail image corresponding to a channel signal or an external input signal. The channel browsing processing unit receives a stream signal (TS) output from the demodulation unit 312 or a stream signal output from the external device interface unit 316, extracts an image from the input stream signal, and generates a thumbnail image. can The generated thumbnail image may be input to the controller 325 as it is or after being encoded. Also, the generated thumbnail image may be encoded in the form of a stream and input to the controller 325 . The controller 325 may display a thumbnail list including a plurality of thumbnail images on the display unit 330 using the input thumbnail image. Meanwhile, thumbnail images in the thumbnail list may be sequentially or simultaneously updated. Accordingly, the user can easily understand the contents of a plurality of broadcasting channels.

The display unit 330 converts the video signal, data signal, and OSD signal processed by the controller 325 or the video signal and data signal received from the external device interface unit 316 into R, G, and B signals, respectively. generate drive signals. The display unit 330 may be a plasma display panel (PDP), a liquid crystal display (LCD), an organic light emitting diode (OLED), a flexible display, a 3D display, and the like. Meanwhile, the display unit 330 may be configured as a touch screen and used as an input device other than an output device. The audio output unit 335 receives a signal processed by the controller 325, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the signal as audio. The audio output unit 335 may be implemented with various types of speakers.

Meanwhile, in order to detect a user's gesture, as described above, a sensing unit (not shown) including at least one of a touch sensor, a voice sensor, a position sensor, and a motion sensor may be further provided in the digital TV. A signal sensed by the sensing unit (not shown) may be transmitted to the control unit 325 through the user input interface unit 320 . Meanwhile, a photographing unit (not shown) for photographing the user may be further provided. Image information photographed by a photographing unit (not shown) may be input to the controller 325 . The controller 325 may detect a user's gesture by individually or in combination with an image photographed by a photographing unit (not shown) or a detected signal from a sensing unit (not shown).

The power supply unit 340 supplies corresponding power throughout the digital TV. In particular, power is supplied to the control unit 325, which can be implemented in the form of a system on chip (SoC), the display unit 380 for displaying images, and the audio output unit 335 for outputting audio. can To this end, the power supply unit 340 may include a converter (not shown) that converts AC power into DC power. Meanwhile, for example, when the display unit 380 is implemented as a liquid crystal panel having a plurality of backlight lamps, an inverter capable of PWM (Pulse Width Modulation) operation for variable luminance or dimming driving. (inverter) (not shown) may be further provided.

The remote control device 345 transmits user input to the user input interface unit 320 . To this end, the remote control device 345 may use Bluetooth, radio frequency (RF) communication, infrared (IR) communication, ultra wideband (UWB), ZigBee, or the like. In addition, the remote control device 345 may receive a video, audio, or data signal output from the user input interface unit 320, display it on the remote control device 345, or output voice or vibration.

In addition, the digital TV according to the present invention may omit some of the illustrated components as necessary or may further include components not shown. Meanwhile, unlike the above, a digital TV may receive and reproduce content through a network interface unit or an external device interface unit without including a tuner and a demodulation unit.

Referring to FIG. 3B, an example of the controller includes a demultiplexer 350, an image processor, an OSD generator 366, a mixer 370, a frame rate converter (FRC) 380 ), and a formatter 390. In addition, although not shown, the control unit may further include a voice processing unit and a data processing unit.

The demultiplexer 350 demultiplexes the input stream. For example, the demultiplexer 350 may demultiplex input MPEG-2 TS video, audio, and data signals. Here, the stream signal input to the demultiplexer 350 may be a stream signal output from a tuner or demodulator or an external device interface unit.

The image processor performs image processing on the demultiplexed image signal. To this end, the image processing unit may include an image decoder 362 and a scaler 364 . The image decoder 362 decodes the demultiplexed image signal, and the scaler 364 scales the resolution of the decoded image signal so that the display unit can output it. The image decoder 362 may support various standards. For example, the video decoder 362 performs the function of an MPEG-2 decoder when the video signal is encoded in the MPEG-2 standard, and the video signal is encoded in the DMB (Digital Multimedia Broadcasting) method or the H.264 standard. In this case, it can perform the function of H.264 decoder. Meanwhile, the video signal decoded by the video processor is input to the mixer 370.

The OSD generation unit 366 generates OSD data according to user input or by itself. For example, the OSD generation unit 366 generates data for displaying various data in the form of graphics or text on the screen of the display unit based on a control signal of the user input interface unit. The generated OSD data includes various data such as a digital TV user interface screen, various menu screens, widgets, icons, and viewing rate information. The OSD generator 366 may generate data for displaying broadcasting information based on captions or EPGs of broadcasting images.

The mixer 370 mixes the OSD data generated by the OSD generation unit 366 and the image signal processed by the image processing unit and provides them to the formatter 390 . Due to mixing of the decoded video signal and OSD data, the OSD is displayed as an overlay on the broadcast video or the externally input video.

The frame rate converter (FRC) 380 converts the frame rate of an input video. For example, the frame rate conversion unit 380 may convert the frame rate of an input 60Hz image to have, for example, 120Hz or 240Hz according to the output frequency of the display unit. As described above, there may be various methods for converting the frame rate. For example, when the frame rate conversion unit 380 converts the frame rate from 60 Hz to 120 Hz, the same first frame is inserted between the first frame and the second frame, or the second frame predicted from the first frame and the second frame is inserted. It can be converted by inserting 3 frames. As another example, when converting the frame rate from 60 Hz to 240 Hz, the frame rate conversion unit 380 may insert the same frame or three more predicted frames between existing frames to convert the frame rate. Meanwhile, when a separate frame conversion is not performed, the frame rate conversion unit 380 may be bypassed.

The formatter 390 changes the input output of the frame rate conversion unit 380 to match the output format of the display unit. For example, the formatter 390 may output R, G, and B data signals, and these R, G, and B data signals are output as low voltage differential signals (LVDS) or mini-LVDS. It can be. In addition, when the output of the input frame rate conversion unit 380 is a 3D video signal, the formatter 390 configures and outputs the 3D video signal in accordance with the output format of the display unit, thereby supporting a 3D service through the display unit.

Meanwhile, a voice processing unit (not shown) in the control unit may perform voice processing of the demultiplexed voice signal. Such a voice processing unit (not shown) may support processing of various audio formats. For example, even when an audio signal is encoded in a format such as MPEG-2, MPEG-4, AAC, HE-AAC, AC-3, or BSAC, a decoder corresponding to the encoded format may be provided and processed. In addition, a voice processing unit (not shown) in the control unit may process base, treble, volume control, and the like. A data processing unit (not shown) in the control unit may perform data processing of the demultiplexed data signal. For example, the data processing unit may decode the demultiplexed data signal even when it is encoded. Here, the encoded data signal may be EPG information including broadcast information such as the start time and end time of a broadcast program broadcast on each channel.

Meanwhile, the above-described digital TV is an example according to the present invention, and each component may be integrated, added, or omitted according to specifications of an actually implemented digital TV. That is, two or more components may be combined into one component or one component may be subdivided into two or more components as needed. In addition, functions performed in each block are for explaining an embodiment of the present invention, and the specific operation or device does not limit the scope of the present invention. Meanwhile, a digital TV may be a video signal processing device that performs signal processing of an image stored in the device or an input image. Another example of the video signal processing device is a set-top box (STB) excluding the display unit 330 and the audio output unit 335 shown in FIG. 3A, the above-mentioned DVD player, Blu-ray player, game device, computer etc. can be further exemplified.

4 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 4, the mobile terminal 400 includes a wireless communication unit 410, an audio/video (A/V) input unit 420, a user input unit 430, a sensing unit 440, an output unit 450, It may include a memory 460, an interface unit 470, a control unit 480, a power supply unit 490, and the like.

The wireless communication unit 410 may include one or more modules enabling wireless communication between the mobile terminal 400 and a wireless communication system or between the mobile terminal and a network in which the mobile terminal is located. For example, the wireless communication unit 410 may include a broadcast reception module 411, a mobile communication module 412, a wireless Internet module 413, a short-distance communication module 414, a location information module 415, and the like. .

The broadcast reception module 411 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server that generates and transmits a broadcast signal and/or broadcast-related information or a server that receives and transmits a previously generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal includes a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, and may also include a TV broadcast signal or a broadcast signal in which a data broadcast signal is combined with a radio broadcast signal. The broadcast related information may include information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it can be received by the mobile communication module 412. Broadcast-related information may include, for example, data for generating and outputting an Electronic Program Guide (EPG) or an Electronic Service Guide (ESG) in the mobile terminal 400 . The broadcast receiving module 411 may include, for example, ATSC, Digital Video Broadcasting-Terrestrial (DVB-T), Satellite (DVB-S), Media Forward Link Only (MediaFLO), Handheld (DVB-H), ISDB-T ( A digital broadcasting signal can be received using a digital broadcasting system such as Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 411 may be configured to be suitable for other digital broadcasting systems as well as the above-described digital broadcasting system. A broadcast signal received through the broadcast reception module 411 and broadcast related information may be stored in the memory 460 .

The mobile communication module 412 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The radio signal may include a voice signal, a video call signal, or various types of data according to text/multimedia message transmission/reception.

The wireless Internet module 413, including a module for wireless Internet access, may be built into or external to the mobile terminal 400. Wireless Internet technologies include wireless LAN (WLAN) (Wi-Fi), wireless broadband (Wibro), world interoperability for microwave access (Wimax), high speed downlink packet access (HSDPA), and the like.

The short-distance communication module 414 refers to a module for short-distance communication. Bluetooth, RFID (Radio Frequency Identification), IrDA (Infrared Data Association), UWB (Ultra Wideband), ZigBee, RS-232, RS-385, etc. will be used as short range communication technologies. can

The location information module 415 is a module for obtaining location information of the mobile terminal 400, and may be a Global Position System (GPS) module as an example.

The A/V input unit 420 is for inputting audio or/and video signals, and may include a camera 421 and a microphone 422. The camera 421 processes an image frame, such as a still image or a moving image, acquired by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 451 .

An image frame processed by the camera 421 may be stored in the memory 460 or transmitted to the outside through the wireless communication unit 410 . Two or more cameras 421 may be provided according to the use environment.

The microphone 422 receives an external sound signal through a microphone in a call mode, a recording mode, or a voice recognition mode, and processes it into electrical voice data. The processed voice data may be converted into a form that can be transmitted to a mobile communication base station through the mobile communication module 412 in the case of a call mode and then output. Various noise cancellation algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 422 .

The user input unit 430 generates input data for the user to control the operation of the terminal. The user input unit 430 may include a key pad, a dome switch, a touch pad (static pressure/capacity), a jog wheel, a jog switch, and the like.

The sensing unit 440 detects the current state of the mobile terminal 400, such as the opening/closing state of the mobile terminal 400, the position of the mobile terminal 400, whether there is user contact, the direction of the mobile terminal, and the acceleration/deceleration of the mobile terminal. It detects and generates a sensing signal for controlling the operation of the mobile terminal 400 . For example, when the mobile terminal 400 is moved or tilted, the position or tilt of the mobile terminal may be sensed. In addition, whether or not the power supply unit 490 supplies power and whether or not the interface unit 470 is connected to an external device may also be sensed. Meanwhile, the sensing unit 440 may include a proximity sensor 341 including NFC (Near Field Communication) and the like.

The output unit 450 is for generating an output related to sight, hearing, or touch, and may include a display unit 451, a sound output module 452, an alarm unit 453, and a haptic module 454. have.

The display unit 451 displays (outputs) information processed by the mobile terminal 400 . For example, when the mobile terminal is in a call mode, a UI or GUI related to a call is displayed. When the mobile terminal 400 is in a video call mode or a shooting mode, a photographed or/and received video, UI, or GUI is displayed.

The display unit 451 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display ( flexible display), and at least one of a 3D display.

Some of these displays may be of a transparent type or a light transmission type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparent OLED) and the like. A rear structure of the display unit 451 may also be configured as a light transmissive structure. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 451 of the terminal body.

Depending on the implementation form of the mobile terminal 400, two or more display units 451 may exist. For example, in the mobile terminal 400, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be respectively disposed on different surfaces.

When the display unit 451 and a sensor for detecting a touch operation (hereinafter referred to as a 'touch sensor') form a mutual layer structure (hereinafter referred to as a 'touch screen'), the display unit 451 may input other than an output device. It can also be used as a device. The touch sensor may have a form of, for example, a touch film, a touch sheet, or a touch pad.

The touch sensor may be configured to convert a pressure applied to a specific area of the display unit 451 or a change in capacitance generated at a specific area of the display unit 451 into an electrical input signal. The touch sensor may be configured to detect not only the touched position and area, but also the pressure upon touch.

When there is a touch input to the touch sensor, the corresponding signal(s) are sent to the touch controller. The touch controller processes the signal(s) and then sends corresponding data to the controller 480. Thus, the controller 480 can know which area of the display unit 451 has been touched.

The proximity sensor 441 may be disposed in an inner area of the mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact by using the force of an electromagnetic field or infrared rays. Proximity sensors have a longer lifespan than contact sensors, and their utilization is also high.

Examples of the proximity sensor include a transmissive photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, an infrared proximity sensor, and the like. When the touch screen is capacitive, the proximity of the pointer is detected by a change in electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an act of approaching the touch screen without contacting the pointer to recognize that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch An act of actually touching a pointer on a screen is referred to as "contact touch". The position at which the pointer touches on the touch screen means a position at which the pointer vertically corresponds to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch location, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The audio output module 452 may output audio data received from the wireless communication unit 410 or stored in the memory 460 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 452 also outputs sound signals related to functions performed by the mobile terminal 400 (eg, call signal reception sound, message reception sound, etc.). The sound output module 452 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 453 outputs a signal for notifying occurrence of an event in the mobile terminal 400 . Examples of events generated in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 453 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or audio signal can also be output through the display unit 451 or the audio output module 452, so they 451 and 452 can be classified as part of the alarm unit 453.

A haptic module 454 generates various tactile effects that a user can feel. A representative example of the tactile effect generated by the haptic module 454 is vibration. The intensity and pattern of vibration generated by the haptic module 454 can be controlled. For example, different vibrations may be synthesized and output or sequentially output. In addition to vibration, the haptic module 454 responds to stimuli such as an array of pins that move vertically with respect to the contacted skin surface, blowing force or suction force of air through a nozzle or suction port, rubbing against the skin surface, contact with an electrode, electrostatic force, and the like. It is possible to generate various tactile effects, such as the effect of heat absorption and the effect of reproducing cold/warm sensations using elements capable of absorbing heat or generating heat. The haptic module 454 not only transfers tactile effects through direct contact, but also can be implemented so that a user can feel tactile effects through muscle sensations such as fingers or arms. Two or more haptic modules 454 may be provided according to the configuration of the mobile terminal 400 .

The memory 460 may store programs for operation of the controller 480 and may temporarily store input/output data (eg, phone books, messages, still images, moving pictures, etc.). The memory 460 may store data related to vibration and sound of various patterns output when a touch is input on the touch screen.

The memory 460 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, It may include a storage medium of at least one type of a magnetic disk and an optical disk. The mobile terminal 400 may operate in relation to a web storage performing a storage function of the memory 460 on the Internet.

The interface unit 470 serves as a passage for all external devices connected to the mobile terminal 400 . The interface unit 470 receives data from an external device or receives power and transmits it to each component inside the mobile terminal 400 or transmits data inside the mobile terminal 400 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I/O (Input/Output) port, A video I/O port, an earphone port, and the like may be included in the interface unit 470 .

The identification module is a chip storing various information for authenticating the right to use the mobile terminal 400, and includes a user identification module (UIM), a subscriber identification module (SIM), and a universal user identification module ( Universal Subscriber Identity Module (USIM), etc. A device equipped with an identification module (hereinafter referred to as 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the mobile terminal 400 through the port.

When the mobile terminal 400 is connected to an external cradle, the interface unit 470 serves as a passage through which power from the cradle is supplied to the mobile terminal 400, or various inputs from the cradle by the user. A command signal may be a passage through which the command signal is transmitted to the mobile terminal. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 480 controls overall operations of the mobile terminal 400 in general. The control unit 480 performs related control and processing for, for example, voice calls, data communications, video calls, and the like. The controller 480 may include a multimedia module 481 for playing multimedia. The multimedia module 481 may be implemented within the control unit 480 or may be implemented separately from the control unit 480 . The controller 480 may perform pattern recognition processing capable of recognizing handwriting input or drawing input made on the touch screen as text and image, respectively.

The power supply unit 490 receives external power and internal power under the control of the controller 480 and supplies power necessary for the operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and other electrical units for performing functions. Embodiments may be implemented by the control unit 480 itself.

According to software implementation, embodiments such as procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented as a software application written in an appropriate programming language. Here, the software code may be stored in the memory 460 and executed by the controller 480 .

On the other hand, a wearable device that can be worn on the body, beyond the level that the user mainly uses in the hand, may operate or function as a digital device or an external device in this specification. Examples of such wearable devices include a smart watch, smart glasses, and a head mounted display (HMD).

As shown in FIG. 1 , the wearable device may mutually exchange (or interwork) data with other devices. The short-distance communication module 414 may detect (or recognize) a wearable device capable of communicating around the mobile terminal 400 . Furthermore, if the detected wearable device is a device authorized to communicate with the mobile terminal 400, the controller 480 transmits at least a portion of data processed by the mobile terminal 400 to the wearable device through the short-range communication module 414. can be sent to Accordingly, the user can use the data processed by the mobile terminal 400 through the wearable device. For example, when a phone call is received in the mobile terminal 400, a phone call can be made through the wearable device, or when a message is received in the mobile terminal 400, the received message can be checked through the wearable device.

5 is a block diagram illustrating a digital device or an external device according to another embodiment of the present invention.

Referring to FIG. 5, a watch-type mobile terminal, that is, a smart watch 500 includes a main body 501 having a display unit 551 and a band 502 connected to the main body 501 and configured to be worn on a wrist. includes In general, the smart watch 500 may include features of the mobile terminal 400 of FIG. 4 or features similar thereto.

The main body 501 includes a case forming an exterior. As shown, the case may include a first case 501a and a second case 501b providing internal spaces accommodating various electronic components. However, the present invention is not limited thereto, and a case may be configured to provide the inner space so that the unibody mobile terminal 500 may be implemented.

The smart watch 500 is configured to enable wireless communication, and an antenna for the wireless communication may be installed in the body 501. Meanwhile, the performance of the antenna can be expanded by using a case. For example, a case including a conductive material may be electrically connected to an antenna to expand a ground area or a radiation area.

A display unit 551 is disposed on the front of the main body 501 to output information, and a touch sensor is provided on the display unit 551 so that it can be implemented as a touch screen. As shown, the window 551a of the display unit 551 may be mounted on the first case 501a to form the front surface of the terminal body together with the first case 501a.

The body 501 may include a sound output unit 552 , a camera 521 , a microphone 522 , a user input unit 523 , and the like. When the display unit 551 is implemented as a touch screen, it may function as a user input unit 523, and accordingly, a separate key may not be provided on the main body 501.

The band 502 is worn on the wrist to surround the wrist, and may be formed of a flexible material so as to be easily worn. As such, the band 502 may be formed of leather, rubber, silicone, synthetic resin, or the like. In addition, the band 502 is configured to be detachable from the main body 501, and can be configured to be interchangeable with various types of bands according to the user's taste.

Meanwhile, the band 502 may be used to extend the performance of an antenna. For example, a ground extension unit (not shown) electrically connected to an antenna to expand a ground area may be embedded in the band.

Band 502 may be provided with fasteners 502a. The fastener 502a may be implemented by a buckle, a hook structure capable of snap-fit, or Velcro (trade name), and may include an elastic section or material. . In this figure, an example in which the fastener 502a is implemented in the form of a buckle is presented.

6 is a diagram illustrating a control means for controlling a digital device according to an embodiment of the present invention.

To control the digital device 600, a front panel (not shown) or control means (input means) provided on the digital device 600 is used.

On the other hand, the control unit is a user interface device (UID) capable of wired and wireless communication, and includes a remote controller 610, a keyboard 630, a pointing device 620, A touch-pad or the like is included, but a control unit dedicated to external input connected to the digital device 600 may also be included. In addition, a mobile terminal such as a smart phone or a tablet PC that controls the digital device 600 through a mode change or the like is also included in the control means, although it is not intended to control the digital device 600 . However, in this specification, a pointing device is described as an example for convenience, but is not limited thereto.

The input means is a communication protocol such as Bluetooth, RFID (Radio Frequency Identification), infrared communication (IrDA, Infrared Data Association), UWB (Ultra Wideband), ZigBee, DLNA (Digital Living Network Alliance), RS, etc. It is possible to communicate with a digital device by adopting at least one or more as necessary.

The remote control 610 refers to a general input means equipped with various key buttons necessary for controlling the digital device 600 .

The pointing device 620 is equipped with a gyro sensor and the like to implement a corresponding pointer on the screen of the digital device 600 based on the user's movement, pressure, rotation, etc. ) transmits a predetermined control command. This pointing device 620 may be named variously, such as a magic remote controller or a magic controller.

The keyboard 630 is an intelligent integrated digital device that goes beyond the conventional digital device 600 providing only broadcasting, and provides various services such as web browsers, applications, and SNS (Social Network Service), so that it can be controlled only with the conventional remote control 610. It is not easy, so it is implemented to compensate for this and to promote the convenience of inputting text by implementing it similarly to the keyboard of a PC.

On the other hand, control means such as the remote control 610, the pointing device 620, and the keyboard 630 are provided with a touch pad as needed, so that text input, pointer movement, and enlargement/reduction of photos or videos are more convenient and for various control purposes. available for

Hereinafter, with reference to the accompanying drawings, a typographical error probability in response to a user's input to keybutton(s) of the virtual keyboard in a digital device using a virtual keyboard according to the present invention It will be described in detail with respect to the embodiment (s) of minimizing and processing to meet the user's intention. To this end, according to embodiments according to the present invention, adaptive processing is performed according to the situation by updating keymap data according to key button input through learning in units of devices or applications, and , Arrangement, size, color, etc. of key button(s) based on key mapping data corresponding to key button access of the user when the virtual keyboard is provided or after the virtual keyboard is provided You can control the combination(s).

Although the present invention can be applied to all digital devices using a virtual keyboard, a mobile device, in particular, a mobile terminal, will be described as an example for better understanding of the present invention and convenience of explanation. However, the scope of the present invention is not limited thereto. Also, for convenience, in this specification, the virtual keyboard is described using the Qwerty format as an example. Therefore, the virtual keyboard is hereinafter referred to as a QWERTY keyboard and described.

A data processing method in a digital device according to an embodiment of the present invention includes storing key mapping data related to text data input by a user using a keyboard, receiving a keyboard output request, and outputting the requested keyboard on a screen. Step of receiving a first touch input for the output keyboard, If the received first touch input is a boundary between a first key button and a second key button in the keyboard, referring to the stored key mapping data The method includes determining one key button and outputting grapheme data corresponding to the determined key button on a text window.

A data processing method in a digital device according to another embodiment of the present invention includes receiving a keyboard output request, outputting the requested keyboard on a screen, receiving a first touch input for the output keyboard, Displaying grapheme data of a key button corresponding to the received touch input on a text window, receiving a second touch input and a third touch input for the output keyboard, and the received second touch input outputting the corrected text data on the text window according to the third touch input if it is a correction key button for correcting the text data output on the text window, and the first to third touch inputs and storing key mapping data for text data according to the method.

In the above, receiving a second touch input and a third touch input for the output keyboard, determining whether the second touch input is a delete key button, and if the second touch input is a delete key button, the outputted deleting grapheme data according to the first touch input and re-outputting grapheme data of a key button according to the third touch input on the text window, and text data according to the first to third touch inputs Updating and storing stored key mapping data may be further included.

In the above, receiving a fourth touch input for the output keyboard, if the fourth touch input is for the completion of at least one of a word, sentence, and paragraph, a word output according to the completion on the text window; Determining whether a typo has occurred in at least one of sentences and paragraphs based on the key mapping data, and if a typo has occurred as a result of the determination, displaying whether or not the typo has occurred in at least one of the character elements, words, sentences, and paragraphs of the typo. It may be made by further including the step of doing. In the above, if a typo has occurred as a result of the determination, one or more key buttons related to the typo are displayed so as to be identifiable from other key buttons on the keyboard, and / and character elements, words, The method may further include generating and outputting key buttons for at least one of sentences and paragraphs.

In the above, when the keyboard is output on the screen or at least one of the first to third touch inputs is received, key button(s) or key button sets having a probability of error occurrence equal to or greater than a threshold value are determined by referring to the key mapping data. The step of displaying so as to be identifiable from other key buttons on the output keyboard may be further included.

In the above, when a specific key button is selected according to the first touch input, the key button(s) of the grapheme related to the grapheme data of the selected key button may be displayed to be identifiable from other key buttons.

In the above, if the language system of the first grapheme data according to the received first touch input is different from the language system of the second grapheme data according to the previous or subsequent touch input, the first grapheme data on the text window is different from the grapheme It may be displayed to be identifiable from data, and one or more key buttons for recommended grapheme data to replace the first grapheme data may be generated and output.

Meanwhile, in the above, the display includes changing at least one of the arrangement, location, size, color, and vibration intensity level of the corresponding key button or key button set, or voice support.

7 is a flowchart of processing a qwerty keyboard input sequence according to an embodiment of the present invention.

The mobile terminal waits until a touch event occurs (S702). When the touch event occurs (S704), the mobile terminal obtains coordinate data corresponding to the generated touch event by calculating corresponding coordinates of the location where the touch event occurred (S706).

The mobile terminal determines whether the touch event has occurred on the keyboard, that is, the QWERTY keyboard, through the acquired coordinate data (S708).

As a result of the determination in step S708, if the touch event has occurred on the QWERTY keyboard, the mobile terminal obtains corresponding key button data on the QWERTY keyboard based on the acquired coordinate data (S710).

The mobile terminal performs processing corresponding to the acquired key button data (S712).

In this specification, standby means not only standby in a general sense, but also a state before a touch event on the QWERTY keyboard is input in relation to the present invention. For example, the standby state may also include a case where a QWERTY keyboard call signal is received and a QWERTY keyboard is provided according to the signal reception.

In the present specification, a touch event may be generated by, for example, contact or non-contact between a user's finger or a pen-type stylus and the touch screen of the mobile terminal. On the other hand, in the present specification, the touch event is described as an example for convenience, but the present invention is not limited thereto, and an event having a similar meaning to the touch event, for example, a gesture, an eye-tracking, etc., is performed in the same or similar manner. Applicable.

In step S710, if the touch event does not occur on the QWERTY keyboard, that is, if a touch event occurs but is not a key button input on the QWERTY keyboard being provided, FIG. , This means that it does not necessarily go into a standby state, but performs an operation corresponding to a corresponding touch event. However, in relation to the present invention, for convenience, when a touch event is not a key button input of a QWERTY keyboard, it is explained that it is fed back in a standby state because no separate explanation is given.

Meanwhile, processing corresponding to the obtained key button data in step S712 means outputting a grapheme or the like corresponding to a corresponding key button, which will be described in more detail below. In addition, in the present invention, phoneme may also be referred to in addition to the above grapheme.

8 is a flowchart illustrating a QWERTY keyboard input sequence processing based on learning data according to another embodiment of the present invention.

Hereinafter, in the QWERTY keyboard input sequence processing process based on the learning data of FIG. 8, steps S802 to S810 are, for example, the same as steps S702 to S710 of FIG. is omitted in advance.

When the key button data value corresponding to the coordinates is obtained in step S810, the mobile terminal determines whether the obtained key button data value is 'DEL', that is, the delete key button value (S812).

As a result of determination in S812, if the obtained key button data value is the delete key button value, the mobile terminal stores the character element corresponding to the delete key button value (S814) and deletes the corresponding character element (S816).

On the other hand, as a result of the determination in S812, if the obtained key button data value is not the delete key button value, the character element corresponding to the acquired key button data is displayed on the keyboard corresponding to the acquired key button data value ( S818).

Then, the mobile terminal determines whether the previous key button value is the delete key button value simultaneously with or immediately after the step S818 (S820).

As a result of the determination in step S820, if the previous key button value is not the delete key button value, the corresponding key button value data is delivered (S822). However, conversely, if the previous key button value is the delete key button value, key mapping data is updated including the grapheme data displayed in step S818 (S824).

Meanwhile, the mobile terminal may determine whether or not a grapheme corresponding to a key button value previously input is an initial consonant in a process of determining a value of a delete key button. This is because the data to be deleted may vary according to the value of the delete key button according to the result of determining whether or not the initial sound is present. On the other hand, the result of determining whether or not the initial sound is present may also affect, for example, key mapping data update. In this regard, in step S812, whether or not the value of the delete key button is determined, the deletion range may also vary depending on whether data is an initial sound before the delete key button is input. For example, since the delete key button input is made not only for the previous input character element but also for the previous input character element in order to delete a certain character element, the delete key button may be continuously input. In addition, when a touch event occurs on the window portion where the grapheme is output after the delete key button or there is an input corresponding to the value of the movement key button, this can be reflected in the step S820 or S824.

On the other hand, the mobile terminal recognizes the user's touch habits by inputting several words at the time of initial setting, stores data on the key mapping area, and uses this to determine the area to be touched to input each text. You can set the scope and change it later.

9 is a flowchart illustrating a QWERTY keyboard input sequence processing based on learning data according to another embodiment of the present invention.

In particular, FIG. 9 may be a diagram illustrating a detailed process of correcting an actual grapheme after a delete key button is activated in FIG. 8 .

When the mobile terminal receives a grapheme correction request (S902), it first determines whether there is a modified record (S904). The grapheme correction request in step S902 may be replaced with, for example, whether the value of the delete key button of FIG. 8 is input.

If there is no modified record, the mobile terminal stores the modified history (S916).

On the other hand, if there is a record of grapheme correction, the mobile terminal analyzes the coordinates of the input key button data values (S906) and calculates an error with the coordinate area of the existing key button data values of the previous record (S908). The mobile terminal calculates a predefined weight (S910) and calculates a correction frequency with respect to the corresponding grapheme up to now (S912). The mobile terminal updates the key mapping area based on the data collected in steps S906 to S912 (S914).

The mobile terminal outputs the corrected grapheme input by the user to the corresponding position in the window where the text is being displayed (S918).

10 to 29 are diagrams illustrating QWERTY keyboard input processing scenarios according to embodiments of the present invention.

As described above, the present invention is to minimize the probability of occurrence of a typo corresponding to the user's intention in response to the user's input on the provided QWERTY keyboard. To this end, in the present specification, learning is used to respond to user input. In relation to the present invention, the learning may be performed, for example, by referring to correction data through a user's selection of a specific grapheme or/and a deletion key due to a typo in a text input process. Meanwhile, in relation to the present invention, the selection or modification occurs mainly according to a touch event at a boundary between key buttons, for example. Therefore, in the present invention, this is described as an example for convenience, but is not necessarily limited thereto.

Hereinafter, various embodiments of the present invention will be described in more detail through the attached QWERTY keyboard input processing scenarios.

10 shows a QWERTY keyboard and a user's input to the QWERTY keyboard.

Referring to FIG. 10 , it can be seen that the user has touched between the first key button (‘ㅇ’) and the second key button (‘ㄹ’). At this time, the user's intention is a touch input to the second key button ('ㅇ'), but the mobile terminal recognizes it as a touch input to the first key button ('ㅇ'), and the 'ㅇ' is a text window ( 1030), it will be recognized as a typo and corrected because it does not correspond to the user's own intention apart from the recognition rate of the mobile terminal.

In other words, except for general cases, the user's intention corresponding to the touch input may be more important than how accurately the mobile terminal recognizes the user's touch point.

FIG. 11A further enlarges only the touch point portion in FIG. 10 , for example, and the user's touch input 1110 includes a first key button ('ㅇ') 1120 and a second key button ('ㄹ') 1130. Referring to between or pre-stored key mapping data, the touch input 1110 may be recognized as a touch input to the second key button ('ㄹ') 1130, and the mobile terminal may display a text window ( 1140), the grapheme 'd' corresponding to the second key button 1120 is output.

However, it cannot be seen that the processing of the character elements of FIG. 11A described above meets the user's intention. For example, as shown in FIG. 11A, if the user deletes the output character element ('ㄹ') through a delete key button after the character element ('ㄹ') is output on the text window 1140, the grapheme processing of FIG. 11A is performed. Rather, it can be seen that it does not meet the user's intention.

As described above, if the grapheme ('ㄹ') output on the text window 1140 of FIG. 11A is deleted and modified as in the text window 1140-1 of FIG. 11B, the mobile terminal maps the pre-stored key mapping of FIG. It is preferable to modify and update the data like the key mapping data 1120-1 and 1130-1 shown in FIG. 11B. This process is performed through learning. In the learning, key mapping data may be updated by a one-time correction or the like, but may be accumulated and updated by referring to previously stored key mapping data. A detailed description of this will be given later in the relevant section.

In FIG. 11 , a processing process according to character element correction according to the use of the delete key button in response to the user's touch input 1110 and learning through it has been described. Meanwhile, as described above, the learning is not necessarily performed only by an input through a delete key button, etc., and as shown in FIG. 12, the user's grapheme selection data may also be referred to in the learning process.

12 is a diagram for explaining a character element selection process according to a touch input.

Assume that the user wants to input the text 'Korea' through the QWERTY keyboard 1220 on the text window 1210 of the mobile terminal.

Referring to FIG. 12, on the text window 1210 of the mobile terminal, 'we' of 'our country' has already been input, and then a touch event occurs for the user to input 'me', but the touch point 1230 It can be seen that this is between the first key button ('b') 1240 and the second key button ('ㅇ') 1250. In this case, in FIG. 11 described above, with reference to previously stored key mapping data, one of the first key button and the second cover button is recognized and outputted on the text window 1210 . However, in FIG. 12, in the above case, the key buttons 1240 and 1250 around the touch point 1230 are output and provided as another layer on the provided keyboard so that the key buttons 1240 and 1250 can be selected. When any one of the provided peripheral key buttons 1240 and 1250 is selected, a grapheme corresponding to the selected key button is provided on the text window 1210 . Also, the peripheral key buttons 1240 and 1250 provided in different layers on the keyboard disappear.

As described above, the mobile terminal updates data on the key button selected from among the provided key buttons 1240 and 1250 according to the touch point to the key mapping data, and uses it later.

13 is a diagram for explaining points recognized for a user's touch input corresponding to a character element on the text window 1310 in relation to the present invention. As shown, the example text on the text window 1310, that is, for key buttons corresponding to 'East Sea and Mt. Touch input points are shown.

In this specification, key mapping data referred to for processing in a mobile terminal refers to at least one of the user's touch input point shown above, character elements according to the touch input, and data related to key buttons corresponding to the character elements. and stored in a memory or the like as such key mapping data. On the other hand, the key mapping data includes a user's delete key selection touch input, a user's touch input point related to character element correction after the delete key selection, character elements according to the touch input, and data related to key buttons corresponding to the character elements. See at least one more. Meanwhile, after the deletion key is selected, the key mapping data may further include at least one of text data input before deletion and text data modified after deletion. Meanwhile, the text data may be one unit of grapheme, word, sentence, and paragraph.

On the other hand, the user's touch input point corresponding to the text data output on the text window 1310 of FIG. 13 is output on the QWERTY keyboard when the user inputs, as shown, and through the output as well as the user's input convenience It is also possible to induce a touch input to an accurate key button to prevent a user from entering a typo. At this time, the point may be output only for the key button corresponding to the previous input grapheme whenever a key button corresponding to the grapheme is selected, or all of the text data currently provided on the text window 1310 is output as shown. It could be. In the case of the latter, in particular, it may be made in units of grapheme, word, sentence, or paragraph. Alternatively, in relation to the present invention, for example, when a key button of a corresponding grapheme is touched, the pointer is output when the possibility of occurrence of a typo is within a predetermined range when the corresponding touch input point considers key mapping data. Instead, only point(s) for touch inputs between key buttons with a possibility of typo may be output. Alternatively, only at least one of the key button for which the user selects the delete key and the key button(s) input after selecting the delete key among the touch points may be output on the qwerty keyboard.

14 describes a case in which an actual key button area referring to key mapping data using learning data according to the present invention differs from the area of each key button output on a QWERTY keyboard, for example.

Referring to FIG. 14 , text data of 'Korea' is provided on a text window 1410 . In this case, while inputting the text data, for example, if there is data modified according to a user's touch input, the corresponding character element, etc. may be output to be identifiable on the text window 1410 differently from other character elements.

Referring to FIG. 14, in the process of inputting text data of 'our country', a user's touch input for inputting a character element ('ㅇ') for inputting 'right' corresponds to a boundary point between key buttons, and the The grapheme corresponding to the boundary point input according to the user's touch input or the grapheme selected by the user again and corrected according to the boundary point input may be output to be identifiable from other character elements as shown.

Meanwhile, as described above, grapheme is provided to be identifiable from text data, and key mapping data according to the present invention is also updated. And the key mapping data updated in this way can be output as shown in FIG. 14 . In other words, referring to the QWERTY keyboard of FIG. 14, a touch input point corresponding to a grapheme ('ㅇ') is displayed, and virtual key button regions 1420 and 1430 are displayed by referring to key mapping data related to the touch input point. ) can also be output so that it can be identified.

Meanwhile, as described above, each virtual key button region data (eg, 1420, 1430) corresponding to the key mapping data may be provided first even if there is no user's touch input when the QWERTY keyboard is called. Meanwhile, in the foregoing description, the provided virtual key button area(s) may vary depending on which application provides the QWERTY keyboard by referring to key mapping data stored separately for each application, for example.

In this regard, in FIG. 29 , similarly, key button(s) corresponding to character element(s) having a typo occurrence rate between key buttons equal to or greater than a predetermined threshold by referring to key mapping data according to an application, a user's touch input pattern, etc. (2910) , 2920, 2930) can be output differentiated from other key button(s). For example, the mobile terminal may output the corresponding key button(s) in a different color, size, etc. from the original position at the corresponding position on the QWERTY keyboard.

15 is an embodiment in which a user's touch input point 1520 is provided to a key button on a QWERTY keyboard corresponding to a grapheme 'b' output on a text window 1510. For example, in FIG. 15 , when a user touches a key button corresponding to a desired grapheme on a QWERTY keyboard and then releases his/her finger, the grapheme 'b' is output on the text window 1510 and simultaneously on the key button. Also, the touch input point is displayed.

16, as in FIG. 15, when the user touches a key button corresponding to a desired grapheme on the QWERTY keyboard and then releases his/her finger, the grapheme ('ㄴ') is output on the text window 1510 and simultaneously the key The touch input point is also displayed on the button, and at the same time, one or more key buttons 1610 corresponding to the character element that can be input next to the character element (eg, 'ㄴ', etc.) Key buttons corresponding to other grapheme elements may be provided to provide input convenience to the user. Meanwhile, determination of the character element(s) that can be input next to the character element ('b') in the above may be made by referring to key mapping data stored in a memory or the like according to the present invention, for example. Alternatively, the word, paragraph, sentence, etc. entered or to be input on the text window 1510 together with or separately from the key mapping data is determined based on data received through data communication with an external server or the like. this can be done Meanwhile, the determination may be made in combination with not only a text input on the QWERTY keyboard but also a user's voice, gesture, eye-tracking, and the like.

In contrast to FIG. 16 described above, in FIG. 17 , when a user touches a key button corresponding to a desired character element ('ㄹ') on the QWERTY keyboard and then releases his or her finger, the character element ('ㄹ') appears on the text window 1710. At the same time as being output, the touched key button 1720 is provided differentiated from other key buttons, and one corresponding to the next input possible grapheme (for example, 'a', etc.) according to the input of the character element (d'). Unlike other grapheme elements, touch input points for inducing touches are displayed on the key buttons 1730 or more.

Meanwhile, FIG. 18 is similar to FIG. 16 described above. However, unlike FIG. 16 described above, in FIG. 18, when the user touches the key button 1820 corresponding to the desired character element ('ㄹ') on the QWERTY keyboard and then releases the finger, the character element (') appears on the text window 1810. At the same time as 'd') is output, the user's touch input point is output on the touched key button 1820, and the next inputable character element around the key button 1820 (for example, 'a', ' One or more key buttons 1830 and 1840 corresponding to 'q', etc.) are provided. In the case of FIG. 16 described above, one or more key buttons corresponding to the next inputable character element are provided to be differentiated from their original positions on the QWERTY keyboard, whereas in FIG. 18, the arrangement around the key button 1820 is different. . In this case, one or more key buttons corresponding to the next inputable character element are also provided in their original positions. However, when provided around the key button 1820, the color, size, and arrangement will be provided in various ways depending on the position of the key button 1820 or the next input character element, regardless of the arrangement of the key buttons of the original QWERTY keyboard. can For example, in FIG. 18, since the grapheme ('ㄹ') can be followed by the grapheme elements ('ㄴ' and 'sh'), the grapheme elements ('ㄱ' and 'sh') are originally the grapheme elements ('ㄹ'). ) or is located on the right side of the character element ('ㄹ') even if it is based on the arrangement of the original QWERTY keyboard, so as shown, it is provided overlaid on the right side for the user's input convenience. In addition, in the case of a foreign language such as English, it can be provided based on the characteristics of the language or considering various factors such as when the user is right-handed or left-handed. In particular, as shown in FIG. 18 , for example, the wider the interval between the key buttons in the QWERTY keyboard, the more convenience can be provided to the user.

Similar to FIG. 18, as shown in FIG. 19, the mobile terminal may provide virtual key buttons corresponding to character elements that can be input after the character elements of the key button according to a predetermined key button.

Referring to FIG. 19 , when a user touches a key button ('ㄹ') 1910 or releases the touch after the touch, the mobile terminal sets a first virtual key button set 1920 around the key button 1910. place Meanwhile, in the mobile terminal, along with the first virtual key button set 1920, a second virtual key button set 1930 for character elements that can be input after the character elements corresponding to the first virtual key button set 1920 ) can be provided together. In this case, the second virtual key button set 1930 may be provided around the first virtual key button set 1920 without overlapping with them.

Meanwhile, the first virtual key button set 1920 and the second virtual key button set 1930 are removed from the keyboard if there is no additional touch event by the user after a predetermined time elapses. In addition, the first virtual key button set 1920 and the second virtual key button set 1930 are provided in case of a touch event for all key buttons on the keyboard or in case of a touch event for specific key button(s). can only be provided. In this case, the touch event for the specific key button(s) includes a touch input for the key button(s) where the probability of occurrence of an error exceeds a threshold as a result of the judgment through learning.

Meanwhile, the mobile terminal may combine and provide FIGS. 18 and 19 according to character elements, words, sentences, paragraphs, etc. input on the text window.

20 to 25 show that when a QWERTY keyboard is provided on the screen according to a touch event or under a specific condition while using the QWERTY keyboard, at least one key button is differentiated from other key buttons to prevent a user from making a typo. It is intended to alleviate discomfort.

Referring to FIG. 20, the mobile terminal arranges the key buttons in each row in a zigzag pattern so that the heights of the key buttons in each row are different from those of the neighboring key buttons in order to provide touch input convenience for the key buttons on the QWERTY keyboard. do. Meanwhile, in arranging key buttons on a QWERTY keyboard in a zigzag form, the mobile terminal may change the arrangement of a corresponding row if an overlap or collision area occurs according to the arrangement with a neighboring row. In addition, referring to FIG. 20, the mobile terminal selects key button(s) frequently used by the user or with a high probability of error occurrence among the arranged key buttons (for example, 'a', 'ㅇ' in FIG. 20). ', 'ㅋ', 'ㄱ', etc.) can be processed differently in size, color, etc. to be differentiated from other key buttons along with the above arrangement.

Referring to FIG. 21 , the mobile terminal may change the zigzag shape, color, size, etc. of only some but not all of the key buttons in each row in order to provide touch input convenience for the key buttons on the provided QWERTY keyboard. . For example, referring to FIG. 21 , only key buttons corresponding to 'ㅅㅕㅐ', which are part of 'ㅅㅕㅑㅔ' in the first row, are differentiated from key buttons corresponding to 'ㅅㅛㅑㅔ'. . Meanwhile, as shown in FIG. 20 described above, between the rows, key buttons are selected or processed in other ways so as not to collide or overlap each other.

Referring to FIG. 22, unlike the foregoing, the mobile terminal differentiates and processes only key button sets whose error probability exceeds a critical value among key buttons provided on the QWERTY keyboard to be distinguished from each other within the corresponding set.

Meanwhile, FIG. 23 differentiates and provides only key button(s) mainly used by a user in a mobile terminal from other key buttons.

In addition, FIG. 24 processes a key button 2420 corresponding to a grapheme to be input next in consideration of a word or grapheme input on the text window 2410 to be differentiated from other key buttons. However, in the case of FIG. 24, unlike other embodiments, since there is a possibility of an error occurring when selecting the key button 2420, one or more neighboring key buttons (eg, 2430) is also differentiated from other key buttons. At this time, the mobile terminal provides the peripheral key buttons 2430 to be differentiated from the key buttons 2420.

Referring to FIG. 25 , in arranging key buttons on a QWERTY keyboard, a mobile terminal provides key buttons within a specific range (2510 to 2520) and other key buttons to be differentiated.

For example, the distance between the key buttons within the specific range (2510 to 2520) is widened, and the size or color of the corresponding key button is processed so that selection is more convenient than when originally provided through a QWERTY keyboard. On the other hand, the mobile terminal reduces the size of key buttons outside the specific range (2510-2520) compared to the case where they are provided through the original QWERTY keyboard, narrows the gap between key buttons, changes the color to a dull color, etc. can be provided.

Next, referring to FIG. 26 , for example, when the user completes inputting a word or sentence, the user tries to correct it through the delete key button, or when referring to grammar check or key mapping data in the mobile terminal, there is a possibility of error. It may be provided as a text window 2610 so that the user can easily identify character elements, paragraphs, sentences, paragraphs, etc. with . Accordingly, the user can easily identify an erroneously input portion through the text window 2610. In this case, if the user continues to input the transmit key button or the next character element or word without a touch event such as touching a part with a possibility of error or selecting a delete key button, the text window 2610 appears. Remove the content that was provided for differentiation.

Hereinafter, in FIGS. 27 to 29, examples of processing of a mobile terminal when a user corrects a character element in which a typo occurs in the same situation as in FIG. 26 will be described.

Referring to FIG. 27, the mobile terminal provides the user's touch input points on key buttons corresponding to each grapheme ('ㅅ', 'ㅛ') of the text ('show') where the typo occurred. .

At this time, the mobile terminal may provide the recommended character elements 2710 and 2720 so as to be identifiable when the touch input point is provided and a neighboring or corresponding typographical character element around the touch input point is corrected.

Referring to FIG. 28, it is similar to FIG. 27, but key buttons 2810 and 2820 corresponding to the recommended character elements are provided in the center rather than at the location of the corresponding key buttons on the QWERTY keyboard so that the user can identify them to provide selection convenience do.

On the other hand, referring to FIG. 29 , similar to FIGS. 27 to 28 , the mobile terminal newly creates a key button 2910 corresponding to a recommended character or word and provides it to a specific area on the QWERTY keyboard. In the case of FIG. 29 , in order to change the character 'show' to 'kyo', the key buttons corresponding to 'a' and 'ㅛ' can be changed directly with a single touch event without pressing twice.

On the other hand, in relation to the present invention, for example, when trying to type the sentence 'Let's go to school', but for some reason, 'Let's go to school' is input on the text window, the mobile terminal determines that the 'ry' from the sentence is the user's It can be processed as shown in FIG. 29 by recognizing the intention as 'Kyo'. In addition, although in FIGS. 27 to 29 , in some cases, not one but a plurality of recommended character elements, recommended characters, and recommended words may be provided.

In addition, in this specification, cases that occur when the language system is Korean are mainly described, but it is applicable to all languages without being classified into a specific language system.

Meanwhile, the embodiments of FIGS. 10 to 29 according to the present invention may be provided only when a user sets or requests a related function to be activated through a menu or the like.

In addition, in the present specification, when a specific key button is differentiated from other key button(s), such as a high frequency of use or a high probability of typo, the vibration intensity of the key button is different from that of other key buttons so that the user can It may also be possible to identify whether or not the user has properly input the touch input at the same time as the user touches it. Alternatively, the mobile terminal may provide touch input convenience by making the size of a key button itself larger than that of other key buttons, even though the size of the key button itself is the same.

As described above, each of the drawings shown in FIGS. 10 to 29 and the content described in this specification in relation thereto may be an embodiment by itself, or any combination (s) of the content shown in at least one or more drawings This may be one embodiment. In addition, even if it is described as a description of a specific drawing within this specification, it is stated in advance that it is applicable to other drawings that are the same or similar to those described in the drawing for convenience. Meanwhile, the contents described above with reference to FIGS. 10 to 29 may be applied in units of devices or in units of applications. For example, in relation to the present invention, a pattern of using a QWERTY keyboard in a web browser and in an application such as a messenger or social networking service (SNS) may be quite different. Therefore, the mobile terminal individually stores key mapping data in units of applications or groups of at least two or more applications, and when an application is executed, by applying various embodiments according to the present invention by referring to key mapping data according to the corresponding application. The user's convenience in using the QWERTY keyboard can be sought.

Accordingly, according to various embodiments of the present disclosure described above, it is possible to minimize the occurrence rate of errors in response to the user's input to the key button(s) and to meet the user's intention. To this end, according to various embodiments of the present invention, key mapping data according to key button input is updated through learning in units of devices or applications, so that adaptive processing or/and virtual keyboards are provided according to situations or provision of the virtual keyboards. Thereafter, the arrangement, size, color, etc. of the key button(s) may be controlled based on the key mapping data in response to the user's access to the key button.

The digital device disclosed in this specification and the data processing method in the digital device are not limited to the configuration and method of the above-described embodiments, but the above embodiments are all or all of the embodiments so that various modifications can be made. Some of them may be selectively combined and configured.

Meanwhile, the operating method of a digital device disclosed in this specification can be implemented as a processor-readable code in a processor-readable recording medium included in a digital device. The processor-readable recording medium includes all types of recording devices in which data readable by the processor is stored. Examples of recording media readable by the processor include Read Only Memory (ROM), Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage devices. It also includes what is implemented in the form of a carrier-wave. In addition, the processor-readable recording medium is distributed in computer systems connected through a network, so that the processor-readable code can be stored and executed in a distributed manner.

On the other hand, although this specification has been described with reference to the accompanying drawings, this is only an embodiment and is not limited to a specific embodiment, and various contents that can be modified and implemented by those skilled in the art to which the invention belongs are also claimed. belongs to the scope of rights according to In addition, such modified implementations should not be individually understood from the technical spirit of the present invention.

201: network interface unit 202: TCP/IP manager
203: service delivery manager 204: SI decoder
205: demultiplexer 206: audio decoder
207: video decoder 208: display unit
209: service control manager 210: service discovery manager
211: SI & metadata database 212: metadata manager
213: service manager 214: UI manager

Claims (20)

In the method of processing data in a digital device,
storing key mapping data related to text data input by a user using a keyboard;
Receiving a keyboard output request;
outputting the requested keyboard on the screen;
Receiving a first touch input for the output keyboard;
determining one key button by referring to the stored key mapping data when the received first touch input is a boundary between a first key button and a second key button in the keyboard;
outputting grapheme data corresponding to the determined key button on a text window;
Receiving a second touch input and a third touch input for the output keyboard;
determining whether the second touch input is a delete key button;
if the second touch input is a delete key button, deleting grapheme data according to the output first touch input and re-outputting grapheme data of a key button according to the third touch input on the text window;
updating and storing text data according to the first to third touch inputs in the stored key mapping data;
Receiving a fourth touch input for the output keyboard;
If the fourth touch input is for completion of at least one of a word, sentence, and paragraph, whether a typo has occurred in at least one of the word, sentence, and paragraph output according to the completion on the text window based on the key mapping data. judging; and
if a typo has occurred as a result of the determination, controlling an output unit to display whether or not the typo has occurred in at least one of the character elements, words, sentences, and paragraphs of the typo;
Data processing method in a digital device comprising a. delete delete delete delete delete delete delete delete delete In a digital device,
a memory for storing key mapping data related to text data input by a user using a keyboard;
a user interface unit that receives a keyboard output request and a first touch input to the keyboard;
an output unit outputting a text window including the requested keyboard and text data according to the first touch input on a screen; and
If the received first touch input is a boundary between a first key button and a second key button in the keyboard, one key button is determined by referring to the stored key mapping data, and grapheme data corresponding to the determined key button is determined. And a control unit for controlling the output unit to output on the text window,
The control unit,
When a second touch input and a third touch input for the output keyboard are received through the user interface unit, it is determined whether the second touch input is a delete key button, and if the second touch input is a delete key button, the output Control the output unit to delete grapheme data according to the first touch input and re-output grapheme data of a key button according to the third touch input on the text window, Control the memory to update and store text data according to the stored key mapping data;
When a fourth touch input for the output keyboard is received through the user interface unit, it is determined whether the fourth touch input is for the completion of at least one of a word, a sentence, and a paragraph, and as a result of the determination, the text window is displayed on the text window. Based on the key mapping data, it is determined whether a typo has occurred in at least one of words, sentences, and paragraphs output according to the completion, and if a typo has occurred as a result of the determination, at least one of the character elements, words, sentences, and paragraphs of the typo Controlling the output unit to display whether the typo has occurred,
digital device. delete delete According to claim 11,
The control unit,
If an error occurs as a result of the determination, one or more key buttons related to the error are displayed so as to be distinguishable from other key buttons on the keyboard, and / and character elements, words, sentences, and characters expected to be corrected by referring to the key mapping data A digital device characterized by generating a key button for at least one of the paragraphs and controlling the output unit to output the generated key button on a keyboard. According to claim 11,
The control unit,
When the keyboard is output on the screen or at least one of the first to third touch inputs is received through the user interface unit, key button(s) or keys having a probability of error occurrence greater than or equal to a threshold by referring to the key mapping data. The digital device characterized in that for controlling the output unit to display a button set to be identifiable from other key buttons on the output keyboard. According to claim 11,
The control unit,
When a specific key button is selected according to the first touch input, controlling the output unit to display the key button (s) of the grapheme related to the grapheme data of the selected key button to be identifiable from other key buttons digital device. According to claim 11,
The control unit,
It is determined whether the language system of the first grapheme data according to the received first touch input is different from the language system of the second grapheme data according to previous or subsequent touch inputs, and if the language system is different from each other as a result of the determination, the Displaying the first grapheme data on a text window so as to be identifiable from other grapheme data, generating key button(s) related to recommended grapheme data to replace the first grapheme data, and A digital device characterized by controlling the output unit to output key button(s). delete delete delete

Images