WO2023277251A1

WO2023277251A1 - A method and system to suggest and control operations on a handheld device for remote display

Info

Publication number: WO2023277251A1
Application number: PCT/KR2021/013061
Authority: WO
Inventors: Saurabh Tiwari; Dharya ARORA; Tushar Kant DEO
Original assignee: Samsung Electronics Co., Ltd.
Priority date: 2021-06-29
Filing date: 2021-09-24
Publication date: 2023-01-05

Abstract

A method of controlling operations in a handheld device for a remote display including identifying a context of usage of the handheld device, wherein the context of usage is related to a user interaction with an application which is used for presenting content on the remote display, generating context information corresponding to the context of usage of the handheld device, wherein the context information indicates at least one operation of the application by a user. The method further includes determining personalized control options based on the context information and displaying the personalized control options.

Description

A METHOD AND SYSTEM TO SUGGEST AND CONTROL OPERATIONS ON A HANDHELD DEVICE FOR REMOTE DISPLAY

The present disclosure generally relates to a customized display options, and particularly relates to methods and systems for suggesting and controlling operations on a handheld device for remote display.

The technical ability of using handheld devices as your primary computer has now become a reality. The handheld devices such as modern smartphones, tablets, etc. are more powerful than the computers used just a few years ago. For this purpose, the handheld devices are now capable of providing docking options to be connected with a remote display. Such a functionality has now made it a platform that turns your handheld device into a desktop computing experience. A user can now connect the handheld device to a supported display wirelessly without any high definition multimedia interface (HDMI) cables. The processor and modules working together in the handheld device projects a full desktop environment to an external monitor in a desktop mode. Applications are optimized for the handheld device look and function similar to what you find in a personal computer (PC) environment so that you can truly experience full computing without having to work with magnified handheld device applications. In other words, a typical handheld device interface is switched into a desktop-optimized interface.

But over the course of time, as the said technical ability evolves and is operated by users' people more often, certain operational challenges were posed. In the user experience, controlling the remote display using the handheld device becomes a cumbersome job. To avoid the handheld device use as touchpad for remote display having no touch capabilities requires external mouse/keyboard, thus creating an extra resource requirement and decreasing the ease of operation of the technical ability. Even, for basic operations as well as performing routine activities on remote display, user engagement becomes very high. The available technology in the similar space fails to provide any solution to provide smart suggestion & controls on handheld device based on user activity and context without interrupting the viewing and experience of content on the remote display.

There is a need for a solution to overcome the above-mentioned drawbacks.

This summary is provided to introduce a selection of concepts in a simplified format that are further described in the detailed description of the present disclosure. This summary is not intended to identify key or essential inventive concepts of the claimed subject matter, nor is it intended for determining the scope of the claimed subject matter. In accordance with the purposes of the disclosure, the present disclosure as embodied and broadly described herein, describes method and system for generating a core dump in a UE.

In accordance with some example embodiments of the inventive concepts, a method of to suggest and control operations in a handheld device for a remote display communicably coupled to the handheld device. The method includes identifying, by an identifier module, a context of usage of the handheld device and the remote display; generating, by the identifier module, a context information corresponding to the context of usage of the handheld device and the remote display; suggesting, by a suggestion module, a personalized control options based on the context information; displaying, by a display module, the personalized control options, wherein the personalized control options are accessible and operable without interrupting the viewing and experience of content on the remote display.

In accordance with some example embodiments of the inventive concepts, a system for to suggest and control operations in a handheld device for a remote display communicably coupled to the handheld device. The handheld device including an identifier module configured to identify a context of usage of the handheld device and the remote display and generate a context information corresponding to the context of usage of the handheld device and the remote display. A suggestion module in communication with the identifier module, the suggestion module is configured to process the context information and suggest a personalized control options based on the context information. The handheld device further includes a display module in communication with the processing module and configured to display the personalized control options, wherein the control options are accessible and operable via said display module without interrupting the viewing and experience of content on the remote display.

In accordance with some example embodiments of the inventive concepts, a method controlling operations in a handheld device for a remote display coupled to the handheld device, the method comprising: identifying a context of usage of the handheld device, wherein the context of usage is related to a user interaction with an application which is used for presenting content on the remote display; generating context information corresponding to the context of usage of the handheld device, wherein the context information indicates at least one operation of the application by a user; determining personalized control options based on the context information; and displaying the personalized control options

In accordance with some example embodiments of the inventive concepts, an apparatus system to control operations in a handheld device for a remote display coupled to the handheld device, wherein the apparatus comprising: a transceiver; and at least one processor coupled to the transceiver, wherein the at least one processor is configured to: identify a context of usage of the handheld device, wherein the context of usage is related to a user interaction with an application which is used for presenting content on the remote display, generate context information corresponding to the context of usage of the handheld device, wherein the context information indicates at least one operation of the application by a user, determine a personalized control options based on the context information, and display the personalized control options

These aspects and advantages will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings and claims.

FIG. 1 illustrates an environment of implementation of a method and system to suggest and control operations in a handheld device for a remote display, in accordance with an embodiment of the present subject matter;

FIG. 2 illustrates a block diagram of the system to suggest and control operations in the handheld device for the remote display, in accordance with an embodiment of the present subject matter;

FIG. 3 illustrates a flowchart of the method to suggest and control operations in the handheld device for the remote display;

FIG. 4-13 illustrate a use case of the method and system to suggest and control operations in a handheld device for a remote display, in accordance with an embodiment of the present subject matter; and

FIG. 14 illustrates a computing device implementation, according to an embodiment of the present disclosure.

Further, skilled artisans will appreciate that elements in the drawings are illustrated for simplicity and may not have been necessarily been drawn to scale. For example, the flow charts illustrate the method in terms of the most prominent steps involved to help to improve understanding of aspects of the present invention. Furthermore, in terms of the construction of the device, one or more components of the device may have been represented in the drawings by conventional symbols, and the drawings may show only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the drawings with details that will be readily apparent to those of ordinary skill in the art having benefit of the description herein.

For the purpose of promoting an understanding of the principles of the invention, reference will now be made to the embodiment illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the invention as illustrated therein being contemplated as would normally occur to one skilled in the art to which the invention relates.

It will be understood by those skilled in the art that the foregoing general description and the following detailed description are explanatory of the invention and are not intended to be restrictive thereof.

Reference throughout this specification to "an aspect", "another aspect" or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrase "in an embodiment", "in another embodiment" and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.

The terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or sub-systems or elements or structures or components proceeded by "comprises... a" does not, without more constraints, preclude the existence of other devices or other sub-systems or other elements or other structures or other components or additional devices or additional sub-systems or additional elements or additional structures or additional components.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skilled in the art to which this invention belongs. The system, methods, and examples provided herein are illustrative only and not intended to be limiting.

For the sake of clarity, the first digit of a reference numeral of each component of the present disclosure is indicative of the Figure number, in which the corresponding component is shown. For example, reference numerals starting with digit "1" are shown at least in Figure 1. Similarly, reference numerals starting with digit "2" are shown at least in Figure 2, and so on and so forth.

Embodiments of the present subject matter are described below in detail with reference to the accompanying drawings.

FIG. 1 illustrates a block diagram depicting an environment 100 of implementation of a method and system to suggest and control operations in a handheld device for a remote display communicably coupled to the handheld device. In an embodiment of the invention, the environment 100 includes for example, the handheld device 110, the remote display 120. The handheld device 110 is in communication 130 with the remote display 120. In an example but is not limited to the handheld device 110 is wirelessly communicably coupled to the remote display 120. The handheld device 110 may be connected to the remote display 120 using wire cables. In an embodiment of the invention, the remote display 120 acts as external display the handheld device 110 projects full working environment of the handheld device 110 on the remote display 120. In an embodiment of the invention, the handheld device 110 suggests a personalized control options 112 based on a context of usage of the handheld device 110 for remote displaying. A user operating the handheld device 110 and projecting full working environment on the remote display 120 is able to view a content 122 on the remote display 120, thus generating the context of usage to be identified by the handheld device 110 for suggesting the personalized control options 112.

The handheld device 110 may include, but is not limited to smartphones, smart tablets. The remote display 120 may include, but is not limited to smart television, monitor, any other user interface providing device.

FIG. 2 illustrates a block diagram of the system 200 to suggest and control operations in the handheld device for the remote display, according to an embodiment of the present subject matter. In an embodiment of the invention, the system 200 but is not limited to, a processor 202, a memory 204, and data 208. The system further includes modules 206 which along with the memory 204 may be coupled to the processor 202.

In an embodiment, the modules 206 may include an identifier module 210, a suggestion module 220, an artificial intelligence (AI) module 230 and a display module 240. The identifier module 210, the suggestion module 220, the AI module 240 and the display module 240, may be in communication with each other. The data 208 serves, amongst other things, as a repository for storing data processed, received, and generated by one or more of the modules 206.

The modules 206, amongst other things, include routines, programs, objects, components, data structures, etc., which perform particular tasks or implement data types, according to embodiments of the present subject matter. The modules 206 may also be implemented as, signal processor(s), state machine(s), logic circuitries, and/or any other device or component that manipulate signals based on operational instructions.

Further, the modules 206 can be implemented in hardware, instructions executed by a processing unit, or by a combination thereof. The processing unit can comprise a computer, a processor, such as the processor 202, a state machine, a logic array, or any other suitable devices capable of processing instructions. The processing unit can be a general-purpose processor which executes instructions to cause the general-purpose processor to perform the required tasks or, the processing unit can be dedicated to performing the required functions. In another embodiment of the present disclosure, the modules 206 may be machine-readable instructions (software) which, when executed by a processor/processing unit, perform any of the described functionalities.

Referring to FIG.1 and FIG.2, the handheld device 110, may receive user interaction. In an embodiment, the identifier module 210 is configured to recognize the user interaction with the handheld device 110 for identifying a context of usage. In an embodiment, the context of usage is identified when the user interacts with the handheld device 110 for remote display 120 of the content 122.

In an embodiment, the identifier module 210 generates context information corresponding to the identified context of usage of the handheld device 110 and the remote display 120.

In an embodiment, the AI module 230 is in communication with the identifier module 210. The AI module 230 is configured to identify the context of usage of the handheld device 110. The artificial intelligence (AI) module 230, is further configured to generate the context information based on learning of the AI module from the identified context of usage of the handheld device.

In an embodiment, the suggestion module 220 is in communication with the identifier module. The suggestion module 220 is configured to receive the context information and generates the personalized control options 112 based on the context information. The context information is indicative of the user's interaction with the handheld device 110 for remote display 120. Further, the suggestion module may modify the personalized control options 112 depending on the context information.

In an embodiment, the display module 240 is in communication with the suggestion module 220. The display module 240 is configured to display the personalized control options 112 on the handheld device 110 for the user to select. The personalized control options 112 are accessible and may be operated by the user on the handheld device 110 without interrupting the viewing and experience of content 122 on the remote display 120. Further, the personalized control options 112 are displayed on the handheld device 110 depending on an operational state of the remote display.

Fig. 3 illustrates a flowchart of a method 300 of suggesting and controlling operations in the handheld device 110 for the remote display 120, according to an embodiment of the present subject matter. The method 300 may be a computer-implemented method executed, for example, by the handheld device 110. For the sake of brevity, constructional and operational features of the system 200 that are already explained in the description of Figure 1, Figure 2, are not explained in detail in the description of Figure 3.

At step 310, the identifier module 210 identifies a context of usage of the handheld device 110 and the remote display 120. In an embodiment, the context of usage is identified when the user interacts with the handheld device 110 for remote display 120 of the content 122.

In an example embodiment, the user interaction may include, but is not limited to, when the user selects an application for accessing, the identifier module 210 may determine a usage pattern of the user based on the accessed applications on the handheld device 110 by the user. The usage patterns correspond to identifying the applications accessed by the user. The usage pattern may also include, time duration, type of applications accessed by the user.

In an example embodiment, the user interaction may include, but is not limited to, when the user selects an application for accessing, the identifier module 210 may determine a functionality of the selected application. The functionality is understood as determining the range of operations that can be performed by the selected application. The identifier module 210 identifies the application selected by the user and further determines the functionality of the selected application for further steps.

In an example embodiment, the user interaction may include but is not limited to, when the user selects an application for accessing, the identifier module 210 may determine a context of the selected application. The determination of the context by the identifier module 210 may include, understanding the context of the application selected by the user. The user when interacting with the selected application may perform various operations thus creating the context for the identifier module 210 to be determined. The identifier module 210 determines the operations performed by the user with the selected application for further steps.

In an example embodiment, the user interaction may include but is not limited to, when the user selects an application for accessing, the identifier module 210 may determine a location of the user. The identifier module 210 determines the location for establishing a relationship between the selection of the application on handheld device 110 at the given location.

At step 320, the identifier module 210 generates context information corresponding to the context of usage of the handheld device 110 and the remote display 120. The context information is based on the identification of the context of usage of the handheld device 110 as mentioned in the example embodiments above.

In an embodiment of the present subject matter, the artificial intelligence (AI) module 230, generates the context information based on learning of the AI module from the identified context of usage of the handheld device. The AI module 230 is in communication with the identifier module 210 for identifying the context of usage of the handheld device 110. The AI module 230 is trained from the user interaction with the handheld device 110. The AI module 230 learns the user interaction and generate the context information accordingly.

In an example, the AI module 230 may include, but is not limited to, identifying the context of usage including the usage pattern and determining the context information including user application selection pattern. In an example, when the user selects multiple applications together and the AI module 230 is trained to learn the user preferences of selecting the application. Learning this pattern of user selection, trains the AI module 230 to generate content information when the user again selects the similar application.

In an example, the AI module 230 may include, but is not limited to, identifying the context of usage including the identification of the selected application by the user and determining the functionality of the application for clustering applications of similar functionality together upon determining the functionality of the selected application for generating context information. Thus, the context information may include the applications with similar functionality.

At step 330, the suggestion module 220, processes the context information and generates the personalized control options 112 based on context information. The context information is indicative of the user's interaction with the handheld device 110 for remote display 120. Therefore, the suggestion module processes the context information to interpret the user interaction for suggesting the personalized control options 112. The personalized control options 112 are in form of recommendations including tools and other applications to the user for controlling the content 122 displayed on the remote display 120. Further, the suggestion module may modify the personalized control options 112 depending on the context information.

At step 340, the display module 240, displays the personalized control options 112 on the handheld device 110 for the user to select. The personalized control options 112 are accessible and may be operated by the user on the handheld device 110 without interrupting the viewing and experience of content 122 on the remote display 120. Further, the personalized control options 112 are displayed on the handheld device 110 depending on an operational state of the remote display.

FIG.4 is a use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as workbook and is performing calculation on workbook. The context information thus generated by the identifier module 210 is indicative that the user is performing operation of calculation on workbook. Thus, the identifier module 210 determines said operation as similar to past usage pattern of the user. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include calculator and help control option. The display module 240 displays calculator and help control option on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 5 is a use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as image viewing application. The context information thus generated by the identifier module 210 is indicative that the user is performing operation of viewing images. Thus, the identifier module 210 determines said operation as the context of the application. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include other applications present in database of handheld device 110 which can be used for image viewing and are of the similar functional category. The display module 240 displays the personalized control options 112 on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 6 is a use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as a video viewing application for example, YouTube. The context information thus generated by the identifier module 210 is indicative that the user is performing operation of viewing videos. Thus, the identifier module 210 determines said operation as the context of the application. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include other applications present in database of handheld device 110 which can be used for video viewing and are of the similar functional category for example Netflix, amazon prime. The display module 240 displays the personalized control options 112 on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 7 is a use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as an image. The context information thus generated by the identifier module 210 is indicative that the user is performing operation of viewing images. Thus, the identifier module 210 determines said operation as the context of the application. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include other images stored in the handheld device 110 of persons present in the image as displayed on the remote display 112. The identifier module 110 identifies the person present in the image and thus the generated context information is indicative that the user is performing operation of viewing image of a particular person. Thus, the suggestion module 220, generates the personalized control object 112 as images of the person whose face is identified in the content 122 displayed on the remote display 120.

FIG. 8 is another use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as a video for example, playing video on YouTube. The context information thus generated by the identifier module 210 is indicative that the user is performing operation of viewing videos. Thus, the identifier module 210 determines said operation as the context of the application. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include for example, other videos identified of the similar functional category listed on the handheld device 110. The display module 240 displays the personalized control options 112 on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 9 is another use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as a video for example, playing video on YouTube. The context information generated by the identifier module 210 is indicative that the user is performing operation of viewing videos. Now, if the user performing a gesture on the handheld device 110 then, the context information generated by the identifier module 210 is indicative that the user is performing operation of viewing videos and performing gesture. Thus, the identifier module 210 determines said operation as the context of the application. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include based on the predefined gesture performed by the user a media control extension tools are displayed on the handheld device 110. The display module 240 displays the personalized control options 112 on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 10 is another use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as a text reader. The context information thus generated by the identifier module 210 is indicative that the user is performing operation of viewing text. Thus, the identifier module 210 determines said operation as the context of the application. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include for example, tools identified based on the past usage pattern of the user, for example, tools for cut, copy, paste the text. The display module 240 displays the personalized control options 112 on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 11 is another use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as a map. The usage of the content 122 map is associated with a location based on the learning of the AI module 230 from the past usage pattern of the user. Therefore, the context information thus generated by the identifier module 210 is indicative that the user is performing operation of viewing maps along with the location data. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 may include options based on the past usage pattern of the user while accessing the application map at the similar location, for example, petrol station, restaurant. The display module 240 displays the personalized control options 112 on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 12 is another use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user selects the content 122 as a video for example, playing video on YouTube. The context information generated by the identifier module 210 is indicative that the user is performing operation of viewing videos. Thus, the identifier module 210 determines said operation as the context of the application. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 for example may include volume control tool and brightness control tool. The display module 240 displays the personalized control options 112 on the handheld device 110 without interrupting viewing and experience of the content 122 on remote display 120.

FIG. 13 is another use case illustrating the method and system to suggest and control operations in the handheld device 110 for a remote display 120. The example may include the handheld device 110, the remote display 120, the personalized control options 112. The handheld device 110 may be in wireless communication 130 with the remote display 120 for viewing content 122 on the remote display 120. In the present example, the identifier module 210 identifies the context of usage when the user interacts with the handheld device 110 by selecting the application for viewing and experience on the remote display 120. The user interaction is initiated in this example when the user interacts with the handheld device 110 and it appears that the handheld device 110 due to security is in locked state. The context information generated by the identifier module 210 is indicative that the user is initiating the interaction and the handheld device 110 is locked. The context information is processed by the suggestion module 220 for suggesting the personalized control options 112. In this example, the personalized control options 112 for example may include keypad to unlock the handheld device 110. The display module 240 displays the personalized control options 112 on the handheld device 110.

FIG. 14 illustrates a computing device implementation of the system and method of the present subject matter, according to an embodiment of the present disclosure.

The present figure essentially illustrates the hardware configuration of the system 200 in the form of a computer system 1400. The computer system 1400 may include a set of instructions that can be executed to cause the computer system 1400 to perform any one or more of the methods disclosed. The computer system 1400 may operate as a standalone device or may be connected, e.g., using a network, to other computer systems or peripheral devices.

In a networked deployment, the computer system 1400 may operate in the capacity of a server or as a client user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. The computer system 1400 can also be implemented as or incorporated into various devices, such as a personal computer (PC), a tablet PC, a personal digital assistant (PDA), a mobile device, a palmtop computer, a laptop computer, a desktop computer, a communications device, a handheld device, a wireless telephone, a land-line telephone, a web appliance, a network router, switch or bridge, or any other machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while a single computer system 1400 is illustrated, the term "system" shall also be taken to include any collection of systems or sub-systems that individually or jointly execute a set, or multiple sets, of instructions to perform one or more computer functions.

The computer system 1400 may include a processor 202 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both. The processor 202 may be a component in a variety of systems. For example, the processor 202 may be part of a standard personal computer or a workstation. The processor 202 may be one or more general processors, digital signal processors, application specific integrated circuits, field programmable gate arrays, servers, networks, digital circuits, analog circuits, combinations thereof, or other now known or later developed devices for analyzing and processing data The processor 202 may implement a software program, such as code generated manually (i.e., programmed).

The computer system 1400 may include a memory 204, such as a memory 204 that can communicate via a bus 1408. The memory 204 may be a main memory, a static memory, or a dynamic memory. The memory 204 may include but is not limited to computer readable storage media such as various types of volatile and non-volatile storage media, including but not limited to random access memory, read-only memory, programmable read-only memory, electrically programmable read-only memory, electrically erasable read-only memory, flash memory, magnetic tape or disk, optical media, and the like. In one example, the memory 204 includes a cache or random-access memory for the processor 202. In alternative examples, the memory 204 is separate from the processor 202, such as a cache memory of a processor, the system memory, or other memory. The memory 204 may be an external storage device or database for storing data. Examples include a hard drive, compact disc ("CD"), digital video disc ("DVD"), memory card, memory stick, floppy disc, universal serial bus ("USB") memory device, or any other device operative to store data. The memory 204 is operable to store instructions executable by the processor 202. The functions, acts or tasks illustrated in the figures or described may be performed by the programmed processor 202 executing the instructions stored in the memory 204. The functions, acts or tasks are independent of the instructions set, storage media, processor or processing strategy and may be performed by software, hardware, integrated circuits, firmware, micro-code and the like, operating alone or in combination. Likewise, processing strategies may include multiprocessing, multitasking, parallel processing, and the like.

As shown, the computer system 1400 may or may not further include a display unit 1410, such as a liquid crystal display (LCD), an organic light emitting diode (OLED), a flat panel display, a solid-state display, a cathode ray tube (CRT), a projector, a printer or other now known or later developed display device for outputting determined information. The display 1410 may act as an interface for the user to see the functioning of the processor 202, or specifically as an interface with the software stored in the memory 204 or in the drive unit 1416.

Additionally, the computer system 1400 may include an input device 1412 configured to allow a user to interact with any of the components of system 1400. The input device 1412 may be a number pad, a keyboard, or a cursor control device, such as a mouse, or a joystick, touch screen display, remote control, or any other device operative to interact with the computer system 1400.

The computer system 1400 may also include a disk or optical drive unit 1416. The disk drive unit 1416 may include a computer-readable medium 1422 in which one or more sets of instructions 1424, e.g., software, or modules 206 can be embedded. Further, the instructions 1424 may embody one or more of the methods or logic as described above. In a particular example, the instructions 1424 may reside completely, or at least partially, within the memory 204 or within the processor 202 during execution by the computer system 1400. The memory 204 and the processor 202 also may include computer-readable media as discussed above.

The present invention contemplates a computer-readable medium that includes instructions 1424 or receives and executes instructions 1424 responsive to a propagated signal so that a device connected to a network 1426 can communicate voice, video, audio, images or any other data over the network 1426. Further, the instructions 1424 may be transmitted or received over the network 1426 via a communication port or interface 1420 or using a bus 1408. The communication port or interface 1420 may be a part of the processor 202 or may be a separate component. The communication port or interface 1420 may include a transceiver. A transceiver may be connected to the processor 202. The communication port 1420 may be created in software or may be a physical connection in hardware. The communication port or interface 1420 may be configured to connect with a network 1426, external media, the display 1410, or any other components in computer system 1400 or combinations thereof. The connection with the network 1426 may be a physical connection, such as a wired Ethernet connection or may be established wirelessly as discussed later. Likewise, the additional connections with other components of the computer system 1400 may be physical connections or may be established wirelessly. The network 1426 may alternatively be directly connected to the bus 1408.

The network 1426 may include wired networks, wireless networks, Ethernet AVB networks, or combinations thereof. The wireless network may be a cellular telephone network, an 802.11, 802.16, 802.20, 802.1Q or WiMax network. Further, the network 1426 may be a public network, such as the Internet, a private network, such as an intranet, or combinations thereof, and may utilize a variety of networking protocols now available or later developed including, but not limited to TCP/IP based networking protocols.

In an example, dedicated hardware implementations, such as application specific integrated circuits, programmable logic arrays and other hardware devices, can be constructed to implement various parts of the system 200. A detailed implementation of the system 200 is as explained in the above paragraphs.

While specific language has been used to describe the present disclosure, any limitations arising on account thereto, are not intended. As would be apparent to a person in the art, various working modifications may be made to the method in order to implement the inventive concepts as taught herein. The drawings and the foregoing description give examples of embodiments. Those skilled in the art will appreciate that the described elements may well be combined into a single functional element. Alternatively, certain elements may be split into multiple functional elements. Elements from one embodiment may be added to another embodiment. Clearly, the present disclosure may be otherwise variously embodied, and practiced within the scope of the following claims.

Claims

A method of controlling operations in a handheld device for a remote display coupled to the handheld device, the method comprising:

identifying a context of usage of the handheld device, wherein the context of usage is related to a user interaction with an application which is used for presenting content on the remote display;

generating context information corresponding to the context of usage of the handheld device, wherein the context information indicates at least one operation of the application by a user;

determining personalized control options based on the context information; and

displaying the personalized control options.
The method of claim 1, further comprising:

determining a user interaction with the handheld device for identifying the context of usage,

wherein determining a user interaction with the handheld device comprising:

identifying the application selected by a user; and

determining a usage pattern of the application for generating the context information.
The method of claim 2, wherein determining the user interaction with the handheld device for identifying the context of usage comprising:

identifying the application selected by the user; and

determining a functionality of the application for generating the context information.
The method ofclaim 2, wherein determining the user interaction with the handheld device for identifying the context of usage comprising:

identifying the application selected by the user; and

determining a location of the user when the application is selected by the user for generating the context information.
The method of claim 2, wherein determining the user interaction with the handheld device for identifying the context of usage comprising:

identifying the application selected by the user; and

determining a context of the application for generating the context information.
The method of claim 1,

wherein the handheld device further includes an artificial intelligence (AI) module, and

wherein the method further comprising:

generating the context information based on learning of the AI module from the identified context of usage of the handheld device.
The method of claim 1, further comprising:

modifying the personalized control options based on the context information.
The method of claim 1, further comprising:

displaying the personalized control options on the handheld device depending on an operational state of the remote display.
An apparatus system to control operations in a handheld device for a remote display coupled to the handheld device, wherein the apparatus comprising:

a transceiver; and

at least one processor coupled to the transceiver, wherein the at least one processor is configured to:

identify a context of usage of the handheld device, wherein the context of usage is related to a user interaction with an application which is used for presenting content on the remote display,

generate context information corresponding to the context of usage of the handheld device, wherein the context information indicates at least one operation of the application by a user,

determine a personalized control options based on the context information, and

display the personalized control options.
The apparatus of claim 9, wherein the at least one processor is further configured to:

determine a user interaction with the handheld device for identifying the context of usage,

identify the application selected by a user, and

determine a usage pattern of the application for generating the context information.
The apparatus of claim 10, wherein the at least one processor is further configured to:

identify the application selected by the user, and

determine functionality of the application for generating the context information.
The apparatus of claim 10, wherein the at least one processor is further configured to:

identify the application selected by the user, and

determine a location of the user when the application is selected by the user for generating the context information.
The apparatus of claim 10, wherein the at least one processor is further configured to:

identify the application selected by the user, and

determining a context of the application for generating the context information.
The apparatus of claim 9, wherein the apparatus is co at least one processor is further configured to:

generate the context information based on learning of an artificial intelligence (AI) module from the identified context of usage of the handheld device, wherein the AI module is included in the handheld device and coupled to the at least one processor.
The apparatus of claim 9, wherein the at least one processor is configured to:

modify the personalized control options based on the context information, and

display the control options on the handheld device depending on an operational state of the remote display.