TWI824729B - Authorizing method of host apparatus, non-transitory computer readable storage medium, and host apparatus - Google Patents

Abstract

An authorizing method of host apparatus, non-transitory computer-readable storage medium, and a host apparatus are provided. In the method, logging in a cloud database by a host account and a host password; obtaining the first account and the first password of a first apparatus from the cloud database; determining whether the host account is the same as the first account; determining whether the host password is the same as the first password; obtaining a first network data if both are yes; obtaining the horst network data; and determining whether the first apparatus belongs to the same network with the host apparatus. The first account, the password, and the first network data are all corresponding to the first apparatus. Accordingly, a dual verification mechanism is provided.

Description

Authorization methods for host devices, non-transitory computer-readable storage media, and host devices

The present invention relates to an authorization and cross-device operation technology, and in particular to an authorization method for a host device, a non-transitory computer-readable storage medium and a host device.

Existing cross-device technology can transfer photos and videos captured through the lens of a mobile phone to a laptop or tablet, and play the photos and videos on the laptop or tablet accordingly. However, the authorization protection mechanism of existing cross-device technologies is easily cracked, and the operations on the user interface are not intuitive.

In view of this, embodiments of the present invention provide an authorization method for a host device, a non-transitory computer-readable storage medium, and a host device, which have a dual protection mechanism and provide diversified cross-device applications.

The authorization method of the host device in the embodiment of the present invention includes (but is not limited to) the following steps: log in to the cloud database through the host account and host password; obtain the first account and first password of the first device from the cloud database; Determine whether the first account is the same as the host account; determine whether the first password is the same as the host password; if both are the same, obtain a first network information; obtain the host network information of the host device; and according to the first The network data and the host network data are used to determine whether the first device and the host device belong to the same network. The first account, the first password and the first network information all correspond to the first device.

The authorization method of the host device in the embodiment of the present invention includes (but is not limited to) the following steps: perform identity verification through the host device to log in to the cloud database; obtain a logged-in device that has passed identity verification from the cloud database; determine the logged-in device, Whether it is an in-network device; and if so, the function of the host device is authorized to control the device agent.

The non-transitory computer-readable storage medium of the embodiment of the present invention is used to store program codes. The processing unit loads program code to execute the authorization method of the host device as described above.

The host device in the embodiment of the present invention includes (but is not limited to) a communication unit, a storage unit and a processing unit. The communication unit is used to transmit or receive signals. Storage units are used to store program code. The processing unit is coupled to the communication unit and the storage unit, and is used to load and execute the program code to perform the above authorization method of the host device.

Based on the above, according to the authorization method of the host device, the non-transitory computer readable storage medium and the host device according to the embodiment of the present invention, it can be confirmed whether the host device logged in through the host account and the host password has a device recorded in the cloud database. Or confirm whether the logged-in device is an on-network device to provide a double protection mechanism. In addition, after passing the verification, the embodiment of the present invention can also authorize the functions of the host device to other device agents to implement cross-device applications.

In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, embodiments are given below and described in detail with reference to the accompanying drawings.

Figure 1 is a schematic diagram of a system 1 according to an embodiment of the present invention. Referring to FIG. 1 , the system 1 includes (but is not limited to) a host device 10 , client devices 21 , 22 , 31 , 41 , 51 , and a cloud database 70 .

The host device 10 includes (but is not limited to) a communication unit 11 , a storage unit 12 , a processing unit 13 , a display unit 14 , a speaker unit 15 and an input unit 16 . The host device 10 may be a personal computer, a notebook computer, a tablet computer, a smart phone, a server, a voice assistant device, a vehicle system or a smart home appliance.

The communication unit 11 may support, for example, fourth generation (4G) or other generations of mobile communications, Wi-Fi, Bluetooth, infrared, radio frequency identification (Radio Frequency Identification, RFID), Ethernet, optical fiber network Such as communication transceiver, serial communication interface (such as RS-232), Universal Serial Bus (USB), Thunderbolt or other communication transmission interface. In one embodiment, the communication unit 11 is used to transmit or receive data with other electronic devices (eg, client devices 21, 22, 31, 41, 51, or cloud database 70).

The storage unit 12 may be any type of fixed or removable random access memory (Radom Access Memory, RAM), read only memory (Read Only Memory, ROM), flash memory (flash memory), or traditional hard disk. (Hard Disk Drive, HDD), solid-state drive (Solid-State Drive, SSD) or similar components. In one embodiment, the storage unit 12 is used to store program codes, software modules, configurations, data (eg, data, accounts, passwords, instructions, or protocols) or files, which will be described in detail in subsequent embodiments.

The processing unit 13 is coupled to the communication unit 11 and the storage unit 12 . The processing unit 13 may be a central processing unit (CPU), a graphics processing unit (GPU), or other programmable general-purpose or special-purpose microprocessor (Microprocessor), digital signal processing Digital Signal Processor (DSP), programmable controller, Field Programmable Gate Array (FPGA), Application-Specific Integrated Circuit (ASIC) or other similar components or A combination of the above elements. In some embodiments, the functions of the processing unit 13 may be implemented in software or integrated circuits. In one embodiment, the processing unit 13 is used to execute all or part of the operations of the host device 10, and can load and execute the program code stored in the storage unit 12 to execute or implement the method process of the embodiment of the present invention. In one embodiment, the base body of the host device 10 is used to accommodate the processing unit 13 .

The display unit 14 is coupled to the processing unit 13 . The display unit 14 may be a Liquid-Crystal Display (LCD), a Light-Emitting Diode (LED) display, an Organic Light-Emitting Diode (OLED) display, or other displays. In one embodiment, the display unit 14 is used to display images, text, videos, user interfaces or combinations thereof. In one embodiment, the display body of the host device 10 is pivotally connected to the base body, and the display body is used to accommodate the display unit 14 .

The speaker unit 15 is coupled to the processing unit 13 . The speaker unit 15 may be a speaker or a loudspeaker. In one embodiment, the speaker unit 15 plays sounds.

The input unit 16 is coupled to the processing unit 13 . The input unit 16 may be a keyboard, mouse, touch panel, joystick, microphone or handheld controller. In one embodiment, the input unit 16 is used to receive user operations and generate user instructions accordingly. The instructions below all refer to instructions generated by the input unit 16 in response to user operations (for example, pressing, sliding, or voice input), and the details of the instructions will be detailed in subsequent embodiments.

The client devices 21, 22, 31, 41, 51 may be personal computers, laptops, tablets, smartphones, servers, voice assistant devices, vehicle systems or smart home appliances. It should be noted that the number of client devices 21, 22, 31, 41, 51 and the networks to which they belong are not limited to those shown in Figure 1.

The cloud database 70 may be a server, a personal host or a network storage. In one embodiment, the cloud database 40 is used to store accounts, passwords, device lists and/or other verification information of one or more electronic devices.

In the following, various devices, components and modules in the system 1 will be used to describe the method described in the embodiment of the present invention. Each process of this method can be adjusted according to the implementation situation, and is not limited to this.

FIG. 2 is a flow chart of an authorization method of the host device 10 according to an embodiment of the present invention. Referring to FIG. 2 , the processing unit 13 of the host device 10 logs into the cloud database 70 through the communication unit 11 using the host account and host password (step S210 ). Specifically, the processing unit 13 can obtain the host account and host password input by the user through the input unit 16 . Alternatively, the processing unit 13 obtains the host account and host password from the storage unit 12 . If the host account and host password have been registered, the host device 10 can successfully log in to the cloud database 70 . If the host account and host password have not been registered, the host device 10 cannot log in to the cloud database 70 .

The processing unit 13 obtains the first account and the first password of the first device from the cloud database 70 through the communication unit 11 (step S220). Specifically, the cloud database 70 stores one or more devices (eg, client devices 21, 22, 31, 41, 51) and the accounts and passwords used by these devices to log in to the cloud database 70. The first device is one of these devices.

The processing unit 13 determines whether the first account is the same as the host account (step S230); and determines whether the first password is the same as the host password (step S240). That is, the host device 10 searches the cloud database 70 for devices (eg, client devices 21, 22, 41 and the host device 10) or device lists that have logged in with the same host account and host password. If the first account is the same as the host account and the first password is the same as the host password, it means that the host account is the same as the first account used by the first device to log in to the cloud database 70, and the host password is the same as that used by the first device. The first password to log into the cloud database 70.

If the judgment results of the above-mentioned steps S220 and S230 are both "yes", the processing unit 13 obtains the first network data through the communication unit 11 (step S250). Specifically, the first network data is the network data of the first device. In one embodiment, the first network information includes a first network protocol address. The first network protocol address is the network protocol address used by the first device to log into the cloud database 70 . The network protocol may be Internet Protocol (IP), Media Access Control (Media Access Control, MAC) protocol, Ethernet (Ethernet) protocol or other protocols. In another embodiment, the first network data may be other identification codes used to identify the first device in the network.

The processing unit 13 obtains the host network information of the host device 10 (step S260). In one embodiment, the host network information includes a host network protocol address. Examples of the network protocol address and network data have been explained in step S250 and will not be repeated here. The host IP address is the IP address used by the host device 10 to log in to the cloud database 70 . In another embodiment, the host network data may be other identifiers used to identify the host device 10 on the network.

The processing unit 13 determines whether the first device and the host device belong to the same network NW according to the first network data and the host network data (step S270). In one embodiment, the same network NW includes the same wireless network (eg, cellular network, Wireless Local Area Networks (WLAN), satellite communication network or terrestrial microwave network), the same wired network (for example, Ethernet, dial-up network), or the same Virtual Private Network (VPN). In other embodiments, the same network NW may be a network that supports the same or is compatible with other communication technologies (eg, Bluetooth, Ultra-Wideband (UWB)).

In one embodiment, when the first network number of the first IP address of the first device (eg, the number of a specific bit of the IP address) is the same as the host IP address of the host device 10, When the channel numbers are the same, the processing unit 13 determines that the first device and the host device 10 belong to the same network NW. For example, if the first 24 bits (each eight bits are decimal 0 to 255) of two network protocol addresses are the same, then the two network protocol addresses belong to the same (sub)network NW.

In one embodiment, when the time for querying the first network protocol address has not expired, the processing unit 13 determines that the first device and the host device 10 belong to the same network NW. The timeout criterion is, for example, 5, 10 or 30 seconds. The processing unit 13 pings the first network protocol address (taking the IP address as an example) through the network NW through the communication unit 11 . If the response packet can be successfully received, the processing unit 13 determines that the first device and the host device 10 belong to the same network NW. If the ping wait times out, the processing unit 13 determines that the first device and the host device 10 do not belong to the same network NW.

In one embodiment, if the host device 10 and the first device belong to the same network NW, the processing unit 13 stores the host device 10 and the first device as a list of devices on the same network for subsequent comparison.

In one embodiment, if the host device 10 and any first device do not belong to the same network NW, the processing unit 13 displays prompt content (for example, a text message of "no connection object") through the display unit 14 .

In the case of system 1 in FIG. 1 , although the client device 31 is connected to the network NW, the client device 31 has not logged into the cloud database 70 with the same account number and password. If the list of co-network devices is modified so that the client device 31 is added to the list of co-network devices, the information of the host device 10 may be leaked to the client device 31, thus causing security concerns.

The client device 41 is not connected to the network NW but has logged into the cloud database 70 with the same account number and password. If the list of co-network devices is modified so that the client device 41 is added to the list of co-network devices, the host device 10 will be unable or difficult to control the client device 41 . For example, the image desired to be displayed by the host device 10 cannot be displayed on the client device 41 through wireless mirroring.

Since the client device 51 is not connected to the network NW and has not logged into the cloud database 70 with the same account and password, the host device 10 cannot sense the existence of the client device 51 .

Through the double verification mechanism (that is, account password and the same network) of the embodiment of the present invention, information leakage can be avoided, and cross-device applications can also be provided.

FIG. 3 is a flow chart of function selection according to an embodiment of the present invention. Referring to FIG. 3 , if the first device and the host device 10 belong to the same network NW, the display unit 14 of the host device 10 displays the first name and the first icon corresponding to the first device (step S310 ). The first name is, for example, an object attribute, a device type, a device identifier, or an Internet protocol address. The first icon is, for example, a first computer icon, a first mobile phone icon, or a first television icon.

For example, FIG. 4A to FIG. 4G are flowcharts of a function agent of a single client according to an embodiment of the present invention. Referring to FIG. 4A , the first names FI displayed by the display unit 14 are "Client A" and "Client B", and their first icons FI (for example, icons of mobile phones and tablet computers).

The processing unit 13 receives the first device command (corresponding to the first name and the first icon (step S320)) through the input unit 16. Depending on the technology of the input unit 16, the first device command may be a first device touch command or a first device touch command. Device voice command. For example, the user clicks on the user interface with a finger. For another example, the user pronounces "first name". Taking Figure 4B as an example, assuming that the first device command selects "Client A", the display unit 14 "Client A" can be prompted for selection (e.g., check icon).

The processing unit 13 displays the first function menu of the first device through the display unit 14 (step S330). The first function menu is a function that the first device can support or can proxy. Taking Figure 4C as an example, the function can be a lens, a screen, a microphone or a writing pad.

In one embodiment, the processing unit 13 may display the continue option through the display unit 14 . For example, the "next step" shown in Figure 4B. The processor 13 may receive a continuation instruction corresponding to the continuation option through the input unit 16 . Depending on the technology of the input unit 16, the continuation instruction may be a continuation touch instruction or a continuation voice instruction. For example, the user clicks "Next" in the user interface with their finger. For another example, the user pronounces "next step". Then, the processing unit 13 displays the first function menu through the display unit 14 .

The processing unit 13 receives the first function instruction (corresponding to the first function menu) (step S340). Depending on the technology of the input unit 16, the first function instruction is, for example, a first function touch instruction or a first function voice instruction. Referring to Figure 4D, the user clicks on the handwriting pad with his fingers. For another example, the user pronounces "shot". That is, the first function instruction selects one or more functions in the first function menu.

In one embodiment, the processing unit 13 can display the connection options through the display unit 14 . Taking Figure 4D as an example, the user interface of the first function menu further includes a "Connect" option. The processing unit 13 can receive a connection instruction corresponding to the connection option through the input unit 16, so as to connect with the first device corresponding to the first device instruction through the communication unit 11. Depending on the technology of the input unit 16, the connection command is, for example, a connection touch command or a connection voice command.

Referring to FIG. 4E and FIG. 4F , if the connection can be successful, the touch panel of the first device (for example, the client device 21 of FIG. 1 ) can be used as the tablet of the host device 10 . For another example, please refer to FIG. 4G , the screen displayed by the display unit 14 can be projected to the client device 21 . Detailed description of functional agents will be introduced in subsequent embodiments.

Similarly, the processing unit 13 receives the second device command (corresponding to the second name and the second icon) through the input unit 16 (step S325). Depending on the technology of the input unit 16, the second device command may be a second device touch command or a second device voice command. For example, the user clicks on the user interface with his finger. For another example, the user pronounces "first name". Taking FIG. 4A as an example, assume that the second device instruction selects "Client B".

The processing unit 13 displays the second function menu of the first device through the display unit 14 (step S335). The second function menu is a function that another first device can support or can proxy.

The processing unit 13 receives the second function instruction (corresponding to the second function menu) (step S345). Depending on the technology of the input unit 16, the second function instruction is, for example, a second function touch instruction or a second function voice instruction. For example, a lens where the user clicks with their finger. For another example, the user pronounces "microphone". That is, the second function instruction selects one or more functions in the second function menu.

It can be seen from this that separate function selections can be provided for one or more first devices in the same network NW.

5A to 5F are flowcharts of a multi-client functional agent according to an embodiment of the present invention. Please refer to FIG. 5A and FIG. 5B. The first device command and the second device command respectively correspond to two first devices ("Client A" and "Client B" in the figure). Referring to FIG. 5C and FIG. 5D , the first function instruction corresponds to the microphone of the first function menu of "Client A", and the second function instruction corresponds to the lens of the second function menu of "Client B".

Please refer to FIG. 5E and FIG. 5F . If the connection can be successful, the touch panel of the first device (for example, the client device 21 of FIG. 1 ) can be used as the writing pad of the host device 10 , and at the same time, another first device (for example, the client device 21 of FIG. 1 ) can be used as a writing pad. , the microphone of the client device 22) of FIG. 1 may provide voice input to the host device 10. Similarly, detailed descriptions about functional agents will be introduced in subsequent embodiments.

FIG. 6 is a flow chart of transmission processing according to an embodiment of the present invention. Referring to FIG. 6 , the processing unit 13 can determine the connection status between the communication unit 11 and the first device (step S610 ). Connection situations include successful connection and failed connection. If the host device 10 is successfully connected to the first device, the processing unit 13 displays the first connection success (text, pattern or other visual prompt) through the display unit 14 . For example, FIG. 4E shows that the host device 10 is successfully connected to a first device, and FIG. 5E shows that the host device 10 is successfully connected to multiple first devices.

In addition, the processing unit 13 pairs the first function instruction with the first function of the first device (step S620). The first function may be a first image capture function, a first image display function, a first image and text input function or a first sound recording function. For example, if the first function instruction is directed to the microphone in the first function menu, then the first function is voice input. In an embodiment, when the first function is a first image capturing function, the first image capturing function includes a first sound recording function. That is, the image capture and sound recording functions are performed at the same time.

The processing unit 13 determines the communication protocol used to transmit data according to the function type of the first function (step S630). In one embodiment, the processing unit 13 starts the first protocol according to the first function. For example, the first protocol is Transmission Control Protocol (TCP). If the first function is the first image capture function, the first image display function or the first image and text input function, the processing unit 13 performs the transmission of the first protocol through the communication unit 11 (step S640).

For example, FIG. 7A is a schematic diagram of transmitting image data according to an embodiment of the present invention. Please refer to Figure 7A. For "Client B", although the lens has been selected by the first function command (that is, the first image capture function is selected), "the microphone is included when using the lens" is not set (that is, There is no need for the first image capture function and the first sound recording function at the same time). Therefore, the processing unit 13 only needs to perform TCP transmission (can transmit images or graphic data) through the communication unit 11 .

In another embodiment, the processing unit 13 performs transmission of the second protocol according to the first function (step S645). For example, the second protocol is User Datagram Protocol (UDP). If the first function is the first sound recording function, the processing unit 13 performs transmission of the second protocol (step S640).

For example, FIG. 7B is a schematic diagram of transmitting image and audio data according to an embodiment of the present invention. Please refer to Figure 7B. The difference from Figure 7A is that for "Client B", the lens has been selected by the first function command (that is, the first image capture function is selected), and "when using the lens also includes "Microphone" (that is, the need for both the first image capture function and the first sound recording function). Therefore, the processing unit 11 must perform UDP transmission through the communication unit 11 (which can transmit audio data obtained by voice recording). In addition, the processing unit 13 also performs TCP transmission through the communication unit 11 to transmit image data).

In another embodiment, it is also possible to transmit both image and audio data simultaneously through TCP to prevent the two types of data from being out of sync.

FIG. 8A is a flow chart of a user data packet protocol according to an embodiment of the present invention. Referring to FIG. 8A, the host device 10 and the client device 21 (for example, but it may also be the client device 22) open the socket (steps S801, S803), and name the socket (steps S802, S804). The host device 10 waits for data from the client device 21 (step S805) until receiving data from the client device 21 (eg, image capture, display, or image and text input data). If the client device 21 transmits data (step S806), the host device 10 processes the data of the client device 21 and sends a reply accordingly (step S807). The client device 21 receives the reply from the host device 10 and ends the socket accordingly (steps S809 and S810).

FIG. 8B is a flow chart of a transmission control protocol according to an embodiment of the present invention. Referring to FIG. 8B, the host device 10 waits for the client (that is, the client device 21, but also the client device 22) (step S901). On the other hand, the client device 21 establishes a host endpoint (corresponding to the host device 10) (step S903). The host device 10 listens to receive the connection request sent by the client device 21 (steps S902 and S904). If the connection between the two devices is successful, the host device 10 receives the image data transmitted by the client device 21 (steps S905 and S906). The host device 10 responds to the client device 21 according to the received image data (steps S907 and 908).

After the transmission of the first or second protocol is established, the processing unit 13 inputs the first function from the first device. "Input first function" means input data generated by the first function. For example, images, graphics or audio data. Then, the processing unit 13 executes the application program to output the first function. For example, play camera, screen, microphone, or tablet input from client A, or display camera, screen, microphone, or tablet input from client B.

In one embodiment, when the first function is the first image capture function, the processing unit 13 executes the application program to display the images captured by the first image capture function individually, synchronously, extended, spliced or mirrored. For example, the display unit 14 synchronously displays images captured by the lens of the client device 21 . An application can be a video program, a document program, or a cross-device application.

In one embodiment, when the first function is the first image display function, the processing unit 13 executes an application program to display the image captured by the first image display function individually, synchronously, extended, spliced or mirrored. Taking FIG. 4G as an example, the client device 21 displays the user interface of the signature field of the PDF viewer. For another example, the client device 21 displays the user interface of Zoom's shared screen or other camera content; the client device 21 displays the mirrored user interface of Your Phone; the client device 21 displays the device setting-microphone user interface of Teams.

In one embodiment, when the first function is the first image and text input function, the processing unit 13 executes an application program to display the images and texts input by the first image and text input function individually, synchronously, extended, spliced or mirrored. For example, the display unit 14 displays the touch command corresponding to the pattern or text received by the touch panel of the client device 21 .

In one embodiment, when the first function is the first sound recording function, the processing unit 13 executes the application program to play the recorded sound. For example, the speaker unit 15 plays audio data recorded by the microphone of the client device 21 .

Referring to FIG. 6 , if the connection between the first device and the host device 10 fails, the processing unit 13 displays a graphic and text prompt related to the connection failure through the display unit 14 (step S650 ). In addition, the communication unit 11 connects the host device 10 to the Internet (step S660). The cloud database 70 is also connected to the Internet.

In one embodiment, the user logs into the host device 10 and connects the host device 10 to the Internet. The cloud database 70 is also connected to the Internet.

However, in other embodiments, the host device 10 and the cloud database 70 may also be in a local network or a private network.

According to the embodiments of FIG. 2 to FIG. 8 , the embodiments of the present invention can also be extended to more devices. FIG. 9 is a flow chart of an authorization method of the host device 10 according to an embodiment of the present invention. Referring to FIG. 9 , the processing unit 13 obtains the second account and the second password of the second device from the cloud database 70 through the communication unit 11 (step S910 ). The second device can be regarded as another first device in the embodiment of FIG. 2 .

The processing unit 13 determines whether the second account is the same as the host account (step S930); and determines whether the second password is the same as the host password (step S940). That is, the host device 10 searches the cloud database 70 for devices (eg, client devices 21, 22, 41 and the host device 10) or device lists that have logged in with the same host account and host password. If the second account is the same as the host account and the second password is the same as the host password, it means that the host account is the same as the second account used by the second device to log in to the cloud database 70, and the host password is the same as that used by the second device. The second password to log into the cloud database 70.

If the determination results of the above-mentioned steps S920 and S930 are both "yes", the processing unit 13 obtains the second network data through the communication unit 11 (step S950). Specifically, the second network data is the network data of the second device. In one embodiment, the second network data includes a second network protocol address, and reference can be made to the description of the first network protocol, which will not be described again here. In another embodiment, the second network data may be other identification codes used to identify the second device in the network.

The processing unit 13 obtains the host network information of the host device 10 (step S960). In one embodiment, the host network information includes a host network protocol address. Examples of network protocol addresses and network data have been described in the previous embodiments and will not be described again here.

The processing unit 13 determines whether the second device and the host device belong to the same network NW according to the second network data and the host network data (step S970). For detailed description of step S970, reference may be made to step S270 in FIG. 2 and will not be described again here.

FIG. 10 is a flowchart of an authorization method of the host device 10 according to an embodiment of the present invention. Referring to Figure 10, identity verification is performed through the host device 10 to log in to the cloud database (step S1010). Specifically, the identity verification may be the account and password verification in the embodiment of FIG. 2, or it may be biometric verification, credential verification, SMS verification or other verification related to the registered identity.

Figure 11 is a flow chart of account verification according to an embodiment of the present invention. Referring to Figure 11, the processing unit 13 determines whether the account number matches the verification information (step S1110). Verification information is, for example, passwords, biometrics such as faces, fingerprints, etc. If the account matches the verification data (that is, the verification data corresponds to the account), the processing unit 13 logs into the cloud database 70 through the communication unit 11 (step S1120). If the account does not meet the verification data, the processing unit 13 displays a visual prompt related to the verification failure through the display unit 14 (step S1130).

The processing unit 13 obtains the logged-in device for communication identity verification from the cloud database (step S1020). The logged-in device is, for example, the first device that logs in with the same account and password as described in the embodiment of FIG. 2 or a device that logs in with the same other identity verification.

The processing unit 13 determines whether the logged-in device is an intra-network device (step S1030).

Figure 12 is a flow chart of device verification in a network according to an embodiment of the present invention. The processing unit 13 determines whether the network protocol address of the logged-in device belongs to the network to which the host device belongs (step S1210). If the logged-in device is an intra-network device (step S1220), the processing unit 13 records the intra-network device in the intra-network device list (step S1230). If the logged-in device is not a device within the network (step S1240), the processing unit 13 deletes the logged-in device that is not a device within the network from the list of devices within the network. For detailed description of step S1030 and FIG. 12 , please refer to step S270 of FIG. 2 , and will not be described again here.

If the logged-in device is a device within the network, the processing unit 130 authorizes the function of the host device 10 to the controllable device agent (step S1040). For detailed description of step S1040, please refer to FIG. 3 to FIG. 8 and will not be described again here. "Agent" represents a function originally implemented through a hardware component of the host device 10 (for example, the display unit 14 or the input unit 16), which can be implemented through a controllable device (for example, the same network NW) within the network (ie, the same network NW) 1 client device 21 , 22) Hardware component implementation

.

Figure 13 is a flow chart of a functional agent according to an embodiment of the present invention. Referring to FIG. 13 , the processing unit 13 obtains the identification information corresponding to the controllable device from the cloud database 70 (step S1310 ). The identification information is, for example, the first name and the first icon in Figure 3, or it may be an identification code or a custom code. The identification information includes an icon and its associated type of controllable device. For example, consider the mobile phone illustration of Figure 4A. The processing unit 13 displays the identification information through the display unit 14 (step S1320), and displays the identification information through the display unit 14 (step S1330).

The processing unit 13 receives a device selection instruction for the controllable device through the input unit 16 (step S1340), and receives a function selection instruction for proxying the function of the host device 10 through the input unit 16 (step S1350). The device selection command is, for example, the first device command and the second device command in FIG. 3 . The function selection instruction is, for example, the first function instruction or the second function instruction in FIG. 3 . For detailed description of steps S1310 to S1350, please refer to FIG. 3 and will not be described again here.

The processing unit 13 authorizes the controllable device through the communication unit 11 to proxy the function corresponding to the function selection instruction (step S1360). In one embodiment, the function represented by the controllable device may be an image capture function, an image display function, an image and text input function, or a sound recording function. In one embodiment, the processing unit 13 receives the image and/or graphic data from the function represented by the controllable device through the transmission control protocol through the communication unit 11 . For example, the displayed screen or the entered graphics and text. In another embodiment, the processing unit 13 receives the audio data obtained from the function represented by the controllable device through the user data packet protocol through the communication unit 11 . For other descriptions of step S1360, please refer to FIG. 3 to FIG. 8B and will not be described again here.

Taking FIG. 4F as an example, when a single controllable device is authorized for a specific function, the client device 21 can act as an agent for the image and text input function. Taking FIG. 5F as an example, when multiple controllable devices are authorized for different functions, the client device 21 can act as an agent for the image and text input function, and the client device can act as an agent for the sound recording function.

Figure 14 is a flow chart of function selection according to an embodiment of the present invention. Referring to FIG. 14 , the processing unit 13 receives an execution instruction for the input/output function (for example, image and/or voice input/output function) of the application program through the input unit 16 (step S1410 ), and performs function selection through the controllable device. Instruct the corresponding function (step S1450). The description of FIG. 14 may refer to FIGS. 3 to 8B and will not be described again here.

Embodiments of the present invention further provide a non-transitory computer-readable storage medium (for example, a storage medium such as a hard disk, an optical disk, a flash memory, a solid state disk (SSD), etc.) for storing program codes. The host device 10, the processing unit 13 or other processors can load the program code and execute the corresponding process of one or more authoritative methods according to the embodiment of the present invention. These processes can be referred to the above description and will not be repeated here.

To sum up, the authorization method of the host device, the non-transitory computer-readable storage medium and the host device in the embodiment of the present invention provide a double protection mechanism: 1. First, perform identity verification of the host device and the client device. 2. The connector determines whether the host device and the client device belong to the same network. This can prevent the host device from infringing other people's devices and causing security concerns.

The user interface of the embodiment of the present invention can simultaneously and correspondingly display the icon and name of the client device to improve operational convenience and allow the user to have a more intuitive experience. In addition, the user interface has a function menu corresponding to one or more client devices to provide more flexible and multifunctional settings.

Embodiments of the present invention also provide cross-device application functions. For example, the screen display of the mobile phone/tablet is transferred to the laptop for simultaneous display; only the extended display, splicing display or screen mirroring of the laptop's screen display. Another example is to individually transfer audio data from the microphone of a mobile phone/tablet to a laptop for playback. For another example, use the touch panel of the mobile phone/tablet as a handwriting pad and transfer the input content to the note/tablet.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the appended patent application scope.

1: System 10: Host device 11: Communication unit 12:Storage unit 13: Processing unit 14:Display unit 15: Speaker unit 16:Input unit 21, 22, 31, 41, 51: Customer device steps FI: first icon NA: first name

Figure 1 is a schematic diagram of a system according to an embodiment of the present invention. FIG. 2 is a flow chart of an authorization method of a host device according to an embodiment of the present invention. FIG. 3 is a flow chart of function selection according to an embodiment of the present invention. 4A to 4G are flow charts of a single client's functional agent according to an embodiment of the present invention. 5A to 5F are flowcharts of a multi-client functional agent according to an embodiment of the present invention. FIG. 6 is a flow chart of transmission processing according to an embodiment of the present invention. FIG. 7A is a schematic diagram of transmitting image data according to an embodiment of the present invention. FIG. 7B is a schematic diagram of transmission of image and audio data according to an embodiment of the present invention. FIG. 8A is a flow chart of User Datagram Protocol (UDP) according to an embodiment of the present invention. FIG. 8B is a flow chart of a Transmission Control Protocol (TCP) according to an embodiment of the present invention. FIG. 9 is a flow chart of an authorization method of a host device according to an embodiment of the present invention. FIG. 10 is a flow chart of an authorization method of a host device according to an embodiment of the present invention. Figure 11 is a flow chart of account verification according to an embodiment of the present invention. Figure 12 is a flow chart of device verification in a network according to an embodiment of the present invention. Figure 13 is a flow chart of a functional agent according to an embodiment of the present invention. Figure 14 is a flow chart of function selection according to an embodiment of the present invention.

S210~S270: steps

Claims (25)

An authorization method for a host device, including: logging into a cloud database through a host account and a host password; obtaining a first account and a first password of a first device from the cloud database; determining the first Whether an account is the same as the host account; determine whether the first password is the same as the host password; if both are the same, obtain a first network information; obtain a host network information of the host device; and Determine whether the first device and the host device belong to the same network based on the first network data and the host network data; wherein the first account, the first password and the first network data are all corresponding to the first device. The authorization method of a host device as claimed in claim 1, wherein the first network information includes a first network protocol address, and the host network information includes a host network protocol address. The authorization method of the host device as described in claim 2, wherein when a first network number of the first network protocol address is the same as a host network number of the host network protocol address, it is determined that the first The device belongs to the same network as the host device. The authorization method of the host device as described in claim 2, wherein when the time for querying the first network protocol address has not expired, it is determined that the first device and the host device belong to the same network. The authorization method of the host device according to claim 1, wherein the same network includes a same wireless network, a same wired network or a same Virtual Private Network (Virtual Private Network, VPN). The authorization method of the host device according to claim 1, further comprising: if the first device and the host device belong to the same network, a display unit of the host device displays a first message corresponding to the first device. name and a first icon; receiving a first device command corresponding to the first name and the first icon; displaying a first function menu corresponding to the first device; and receiving a first function command, Corresponds to the first function menu. The authorization method of the host device according to claim 6, wherein the first device command includes a first device touch command or a first device voice command. The authorization method of the host device according to claim 6, wherein the first function command includes a first function touch command or a first function voice command. The authorization method of the host device as described in claim 6 further includes: displaying a connection option; and receiving a connection instruction corresponding to the connection option to connect with the first device. The authorization method of the host device according to claim 9, wherein the connection command includes a connection touch command or a connection voice command. The authorization method of the host device as described in claim 9 further includes: if the connection with the first device is successful, displaying a first connection success; pairing the first function command with a first device of the first device. Function; perform transmission of a first protocol according to the first function; input the first function from the first device; and execute an application to output the first function. The authorization method of the host device according to claim 11, wherein the first function includes a first voice recording function, a first image capture function, a first image display function or a first image and text input function. The authorization method of the host device as described in claim 12, wherein when the first function is the first image capture function, the application is executed to display the first image individually, synchronously, extended, spliced or mirrored. Images captured by the image capture function. The authorization method of the host device as described in claim 12 further includes: opening a second protocol according to the first function, wherein the second protocol is a user data packet protocol. The authorization method of the host device as described in claim 1 further includes: obtaining a second account and a second password of a second device from the cloud database; determining whether the second account is the same as the host account; Determine whether the second password is the same as the host password; if both are, obtain a second network information; Obtain a host network data of the host device; and determine whether the second device and the host device belong to the same network based on the second network data and the host network data; wherein, the second account, the The second password and the second network data both correspond to the second device. An authorization method for a host device, including: performing an identity verification through the host device to log into a cloud database; obtaining a logged-in device that passes the identity verification from the cloud database; and determining whether the logged-in device is a A device in the network, wherein the device in the network is in the same network as the host device, and the step of determining whether the logged-in device is a device in the network includes: determining whether the network protocol address of the logged-in device belongs to the host The network on which the device is located; if so, the logged-in device is a device on the network; the network device is recorded in a device list; and the logged-in device that is not a device on the network is deleted from the device list; and If so, authorize the function of the host device to a controllable device agent, wherein the controllable device is a logged-in device among the devices in the network. The authorization method of the host device as described in claim 16, wherein the logged-in device is another device that has previously passed the identity verification and previously logged in to the cloud database. The authorization method of the host device as described in claim 16, wherein the steps of performing the identity verification through the host device include: determining whether an account matches a verification data; if so, logging into the cloud database; and wherein, the verification The profile corresponds to this account. The authorization method of the host device as described in claim 16, wherein the step of authorizing the function of the host device to the controllable device agent includes: obtaining an identification information corresponding to the controllable device from the cloud database; and displaying the controllable device. Identify information; receive a device selection command for the controllable device; receive a function selection command to proxy the function of the host device through the controllable device; and authorize the controllable device to proxy the function corresponding to the function selection command . The authorization method of the host device as described in claim 19 further includes: receiving an execution command for an input/output function of an application program; and executing the function corresponding to the function selection command through the controllable device. The authorization method of the host device as described in claim 16, wherein the function represented by the controllable device includes an image capture function, an image display function or a picture and text input function. The authorization method of the host device as described in claim 21 further includes: Data obtained from the function proxied by the controllable device is received through the host device via a transmission control protocol. The authorization method of the host device as described in claim 16 further includes: receiving, through the host device, data obtained from the function proxied by the controllable device through a user data packet protocol. A non-transitory computer-readable storage medium is used to store a program code, and a processing unit loads the program code to execute the authorization method of the host device as described in claim 1 or 16. A host device includes: a communication unit for transmitting or receiving signals; a display unit for displaying a user interface; a storage unit for storing a program code; and a processing unit coupled to the communication unit and the storage unit for loading and executing the program code to perform the authorization method of the host device as described in claim 1 or 16.