CN107145278B - Equipment control method and device based on mobile terminal and mobile terminal - Google Patents

Equipment control method and device based on mobile terminal and mobile terminal Download PDF

Info

Publication number
CN107145278B
CN107145278B CN201610115370.9A CN201610115370A CN107145278B CN 107145278 B CN107145278 B CN 107145278B CN 201610115370 A CN201610115370 A CN 201610115370A CN 107145278 B CN107145278 B CN 107145278B
Authority
CN
China
Prior art keywords
picture information
picture
controlled equipment
mobile terminal
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610115370.9A
Other languages
Chinese (zh)
Other versions
CN107145278A (en
Inventor
张磊
杜武平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201610115370.9A priority Critical patent/CN107145278B/en
Publication of CN107145278A publication Critical patent/CN107145278A/en
Application granted granted Critical
Publication of CN107145278B publication Critical patent/CN107145278B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Abstract

The application provides a device control method and device based on a mobile terminal and the mobile terminal, wherein the device control method based on the mobile terminal comprises the following steps: establishing communication connection with a controlled device; acquiring and displaying extended picture information linked with the current displayed picture information of the controlled equipment; receiving control operation of a user for the expanded picture information; and converting the control operation into an instruction which can be recognized by the controlled equipment, and sending the instruction to the controlled equipment so as to control the controlled equipment. The device control method based on the mobile terminal realizes advantage complementation among devices and greatly improves the user interaction freedom degree and flexibility.

Description

Equipment control method and device based on mobile terminal and mobile terminal
Technical Field
The present application relates to the field of communications technologies, and in particular, to a device control method and apparatus based on a mobile terminal, and a mobile terminal.
Background
Intelligent devices have been increasingly and widely used in daily life of people, and users can perform various activities such as video, entertainment, shopping and the like through devices such as intelligent set top boxes, intelligent televisions, personal computers, projectors and the like. Most of the intelligent devices are controlled by a remote controller or a mouse, the operation mode is single, the operation is inconvenient, and the operation is more obvious particularly in scenes of inputting Chinese characters, key operation or playing games and the like.
Disclosure of Invention
The present application aims to address the above technical problem, at least to some extent.
Therefore, a first objective of the present application is to provide a device control method based on a mobile terminal, which realizes advantage complementation between devices and greatly improves the user interaction freedom and flexibility.
A second objective of the present application is to provide a device control apparatus based on a mobile terminal.
A third object of the present application is to provide a mobile terminal.
In order to achieve the above object, according to a first aspect of the present application, a method for controlling a device based on a mobile terminal is provided, including the following steps: acquiring and displaying extended picture information linked with the current displayed picture information of the controlled equipment; receiving control operation of a user for the expanded picture information; and converting the control operation into an instruction which can be recognized by the controlled equipment, and sending the instruction to the controlled equipment so as to control the controlled equipment.
The equipment control method based on the mobile terminal of the embodiment of the application controls the controlled equipment by acquiring the expansion picture information linked with the picture information currently displayed in the controlled equipment, displaying the expansion picture information in the mobile terminal and converting the control operation of a user aiming at the expansion picture information into the command which can be identified by the controlled equipment and sending the command to the controlled equipment, thereby realizing the cooperative operation control of the mobile terminal and the controlled equipment, fully utilizing the advantages of good display experience and natural and convenient control of the controlled equipment, converting various, natural and convenient operations of the mobile terminal into the command which can be identified by the controlled equipment for control, further carrying out various and diversified cooperative controls by the controlled equipment with single operation through the mobile terminal, realizing the advantage complementation between the equipment, and simultaneously bringing the visual operation experience seen by the user, greatly improving the degree of freedom and flexibility of user interaction.
An embodiment of a second aspect of the present application provides a device control apparatus based on a mobile terminal, including: the acquisition module is used for acquiring the expanded picture information linked with the picture information currently displayed by the controlled equipment; the display module is used for expanding the picture information; the first receiving module is used for receiving control operation of a user aiming at the expansion picture information; the conversion module is used for converting the control operation into an instruction which can be recognized by the controlled equipment; and the sending module is used for sending the command which can be identified by the controlled equipment to the controlled equipment so as to control the controlled equipment.
The device control device based on the mobile terminal of the embodiment of the application controls the controlled device by acquiring the expansion picture information linked with the picture information currently displayed in the controlled device and displaying the expansion picture information in the mobile terminal, and converting the control operation of a user aiming at the expansion picture information into the command recognizable by the controlled device and sending the command to the controlled device, so as to control the controlled device, realize the cooperative operation control of the mobile terminal and the controlled device, fully utilize the advantages of good display experience and natural and convenient control of the controlled device, convert various, natural and convenient operations of the mobile terminal into the command recognizable by the controlled device for control, further carry out various and diversified cooperative controls by the controlled device with single operation through the mobile terminal, realize the advantage complementation among the devices, and simultaneously bring the visual operation experience seen by the user, greatly improving the degree of freedom and flexibility of user interaction.
The third aspect of the present application provides a mobile terminal, including the mobile terminal-based device control apparatus according to the second aspect of the present application.
The mobile terminal of the embodiment of the application acquires the expanded picture information linked with the picture information currently displayed in the controlled equipment, and displays the control operation of the user aiming at the expansion picture information in the mobile terminal, converts the control operation into an instruction which can be recognized by the controlled equipment and sends the instruction to the controlled equipment, so as to control the controlled equipment, realize the cooperative operation control of the mobile terminal and the controlled equipment, fully utilize the advantages of good display experience of the controlled equipment and natural and convenient operation of the mobile terminal, convert the various, natural and convenient operations of the mobile terminal into the instructions which can be recognized by the controlled equipment for control, thereby operating a single controlled device to perform various and diversified cooperative controls through the mobile terminal, realizing the advantage complementation among the devices, the visual operation experience seen and obtained by the user is brought, and meanwhile, the degree of freedom and flexibility of user interaction are greatly improved.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The above and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a flowchart of a mobile terminal-based device control method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of expander information according to one embodiment of the application;
3 a-3 c are schematic diagrams of extended screen information according to an embodiment of the application;
fig. 4 is a flowchart of a method for acquiring extended screen information linked with screen information currently displayed by a controlled device according to an embodiment of the present application;
fig. 5 is a flowchart of a mobile terminal-based device control method according to another embodiment of the present application;
FIG. 6 is a schematic diagram of instruction conversion according to one embodiment of the present application;
fig. 7 is a flowchart of a mobile terminal-based device control method according to another embodiment of the present application;
fig. 8 is a flowchart of a mobile terminal-based device control method according to another embodiment of the present application;
fig. 9 is a schematic structural diagram of a device control apparatus based on a mobile terminal according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a device control apparatus based on a mobile terminal according to another embodiment of the present application;
fig. 11 is a schematic structural diagram of a device control apparatus based on a mobile terminal according to another embodiment of the present application;
fig. 12 is a schematic structural diagram of a device control apparatus based on a mobile terminal according to another embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
Because mobile terminal has nature, various user interaction mode, like touch, pronunciation, body feel the control mode such as, the advantage of being convenient for control, consequently, in order to solve equipment such as current intelligent STB, smart TV, personal computer, projector and have big screen display or broadcast, the some that is convenient for watch, but the operation mode is single, the inconvenient problem of operation, the embodiment of this application has proposed a device control method and device based on mobile terminal, can combine together the advantage of above-mentioned two kinds of equipment, realize that big screen display + the advantage of naturally controlling combines, in order to promote the interactive experience of user when using.
A mobile terminal-based device control method and apparatus according to an embodiment of the present application are described below with reference to the accompanying drawings.
It should be noted that the mobile terminal in the embodiment of the present application may be a mobile phone, a tablet computer, an intelligent wearable device, a personal digital assistant, and other terminal devices.
Fig. 1 is a flowchart of a device control method based on a mobile terminal according to an embodiment of the present application. As shown in fig. 1, a device control method based on a mobile terminal according to an embodiment of the present application includes:
and S101, establishing communication connection with the controlled equipment.
In one embodiment of the present application, the controlled device may be a smart television, a television set-top box, a personal computer or a projector, etc.
The mobile terminal and the controlled device may establish a communication connection through Wireless communication methods such as, but not limited to, bluetooth, Wi-Fi (Wireless Fidelity), 2.4G (a Wireless communication technology with a frequency band between 2.400GHz and 2.4835 GHz), iBeacon (a Wireless communication technology based on bluetooth low energy released by apple), and the like, or establish a communication connection through a wired method.
And S102, acquiring and displaying the expansion picture information linked with the current displayed picture information of the controlled equipment.
In an embodiment of the present application, the extended screen information may be a thumbnail screen corresponding to the screen information currently displayed by the controlled device. That is, the mobile terminal synchronously displays the thumbnail picture of the picture information currently displayed by the controlled device, namely, the content of the additional information such as beijing, pictures and the like in the picture information currently displayed by the controlled device is removed. Only the operation controls in the current display screen and the position information between the operation controls are reserved in the thumbnail screen. For example, as shown in fig. 2, for a screen displayed in a television, a thumbnail screen showing a corresponding control at a respective position in a block diagram form may be displayed in a cell phone.
Or, in an embodiment of the present application, the content of the extended screen information may be that the content of the screen information currently displayed by the controlled device corresponds to other viewing angle screens. Specifically, the extension screen information required by each application program may be determined in advance according to the characteristic scene and type of the application program. For example, taking a game program as an example, fig. 3 is the expansion screen information corresponding to different application programs according to the embodiment of the present application. As shown in fig. 3a, for a racing game scene, the TV end can display a game main screen, and the mobile terminal can synchronously display the corresponding cab view expansion screen information. As shown in fig. 3b, for battle game scenes such as CS, the TV end can display a game home screen, and the mobile terminal can synchronously display corresponding extended screen information such as dagger and pistol. As shown in fig. 3c, for strategic game scenes such as interplanetary, the TV end can display all the maps of the game, and the mobile terminal can synchronously display the expansion screen information corresponding to the local arrangement details.
Therefore, the mobile terminal provides the picture with the same or different visual angle as that of the controlled equipment, so that the user can conveniently know the relevant information of the application program currently displayed in the controlled equipment from multiple directions in real time, and different visual experiences can be provided for the user.
In the embodiment of the application, the mobile terminal can acquire the extended picture information linked with the picture information currently displayed by the controlled device in a plurality of different ways, for example, the extended picture information is pushed in real time through the server side, or the corresponding extended picture information is inquired from local data. The following two ways are exemplified in the present application.
In a first mode
And receiving the extended picture information pushed by the server, wherein the extended picture information is obtained by inquiring according to the identification information of the application program displaying the picture information in the controlled equipment. The identification information of the application program may include a name of the application program, a package name, and the like. In an embodiment of the application, identification information of a currently displayed application program can be acquired from a system of a controlled device through a preset interface function; or, the image recognition may be performed on the currently displayed screen information of the controlled device to acquire the text information or the icon in the currently displayed screen information, and the corresponding application program may be determined from the acquired text information or the icon.
That is, the server stores a large amount of extension screen information corresponding to different applications in advance. The server can inquire corresponding extended picture resources according to the identification information of the application program displaying the picture information in the controlled equipment, and push the extended picture information linked with the current display picture of the controlled equipment to the mobile terminal in real time.
The identification information of the application program can be sent to the server by the controlled equipment;
or after the mobile terminal establishes communication connection with the controlled device, the identification information of the application program can be acquired from the controlled device and uploaded to the server.
Mode two
The extended screen information linked with the screen information currently displayed by the controlled device can be acquired through the steps shown in fig. 4. As shown in fig. 4, the method comprises the following steps:
s401, acquiring identification information of an application program displaying the screen information in the controlled device.
S402, acquiring a corresponding expansion data packet according to the identification information.
And S403, determining expanded picture information linked with the picture information currently displayed in the controlled equipment in the expanded data packet.
It should be understood that the above two manners are only exemplary, and the present application is not limited to obtaining the extended screen information linked with the screen information currently displayed by the controlled device through the above two manners, and other possible linking manners should be included in the scope of the present application.
In one embodiment of the application, the sizes of the display screens of the mobile terminal and the controlled device are different. Therefore, after the mobile terminal acquires the extended picture information, the mobile terminal can adjust the size of the extended picture information to adapt to the display size in the mobile terminal.
And S103, receiving control operation of the user on the expansion screen information.
When a user needs to operate according to the picture information displayed by the controlled equipment, the mobile terminal can be directly operated according to the expanded picture displayed in the mobile terminal. Because the mobile terminal has various and abundant sensors and devices, such as a touch screen, a camera, a voice input device, a gravity sensor, a gyroscope, an accelerometer and the like. Accordingly, the mobile terminal may receive different forms of control operations. In one embodiment of the present application, the control operation may include at least one of:
touch operation, somatosensory operation, gesture operation and voice operation.
For example, the user may input the control operation by clicking an operation control on the expansion screen, inputting a voice instruction, or controlling the mobile terminal to shake left and right in the space.
And S104, converting the control operation into an instruction which can be recognized by the controlled equipment, and sending the instruction to the controlled equipment so as to control the controlled equipment.
Specifically, the instruction recognizable by the controlled device may be queried according to the identification information (e.g., device serial number, etc.) of the controlled device or the identification (e.g., application package name, etc.) of the application program displaying the screen information in the controlled device.
In an embodiment of the present application, the converting the control operation into the instruction recognizable by the controlled device may include steps S501-S503 as shown in fig. 5.
S501, identifying the control operation to determine an operation instruction corresponding to the control operation.
If the control operation is a touch operation, the touch operation can be recognized as an operation instruction of the corresponding operation control. For example, if the control operation is a 3 rd control button a in the touch expansion screen, it may be recognized as "click operation on the control button a".
If the control operation is a voice operation, voice recognition can be carried out on the voice input by the user so as to obtain an operation instruction of the corresponding control.
If the control operation is a body sensing operation or a gesture operation, the body sensing operation or the gesture operation can be identified as a key operation on the corresponding key.
And S502, determining an instruction mapping relation corresponding to the currently displayed picture information of the controlled equipment.
In the embodiment of the application, the instruction mapping relationship corresponding to the identification information (such as the device serial number) of the controlled device can be queried according to the identification information (such as the device serial number). Or inquiring the corresponding instruction mapping relation according to the identification (such as the name and the name of an application program package) of the application program displaying the screen information in the controlled equipment.
The command mapping relation is a mapping relation between a command in the mobile terminal and a command recognizable by the controlled equipment. Therefore, the command identifiable by the controlled device corresponding to the identified command can be inquired based on the command mapping relation.
In an embodiment of the present application, determining an instruction mapping relationship corresponding to the currently displayed screen information of the controlled device may include: acquiring identification information of an application program displaying the picture information in the controlled equipment; and querying a preset database according to the identification information to obtain a corresponding instruction mapping relation.
The preset database stores instruction mapping relations corresponding to different application programs, and the instruction mapping relations can be stored in a mobile terminal local area or a server.
And S503, converting the operation instruction into an instruction which can be recognized by the controlled equipment according to the instruction mapping relation.
Specifically, the operation instruction may be parsed, mapped, and converted according to the instruction mapping relationship. For example, the following are three examples of converting the operation instruction into an instruction recognizable by the controlled device according to the instruction mapping relationship.
Example one (as shown in FIG. 6)
TV (television) manipulation: no touch response, namely no touch operation;
operation instruction received by Phone (Mobile terminal): touching the 3 rd control button;
the instruction is analyzed as follows: moving and clicking;
the instruction maps to: firstly, positioning the current position of a control focus (the 1 st control button), then moving the control focus from the current position to the 3 rd control button, and then clicking the 3 rd control button;
the instructions are converted into: right key (arrow key) 2, OK key 1.
Example two
The current interface is a racing car game interface, and the control mode is key response;
the operation instruction received by the mobile terminal is as follows: GSensor (gravity sensor) somatosensory control;
the instruction is analyzed as follows: arrow keys, single or long press, etc.;
the instruction maps to: firstly, determining a direction corresponding to somatosensory operation, and then clicking;
and (3) instruction conversion: right button (arrow key), single click or long press.
Example three
The current interface is a game interface capable of responding to touch operation;
the operation instruction received by the mobile terminal is as follows: touching the 3 rd control button;
the instruction is analyzed as follows: clicking;
the instruction maps to: clicking;
the instructions are converted into: click the 3 rd control button.
In an embodiment of the application, after the controlled device responds to the recognizable instruction sent by the mobile terminal, the mobile terminal may generate a click prompt at a corresponding response position of the expanded screen, or may also perform a vibration prompt, etc., so as to enhance interactivity between devices and improve user experience.
In addition, because the mobile terminal acquires the screen information currently displayed by the controlled device, when the screen displayed by the controlled device changes, the extended screen in the mobile terminal also changes.
The equipment control method based on the mobile terminal of the embodiment of the application controls the controlled equipment by acquiring the expansion picture information linked with the picture information currently displayed in the controlled equipment, displaying the expansion picture information in the mobile terminal and converting the control operation of a user aiming at the expansion picture information into the command which can be identified by the controlled equipment and sending the command to the controlled equipment, thereby realizing the cooperative operation control of the mobile terminal and the controlled equipment, fully utilizing the advantages of good display experience and natural and convenient control of the controlled equipment, converting various, natural and convenient operations of the mobile terminal into the command which can be identified by the controlled equipment for control, further carrying out various and diversified cooperative controls by the controlled equipment with single operation through the mobile terminal, realizing the advantage complementation between the equipment, and simultaneously bringing the visual operation experience seen by the user, greatly improving the degree of freedom and flexibility of user interaction.
Furthermore, in order to provide more various speech experiences for the user, the current picture information in the controlled device can be acquired to provide corresponding expanded picture information, and picture switching buttons corresponding to the expanded picture information are provided, so that the user can select and switch to the corresponding expanded picture information as required. Specifically, in another embodiment of the present application, the method of the embodiment of the present application may further include steps S701 to S703 as shown in fig. 7. Wherein the content of the first and second substances,
and S701, providing a picture control window on the display interface of the expanded picture information, wherein at least one picture switching button is displayed in the picture control window.
The screen control window may be in the form of, but not limited to, a floating layer window, a sidebar, and the like. The at least one picture switching button corresponds to the at least one expanded picture information respectively.
And S702, receiving the selection operation of the screen switching button by the user.
And S703, acquiring the extended picture information corresponding to the picture switching button selected by the selection operation, and replacing the currently displayed extended picture information in the display interface.
Therefore, the picture switching button is provided on the display interface of the expanded picture information, so that a user can select the expanded picture information as required, diversified control experience is provided for the user, and the user can watch and control pictures with different visual angles conveniently.
In one embodiment of the present application, as shown in fig. 8, steps S801-S802 may also be included. Wherein:
s801, determining an application scene corresponding to a current display picture of the controlled device.
For example, the application scenes may include game in progress scenes, main interface scenes, video playback scenes, and the like.
In an embodiment of the present application, an application scene corresponding to the screen information may be determined according to a type to which an application program generating the screen information belongs. For example, if the application program generating the screen information is a game application, the application scene corresponding to the screen information is a scene in the process of a game; and if the application program for generating the picture information is a video playing application, the application scene corresponding to the picture information is a video playing scene.
Further, application scenes corresponding to different picture information can be divided more finely. Specifically, on the basis of determining the application program for generating the screen information, image recognition may be further performed on the screen information to determine the content of the screen information, and a corresponding application scene may be determined according to the content of the screen information. For example, if the content of the screen information is an application program or a device main interface or a menu interface, the application scene corresponding to the screen information is a main interface scene; and if the content of the picture information is an interface in the running of a game program, the application scene corresponding to the picture information is a scene in the running of the game.
S802, controlling the display parameters of the expansion picture information according to the application scene.
In one embodiment of the present application, the display parameters may include fluency and/or resolution.
For example, if the application scene is a main interface of an application or a device, the update frequency is low during the display process, or the interface change occurs only when the user performs an operation, so that the fluency can be appropriately reduced, for example, the frame rate can be set to 20fps ((Frames per Second), and for a scene in a game, or a video playback scene, the frame is dynamically changed, so that the fluency can be appropriately adjusted high, for example, to 30fps ((Frames per Second).
The resolution can also be adjusted according to the display requirements of the actual scene.
Therefore, the display parameters of the expanded picture can be dynamically adjusted according to the application scene corresponding to the picture information in the controlled equipment, and the power consumption of the equipment can be effectively reduced while good visual experience is provided for a user.
Corresponding to the method for controlling the device based on the mobile terminal provided by the embodiment, the application also provides a device control device based on the mobile terminal.
Fig. 9 is a schematic structural diagram of a device control apparatus based on a mobile terminal according to an embodiment of the present application.
As shown in fig. 9, the apparatus for controlling a device based on a mobile terminal according to an embodiment of the present application includes: the device comprises a communication module 1, an acquisition module 2, a display module 3, a first receiving module 4, a conversion module 5 and a sending module 6.
Specifically, the communication module 1 is used for establishing a communication connection with a controlled device.
In one embodiment of the present application, the controlled device may be a smart television, a television set-top box, a personal computer or a projector, etc.
The communication module 1 and the controlled device may establish a communication connection through Wireless communication methods such as, but not limited to, bluetooth, Wi-Fi (Wireless Fidelity), 2.4G (a Wireless communication technology with a frequency band between 2.400GHz and 2.4835 GHz), iBeacon (a Wireless communication technology based on bluetooth low energy released by apple), and the like, or establish a communication connection through a wired method.
The acquisition module 2 is used for acquiring the expansion picture information linked with the picture information currently displayed by the controlled equipment.
In an embodiment of the present application, the extended screen information may be a thumbnail screen corresponding to the screen information currently displayed by the controlled device. That is, the mobile terminal synchronously displays the thumbnail picture of the picture information currently displayed by the controlled device, namely, the content of the additional information such as beijing, pictures and the like in the picture information currently displayed by the controlled device is removed. Only the operation controls in the current display screen and the position information between the operation controls are reserved in the thumbnail screen. For example, as shown in fig. 2, for a screen displayed in a television, a thumbnail screen showing a corresponding control at a respective position in a block diagram form may be displayed in a cell phone.
Or, in an embodiment of the present application, the content of the extended screen information may be that the content of the screen information currently displayed by the controlled device corresponds to other viewing angle screens. Specifically, the extension screen information required by each application program may be determined in advance according to the characteristic scene and type of the application program. For example, taking a game program as an example, fig. 3 is the expansion screen information corresponding to different application programs according to the embodiment of the present application. As shown in fig. 3a, for a racing game scene, the TV end can display a game main screen, and the mobile terminal can synchronously display the corresponding cab view expansion screen information. As shown in fig. 3b, for battle game scenes such as CS, the TV end can display a game home screen, and the mobile terminal can synchronously display corresponding extended screen information such as dagger and pistol. As shown in fig. 3c, for strategic game scenes such as interplanetary, the TV end can display all the maps of the game, and the mobile terminal can synchronously display the expansion screen information corresponding to the local arrangement details.
Therefore, the mobile terminal provides the picture with the same or different visual angle as that of the controlled equipment, so that the user can conveniently know the relevant information of the application program currently displayed in the controlled equipment from multiple directions in real time, and different visual experiences can be provided for the user.
In the embodiment of the application, the obtaining module 2 may obtain the extended screen information linked with the screen information currently displayed by the controlled device in a plurality of different manners, for example, the extended screen information pushed in real time by the server, or the extended screen information corresponding to the local data is queried. The following two ways are exemplified in the present application.
In a first mode
The obtaining module 2 may receive the extended screen information pushed by the server, where the extended screen information is obtained by querying, according to the identification information of the application program in the controlled device, which displays the screen information. The identification information of the application program may include a name of the application program, a package name, and the like. In an embodiment of the application, identification information of a currently displayed application program can be acquired from a system of a controlled device through a preset interface function; or, the image recognition may be performed on the currently displayed screen information of the controlled device to acquire the text information or the icon in the currently displayed screen information, and the corresponding application program may be determined from the acquired text information or the icon. .
That is, the server stores a large amount of extension screen information corresponding to different applications in advance. The server can inquire the corresponding extended picture resource according to the identification information of the application program displaying the picture information in the controlled device, and push the extended picture information linked with the current display picture of the controlled device to the acquisition module 2 in real time.
The identification information of the application program can be sent to the server by the controlled equipment;
or, after the communication module 1 establishes communication connection with the controlled device, the obtaining module 2 may obtain the identification information of the application program from the controlled device, and upload the identification information to the server.
Mode two
The acquisition module 2 can acquire identification information of an application program displaying the picture information in the controlled device; acquiring a corresponding expansion data packet according to the identification information; and determining expansion picture information linked with the picture information currently displayed in the controlled equipment in the expansion data packet.
It should be understood that the above two manners are only exemplary, and in the present application, the obtaining module 2 is not limited to obtain the extended screen information linked with the screen information currently displayed by the controlled device through the above two manners, and other possible linking manners should also be included in the scope of the present application.
In one embodiment of the application, the sizes of the display screens of the mobile terminal and the controlled device are different. Therefore, after the mobile terminal acquires the extended picture information, the mobile terminal can adjust the size of the extended picture information to adapt to the display size in the mobile terminal.
The display module 3 is used for the expansion picture information.
The first receiving module 4 is configured to receive a control operation of a user for the extended screen information.
When a user needs to operate according to the picture information displayed by the controlled equipment, the mobile terminal can be directly operated according to the expanded picture displayed in the mobile terminal. Because the mobile terminal has various and abundant sensors and devices, such as a touch screen, a camera, a voice input device, a gravity sensor, a gyroscope, an accelerometer and the like. Therefore, the first receiving module 4 can receive different forms of control operations. In one embodiment of the present application, the control operation may include at least one of:
touch operation, somatosensory operation, gesture operation and voice operation.
For example, the user may input the control operation by clicking an operation control on the expansion screen, inputting a voice instruction, or controlling the mobile terminal to shake left and right in the space.
The conversion module 5 is used for converting the control operation into an instruction recognizable by the controlled device.
Specifically, the conversion module 5 may query the instruction recognizable by the controlled device according to the identification information (e.g., device serial number, etc.) of the controlled device or the identification (e.g., application package name, etc.) of the application program displaying the screen information in the controlled device.
In one embodiment of the present application, as shown in fig. 10, the conversion module 5 may further include: an identification unit 51, a determination unit 52 and a conversion unit 53.
The identification unit 51 identifies the control operation to determine an operation instruction corresponding to the control operation.
If the control operation is a touch operation, the distinguishing unit 51 may recognize the touch operation as an operation instruction to the corresponding operation control. For example, if the control operation is a 3 rd control button a in the touch expansion screen, it may be recognized as "click operation on the control button a".
If the control operation is a voice operation, the recognition unit 51 may perform voice recognition on the voice input by the user to obtain an operation instruction for the corresponding control.
If the control operation is a body-sensing operation or a gesture operation, the recognition unit 51 may recognize the body-sensing operation or the gesture operation as a key operation to a corresponding key.
The determining unit 52 determines an instruction mapping relationship corresponding to the currently displayed screen information of the controlled device.
In an embodiment of the present application, the determining unit 52 may query the instruction mapping relationship corresponding to the identification information (e.g., device serial number, etc.) of the controlled device. Or the determining unit 52 may query the instruction mapping relationship corresponding to the identifier (such as the name and name of the application package) of the application program displaying the screen information in the controlled device.
The command mapping relation is a mapping relation between a command in the mobile terminal and a command recognizable by the controlled equipment. Therefore, the command identifiable by the controlled device corresponding to the identified command can be inquired based on the command mapping relation.
In one embodiment of the present application, the determination unit 52 may be configured to: acquiring identification information of an application program displaying the picture information in the controlled equipment; and querying a preset database according to the identification information to obtain a corresponding instruction mapping relation.
The preset database stores instruction mapping relations corresponding to different application programs, and the instruction mapping relations can be stored in a mobile terminal local area or a server.
The conversion unit 53 converts the operation instruction into an instruction recognizable by the controlled device according to the instruction mapping relationship.
Specifically, the conversion unit 53 may parse, map and convert the operation instruction according to the instruction mapping relationship. For example, the following are three examples of converting the operation instruction into an instruction recognizable by the controlled device according to the instruction mapping relationship.
Example one (as shown in FIG. 6)
TV (television) manipulation: no touch response, namely no touch operation;
operation instruction received by Phone (Mobile terminal): touching the 3 rd control button;
the instruction is analyzed as follows: moving and clicking;
the instruction maps to: firstly, positioning the current position of a control focus (the 1 st control button), then moving the control focus from the current position to the 3 rd control button, and then clicking the 3 rd control button;
the instructions are converted into: right key (arrow key) 2, OK key 1.
Example two
The current interface is a racing car game interface, and the control mode is key response;
the operation instruction received by the mobile terminal is as follows: GSensor (gravity sensor) somatosensory control;
the instruction is analyzed as follows: arrow keys, single or long press, etc.;
the instruction maps to: firstly, determining a direction corresponding to somatosensory operation, and then clicking;
and (3) instruction conversion: right button (arrow key), single click or long press.
Example three
The current interface is a game interface capable of responding to touch operation;
the operation instruction received by the mobile terminal is as follows: touching the 3 rd control button;
the instruction is analyzed as follows: clicking;
the instruction maps to: clicking;
the instructions are converted into: click the 3 rd control button.
The sending module 6 is configured to send an instruction recognizable by the controlled device to the controlled device, so as to control the controlled device.
In an embodiment of the application, after the controlled device responds to the recognizable instruction sent by the sending module 6, the mobile terminal may generate a click prompt at a corresponding response position of the expanded screen, or may also perform a vibration prompt, etc., so as to enhance interactivity between devices and improve user experience.
In addition, because the mobile terminal acquires the screen information currently displayed by the controlled device, when the screen displayed by the controlled device changes, the extended screen in the mobile terminal also changes.
Fig. 11 is a schematic structural diagram of a device control apparatus based on a mobile terminal according to another embodiment of the present application.
As shown in fig. 11, the apparatus for controlling a device based on a mobile terminal according to an embodiment of the present application includes: the device comprises a communication module 1, an acquisition module 2, a display module 3, a first receiving module 4, a conversion module 5, a sending module 6, a providing module 7, a second receiving module 8 and a replacing module 9.
The communication module 1, the obtaining module 2, the display module 3, the first receiving module 4, the converting module 5 and the sending module 6 are the same as those in the embodiment shown in fig. 9.
The providing module 7 is configured to provide a picture control window on the display interface of the expanded picture information, where at least one picture switching button is displayed in the picture control window.
The screen control window may be in the form of, but not limited to, a floating layer window, a sidebar, and the like. The at least one picture switching button corresponds to the at least one expanded picture information respectively.
The second receiving module 8 is configured to receive a selection operation of the screen switching button by a user.
The replacing module 9 is configured to obtain the extended screen information corresponding to the screen switching button selected by the selecting operation, and replace the extended screen information currently displayed in the display interface.
Therefore, the picture switching button is provided on the display interface of the expanded picture information, so that a user can select the expanded picture information as required, diversified control experience is provided for the user, and the user can watch and control pictures with different visual angles conveniently.
Fig. 12 is a schematic structural diagram of a device control apparatus based on a mobile terminal according to another embodiment of the present application.
As shown in fig. 12, the apparatus for controlling a device based on a mobile terminal according to an embodiment of the present application includes: the device comprises a communication module 1, an acquisition module 2, a display module 3, a first receiving module 4, a conversion module 5, a sending module 6, a determination module 10 and a control module 11.
The communication module 1, the obtaining module 2, the display module 3, the first receiving module 4, the converting module 5 and the sending module 6 are the same as those in the embodiment shown in fig. 9.
The determining module 10 determines an application scene corresponding to a current display screen of the controlled device.
For example, the application scenes may include game in progress scenes, main interface scenes, video playback scenes, and the like.
In an embodiment of the present application, the determining module 10 may determine the application scene corresponding to the screen information according to a type of an application program generating the screen information. For example, if the application program generating the screen information is a game application, the application scene corresponding to the screen information is a scene in the process of a game; and if the application program for generating the picture information is a video playing application, the application scene corresponding to the picture information is a video playing scene.
Further, the determining module 10 may divide the application scenes corresponding to different pieces of screen information more finely. Specifically, on the basis of determining the application program for generating the screen information, the determining module 10 may further perform image recognition on the screen information to determine the content of the screen information, and determine the corresponding application scene according to the content of the screen information. For example, if the content of the screen information is an application program or a device main interface or a menu interface, the application scene corresponding to the screen information is a main interface scene; and if the content of the picture information is an interface in the running of a game program, the application scene corresponding to the picture information is a scene in the running of the game.
The control module 11 controls the display parameters of the extended screen information according to the application scene.
In one embodiment of the present application, the display parameters may include fluency and/or resolution.
For example, if the application scene is the main interface of the application program or the device, the update frequency is low during the display process, or the interface change occurs only when the user performs the operation, so the control module 11 can appropriately reduce the fluency, for example, the frame rate can be set to 20fps ((Frames per Second), and for the scene in the game, or the video playing scene, the frame is dynamically changed, so the fluency can be appropriately adjusted to 30fps ((Frames per Second), for example).
For the resolution, the control module 11 can also adjust according to the display requirement of the actual scene.
Therefore, the display parameters of the expanded picture can be dynamically adjusted according to the application scene corresponding to the picture information in the controlled equipment, and the power consumption of the equipment can be effectively reduced while good visual experience is provided for a user.
The device control device based on the mobile terminal of the embodiment of the application controls the controlled device by acquiring the expansion picture information linked with the picture information currently displayed in the controlled device and displaying the expansion picture information in the mobile terminal, and converting the control operation of a user aiming at the expansion picture information into the command recognizable by the controlled device and sending the command to the controlled device, so as to control the controlled device, realize the cooperative operation control of the mobile terminal and the controlled device, fully utilize the advantages of good display experience and natural and convenient control of the controlled device, convert various, natural and convenient operations of the mobile terminal into the command recognizable by the controlled device for control, further carry out various and diversified cooperative controls by the controlled device with single operation through the mobile terminal, realize the advantage complementation among the devices, and simultaneously bring the visual operation experience seen by the user, greatly improving the degree of freedom and flexibility of user interaction.
The application also provides a mobile terminal.
The mobile terminal of the embodiment of the application comprises: the device control device based on the mobile terminal in any embodiment of the application.
The mobile terminal of the embodiment of the application acquires the expanded picture information linked with the picture information currently displayed in the controlled equipment, and displays the control operation of the user aiming at the expansion picture information in the mobile terminal, converts the control operation into an instruction which can be recognized by the controlled equipment and sends the instruction to the controlled equipment, so as to control the controlled equipment, realize the cooperative operation control of the mobile terminal and the controlled equipment, fully utilize the advantages of good display experience of the controlled equipment and natural and convenient operation of the mobile terminal, convert the various, natural and convenient operations of the mobile terminal into the instructions which can be recognized by the controlled equipment for control, thereby operating a single controlled device to perform various and diversified cooperative controls through the mobile terminal, realizing the advantage complementation among the devices, the visual operation experience seen and obtained by the user is brought, and meanwhile, the degree of freedom and flexibility of user interaction are greatly improved.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the application, the scope of which is defined by the claims and their equivalents.

Claims (11)

1. A device control method based on a mobile terminal is characterized by comprising the following steps:
establishing communication connection with a controlled device;
acquiring extended picture information linked with picture information currently displayed by the controlled device, displaying the extended picture information, and providing a picture control window on a display interface of the extended picture information, wherein the content of the extended picture information corresponds to other visual angle pictures of the content of the picture information currently displayed by the controlled device, the other visual angle pictures are determined according to the characteristic scene and the type of an application program for displaying the picture information in the controlled device, and at least one picture switching button is displayed in the picture control window;
receiving control operation of a user for the expanded picture information;
converting the control operation into an instruction which can be recognized by the controlled equipment, and sending the instruction to the controlled equipment so as to control the controlled equipment;
the method further comprises the following steps:
determining an application scene corresponding to a current display picture of the controlled equipment; the application scene is any one of the following scenes: scenes in the process of game playing, main interface scenes and video playing scenes;
controlling display parameters of the expanded picture information according to the application scene; the display parameters include: fluency and resolution;
the acquiring of the extended picture information linked with the picture information currently displayed by the controlled device includes:
and receiving the extended picture information pushed by the server, wherein the extended picture information is obtained by inquiring according to the identification information of the application program displaying the picture information in the controlled equipment.
2. The method of claim 1, wherein the acquiring of the extended screen information linked with the screen information currently displayed by the controlled device comprises:
acquiring identification information of an application program displaying the picture information in the controlled equipment;
acquiring a corresponding expansion data packet according to the identification information;
and determining expansion picture information linked with the picture information currently displayed in the controlled equipment in the expansion data packet.
3. The method of claim 1, wherein converting the control operation into an instruction recognizable by the controlled device comprises:
identifying the control operation to determine an operation instruction corresponding to the control operation;
determining an instruction mapping relation corresponding to the currently displayed picture information of the controlled equipment;
and converting the operation instruction into an instruction which can be recognized by the controlled equipment according to the instruction mapping relation.
4. The method of claim 3, wherein the determining the instruction mapping relationship corresponding to the currently displayed picture information of the controlled device comprises:
acquiring identification information of an application program displaying the picture information in the controlled equipment;
and querying a preset database according to the identification information to obtain a corresponding instruction mapping relation.
5. The method of claim 1, further comprising:
receiving the selection operation of the user on the picture switching button;
and acquiring the expansion picture information corresponding to the picture switching button selected by the selection operation, and replacing the expansion picture information currently displayed in the display interface.
6. An apparatus control device based on a mobile terminal, comprising:
the communication module is used for establishing communication connection with the controlled equipment;
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring extended picture information linked with picture information currently displayed by controlled equipment, the content of the extended picture information is other visual angle pictures corresponding to the content of the picture information currently displayed by the controlled equipment, and the other visual angle pictures are determined according to the characteristic scene and the type of an application program for displaying the picture information in the controlled equipment;
the display module is used for expanding the picture information;
the system comprises a providing module, a display module and a display module, wherein the providing module is used for providing a picture control window on a display interface of the expanded picture information, and at least one picture switching button is displayed in the picture control window;
the first receiving module is used for receiving control operation of a user aiming at the expansion picture information;
the conversion module is used for converting the control operation into an instruction which can be recognized by the controlled equipment;
the sending module is used for sending the command which can be identified by the controlled equipment to the controlled equipment so as to control the controlled equipment;
the device, still include:
the determining module is used for determining an application scene corresponding to a current display picture of the controlled equipment; the application scene is any one of the following scenes: scenes in the process of game playing, main interface scenes and video playing scenes;
the control module is used for controlling the display parameters of the expanded picture information according to the application scene; the display parameters include: fluency and resolution;
the acquisition module is configured to:
and receiving the extended picture information pushed by the server, wherein the extended picture information is obtained by inquiring according to the identification information of the application program displaying the picture information in the controlled equipment.
7. The apparatus of claim 6, wherein the acquisition module is to:
acquiring identification information of an application program displaying the picture information in the controlled equipment;
acquiring a corresponding expansion data packet according to the identification information;
and determining expansion picture information linked with the picture information currently displayed in the controlled equipment in the expansion data packet.
8. The apparatus of claim 6, wherein the conversion module comprises:
the identification unit is used for identifying the control operation so as to determine an operation instruction corresponding to the control operation;
the determining unit is used for determining an instruction mapping relation corresponding to the currently displayed picture information of the controlled equipment;
and the conversion unit is used for converting the operation instruction into an instruction which can be recognized by the controlled equipment according to the instruction mapping relation.
9. The apparatus of claim 8, wherein the determination unit is to:
acquiring identification information of an application program displaying the picture information in the controlled equipment;
and querying a preset database according to the identification information to obtain a corresponding instruction mapping relation.
10. The apparatus of claim 6, further comprising:
the second receiving module is used for receiving the selection operation of the user on the picture switching button;
and the replacing module is used for acquiring the expanded picture information corresponding to the picture switching button selected by the selection operation and replacing the expanded picture information currently displayed in the display interface.
11. A mobile terminal, characterized in that it comprises a mobile terminal based device control apparatus according to any of claims 6-10.
CN201610115370.9A 2016-03-01 2016-03-01 Equipment control method and device based on mobile terminal and mobile terminal Active CN107145278B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610115370.9A CN107145278B (en) 2016-03-01 2016-03-01 Equipment control method and device based on mobile terminal and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610115370.9A CN107145278B (en) 2016-03-01 2016-03-01 Equipment control method and device based on mobile terminal and mobile terminal

Publications (2)

Publication Number Publication Date
CN107145278A CN107145278A (en) 2017-09-08
CN107145278B true CN107145278B (en) 2021-06-15

Family

ID=59783065

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610115370.9A Active CN107145278B (en) 2016-03-01 2016-03-01 Equipment control method and device based on mobile terminal and mobile terminal

Country Status (1)

Country Link
CN (1) CN107145278B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109151012A (en) * 2018-08-11 2019-01-04 宁波亿拍客网络科技有限公司 A kind of push mode runs program technic and its application method, correlation technique
CN110941376A (en) * 2019-11-29 2020-03-31 联想(北京)有限公司 Display control method and electronic equipment
CN111221491A (en) * 2020-01-09 2020-06-02 Oppo(重庆)智能科技有限公司 Interaction control method and device, electronic equipment and storage medium
CN113285981B (en) * 2021-04-16 2023-03-07 北京沃东天骏信息技术有限公司 Remote control method, controlled method and device, equipment and storage medium
CN115268754A (en) * 2022-07-26 2022-11-01 京东方科技集团股份有限公司 Control method and system of display terminal, display device and storage medium
CN117236195B (en) * 2023-11-10 2024-02-02 中国石油大学(华东) Machine learning offline agent model production optimization method for reducing development risk

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105141913A (en) * 2015-08-18 2015-12-09 华为技术有限公司 Method and system for visually and remotely controlling touch control equipment and relevant equipment

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120063791A (en) * 2010-12-08 2012-06-18 삼성전자주식회사 Method for controlling image using mobile projector
CN104331243B (en) * 2014-10-22 2017-11-21 积成电子股份有限公司 Mobile terminal based on thumbnail reconstruct shows interactive control method with large-size screen monitors
CN104331218A (en) * 2014-10-27 2015-02-04 百度在线网络技术(北京)有限公司 Implementation method and system for wireless control on remote display terminal
CN104811780B (en) * 2015-04-30 2018-04-10 北京奇艺世纪科技有限公司 Control method of electronic device and device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105141913A (en) * 2015-08-18 2015-12-09 华为技术有限公司 Method and system for visually and remotely controlling touch control equipment and relevant equipment

Also Published As

Publication number Publication date
CN107145278A (en) 2017-09-08

Similar Documents

Publication Publication Date Title
CN107147769B (en) Equipment control method and device based on mobile terminal and mobile terminal
CN107145278B (en) Equipment control method and device based on mobile terminal and mobile terminal
CN111405338B (en) Intelligent image quality switching method and display device
KR20120105341A (en) Method for controlling connection between electronic devices and portable terminal thereof
CN112073762B (en) Information acquisition method based on multi-system display equipment and multi-system display equipment
US11917329B2 (en) Display device and video communication data processing method
CN112399212A (en) Display device, file sharing method and server
US10219045B2 (en) Server, image providing apparatus, and image providing system comprising same
CN111083538A (en) Background image display method and device
CN112995733B (en) Display device, device discovery method and storage medium
CN112073663B (en) Audio gain adjusting method, video chat method and display device
CN112073789A (en) Sound processing method and display device
CN112073776B (en) Voice control method and display device
CN112399071B (en) Control method and device for camera motor and display equipment
CN112073759B (en) Method and device for selecting and scheduling communication modes between two systems and display equipment
CN112073356B (en) Data transmission method and display device
CN112071338A (en) Recording control method and device and display equipment
CN112995113B (en) Display device, port control method and storage medium
KR20160097023A (en) Image display apparatus
KR102281839B1 (en) Apparatus for providing Image
CN112073811B (en) File transmission scheduling method and display device
CN112399223B (en) Method for improving moire fringe phenomenon and display device
CN112565892B (en) Method for identifying roles of video programs and related equipment
CN112073777B (en) Voice interaction method and display device
WO2020248650A1 (en) Display apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1243527

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant