CN111506228A - Target device control method and electronic device - Google Patents

Target device control method and electronic device Download PDF

Info

Publication number
CN111506228A
CN111506228A CN202010256465.9A CN202010256465A CN111506228A CN 111506228 A CN111506228 A CN 111506228A CN 202010256465 A CN202010256465 A CN 202010256465A CN 111506228 A CN111506228 A CN 111506228A
Authority
CN
China
Prior art keywords
screen
key
target
area
target device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010256465.9A
Other languages
Chinese (zh)
Other versions
CN111506228B (en
Inventor
侯宇涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202010256465.9A priority Critical patent/CN111506228B/en
Publication of CN111506228A publication Critical patent/CN111506228A/en
Application granted granted Critical
Publication of CN111506228B publication Critical patent/CN111506228B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides a control method of target equipment and electronic equipment. The method comprises the following steps: shooting a picture of a target device under the condition that the target device is placed in a first area on a screen of the electronic device; and displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture. In the embodiment of the invention, the preset control key and the controlled target equipment are arranged on the same screen, and a user can control the target equipment in a short distance by touching the key in the second area, so that the interactive sense of reality is enhanced. The embodiment of the invention solves the problem that the electronic equipment and the controlled equipment are in an isolated state in the interaction process in the prior art.

Description

Target device control method and electronic device
Technical Field
The present invention relates to the field of mobile communications technologies, and in particular, to a method for controlling a target device and an electronic device.
Background
With the rapid development of mobile communication technology, electronic devices such as smart phones have become an indispensable tool in various aspects of people's life. The functions of various Application programs (APPs) of the electronic equipment are gradually improved, and the functions do not only play a role in communication, but also provide various intelligent services for users, so that great convenience is brought to the work and life of the users.
Currently, it has become a common scenario to control entity devices through an application program of an electronic device, such as some electrical appliances, some internet of things devices, and the like. The electronic device is usually controlled remotely, and an application program is installed on the electronic device side, and communicates with the controlled device through a server of the application program to forward a control command of the electronic device. However, the electronic device and the controlled device are always in an isolated state in the interaction process by remote control, and real use experience cannot be brought.
Disclosure of Invention
The embodiment of the invention provides a control method of target equipment and electronic equipment, and aims to solve the problem that in the prior art, the electronic equipment and controlled equipment are in an isolated state in an interaction process.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a method for controlling a target device, where the method is applied to an electronic device, and the method includes:
shooting a picture of a target device under the condition that the target device is placed in a first area on a screen of the electronic device;
and displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture.
In a second aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes:
the shooting module is used for shooting a picture of the target equipment under the condition that the target equipment is placed in a first area on a screen of the electronic equipment;
and the display module is used for displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture.
In a third aspect, an embodiment of the present invention further provides an electronic device, where the electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to implement the steps in the method for controlling the target device as described above.
In a fourth aspect, the embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the control method of the target device as described above.
In the embodiment of the invention, under the condition that the target equipment is placed in a first area on the screen of the electronic equipment, a picture of the target equipment is shot; and displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture, placing a preset control key and the controlled target equipment on the same screen, and enabling a user to control the target equipment in a short distance by touching the key in the second area so as to enhance the reality sense of interaction.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
Fig. 1 is a flowchart illustrating a method for controlling a target device according to an embodiment of the present invention;
FIG. 2 shows a schematic diagram of a first example of embodiment of the invention;
FIG. 3 shows a schematic diagram of a second example of embodiment of the invention;
fig. 4 is a second flowchart of a control method of a target device according to an embodiment of the present invention;
fig. 5 is a third flowchart illustrating a control method of a target device according to an embodiment of the present invention;
FIG. 6 shows a flow chart of a fourth example of an embodiment of the invention;
FIG. 7 shows one of the block diagrams of an electronic device provided by an embodiment of the invention;
fig. 8 shows a second block diagram of an electronic device according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
In various embodiments of the present invention, it should be understood that the sequence numbers of the following processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Referring to fig. 1, an embodiment of the present invention provides a control method for a target device, which is applied to electronic devices including various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and various forms of Mobile Stations (MSs), terminal devices (terminaldevices), and so on.
The method comprises the following steps:
step 101, taking a picture of a target device under the condition that the target device is placed in a first area on a screen of the electronic device.
Wherein, receive gravity on the accessible sensor detection screen, or scan the mode of placing the object on the screen through leading camera, placed target device on the detection screen.
And if the target equipment is detected to be placed in the first area, shooting a picture of the target equipment for identifying the target equipment. The target device may be a stereo, a smart watch, an electronic toothbrush, etc.
And 102, displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture.
Alternatively, the key information may be characteristics of the target device, such as appearance information, configuration information, brand identification, and the like. The key information is used for identifying the target device, optionally, when the electronic device is connected with the target device for the first time, the corresponding relationship between the key information of the target device and the control key is recorded, and when the key information is extracted again subsequently, the control key is displayed according to the recorded corresponding relationship.
And determining a preset control key corresponding to the key information according to the key information, wherein the preset control key is used for controlling the target equipment. Optionally, in addition to the above-mentioned manner of recording the correspondence between the key information of the target device and the control key, the method may further include sending the key information to a server in communication connection with the electronic device, and requesting the server to search for the control key corresponding to the target device according to the key information.
After the preset control key is determined, displaying the preset control key in a second area of the screen, and controlling the target equipment by a user through touching the preset control key; because the target equipment is positioned on the screen at the moment, the control key area of the target equipment is simultaneously displayed on the screen, and the reality of interactive experience is enhanced; alternatively, if the width of the side of the target device in contact with the screen is smaller than the width of the screen, that is, the screen is not completely covered, an area surrounding the first area is taken as the second area, as a first example, as shown in fig. 2, the target device is an audio device, S1 is the first area, S2 is the second area, S2 surrounds the S1 area, and preset control keys related to the audio device are displayed in S2.
If the width of the side of the target device in contact with the screen is greater than or equal to the width of the screen, that is, the screen is completely covered, the other area around the first area is taken as a second area, as a second example, as shown in fig. 3, the target device is an audio device, S1 is the first area, S2 is the second area, and preset control keys related to the audio device are displayed in S2.
It can be understood that after the control key is displayed on the screen of the electronic device, if the target device can be detached from the screen, the control key can still control the target device.
In the embodiment of the invention, under the condition that target equipment is placed in a first area on a screen of the electronic equipment, a picture of the target equipment is shot; and displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture, placing a preset control key and the controlled target equipment on the same screen, and enabling a user to control the target equipment in a short distance by touching the key in the second area so as to enhance the reality sense of interaction. The embodiment of the invention solves the problem that the electronic equipment and the controlled equipment are always in an isolated state in the interaction process in the prior art.
Optionally, in this embodiment of the present invention, before the step of taking a picture of the target device when the target device is placed in the first area on the screen of the electronic device, the method further includes:
under the condition that an object is placed on a screen of the electronic equipment, acquiring identification parameters through pressure sensing equipment of the screen;
determining the object as target equipment according to the identification parameters;
wherein the identification parameters include at least one of:
a mass of the object;
the area of the surface of the object in contact with the screen.
The identification parameter may be a mass of the object and/or an area of a surface of the object contacting the screen, and the identification parameter may further include other parameters, which is not limited in this embodiment of the present invention.
Wherein, the pressure-sensitive device can be a pressure-sensitive sensor or the like, the mass (or weight) of the object can be determined by the pressure detected by the pressure-sensitive sensor, and the area of the contact surface of the object and the screen can be determined by detecting the area of the pressure;
determining that the object is the target device according to the identification parameter may be determining whether the object is the target device according to the identification parameter, for example, the electronic device records the mass of each target device and the area of each structural surface, and comparing the measured identification parameter with a parameter recorded in advance in the electronic device to determine whether the same parameter exists; and if the parameters are the same, determining the object as the target equipment. At this time, a camera of the electronic device may be started to take a picture of the object.
Referring to fig. 4, an embodiment of the present invention provides a method for controlling a target device, which is applied to an electronic device, and the method includes:
step 401, taking a picture of a target device when the target device is placed in a first area on a screen of the electronic device.
Wherein, receive gravity on the accessible sensor detection screen, or scan the mode of placing the object on the screen through leading camera, placed target device on the detection screen.
And if the target equipment is detected to be placed in the first area, shooting a picture of the target equipment for identifying the target equipment.
Step 402, according to the key information in the picture, displaying a control key corresponding to the key information in a second area of the screen.
Alternatively, the key information may be characteristics of the target device, such as appearance information, configuration information, brand identification, and the like. The key information is used for identifying the target device, optionally, when the electronic device is connected with the target device for the first time, the corresponding relationship between the key information of the target device and the control key is recorded, and when the key information is extracted again subsequently, the control key is displayed according to the recorded corresponding relationship.
And determining a preset control key corresponding to the key information according to the key information, wherein the preset control key is used for controlling the target equipment. Optionally, in addition to the above-mentioned manner of recording the correspondence between the key information of the target device and the control key, the method may further include sending the key information to a server in communication connection with the electronic device, and requesting the server to search for the control key corresponding to the target device according to the key information.
After the preset control key is determined, displaying the preset control key in a second area of the screen, and controlling the target equipment by a user through touching the preset control key; because the target device is positioned on the screen at the moment, the control key area of the target device is simultaneously displayed on the screen, and the reality of interactive experience is enhanced.
Step 403, receiving a touch operation on the control key.
And after the preset control keys in the second area are displayed, receiving touch operation of a user for the touch keys. Referring to fig. 2, the user may touch a key in the area of S2.
Step 404, in response to the touch operation, sending control information corresponding to the touch operation to the target device.
Optionally, control information corresponding to the touch operation is sent to the target device,
as a third example, referring to table 1 below, a control protocol between preset control keys and control information is provided in table 1:
table 1:
Figure BDA0002437528400000061
Figure BDA0002437528400000071
if the preset control key 'next' is touched, the electronic equipment sends control information '0X 000011' to the target equipment; and after the target device successfully receives the control information, feeding back '0 x 1' to the electronic device, and if the control information is not successfully received, feeding back '0 x 0' to the electronic device.
Optionally, in this embodiment of the present invention, after the step of taking the picture of the target device, the method further includes:
and establishing communication connection with the target equipment according to the key information in the picture.
The Communication connection mode may be bluetooth connection or Near Field Communication (NFC); and after the preset control key is displayed, the electronic equipment automatically starts the communication connection with the target equipment.
Optionally, in this embodiment of the present invention, the step of establishing a communication connection with the target device includes:
acquiring a preset key corresponding to the key information;
and starting communication connection with the target equipment according to the preset secret key.
After communication connection with the target device is started, verifying a preset secret key between the target device and the target device to ensure communication safety; specifically, a preset key corresponding to the key information and stored locally in the electronic device may be acquired, and a communication connection request is sent to the target device and carries the preset key.
Referring to fig. 5, an embodiment of the present invention provides a method for controlling a target device, which is applied to an electronic device, and includes:
step 501, taking a picture of a target device when the target device is placed in a first area on a screen of the electronic device.
Wherein, receive gravity on the accessible sensor detection screen, or scan the mode of placing the object on the screen through leading camera, placed target device on the detection screen.
And if the target equipment is detected to be placed in the first area, shooting a picture of the target equipment for identifying the target equipment.
Step 502, extracting key information in the picture.
And extracting key information of the target equipment. Alternatively, the key information may be characteristics of the target device, such as appearance information, configuration information, brand identification, and the like. The key information is used to identify the target device.
Step 503, detecting whether a preset control key corresponding to the key information is stored in the electronic device; if yes, go to step 504; otherwise, step 505 is performed.
And detecting whether a preset control key corresponding to the key information is stored in the electronic equipment or not according to the key information, wherein the preset control key is used for controlling the target equipment.
And 504, displaying a preset control key in a second area of the screen under the condition that the preset control key corresponding to the key information is stored in the electronic equipment, and ending the process.
Optionally, when the electronic device is initially connected to the target device, the corresponding relationship between the key information of the target device and the control key may be recorded, and when the key information is subsequently extracted again, the control key may be displayed according to the recorded corresponding relationship.
Step 505, uploading the key information to a preset server under the condition that the electronic device does not store a preset control key corresponding to the key information, and then executing step 506.
Step 506, receiving the model information of the target device sent by the preset server, and then executing step 507.
Receiving model information of the target equipment, which is obtained by the preset server according to the key information identification;
and step 507, matching a preset control key of the target device according to the model information, displaying the preset control key in a second area of the screen, and ending the process.
If the preset control key corresponding to the key information is not stored on the electronic equipment side, the key information is sent to a server in communication connection with the electronic equipment, the server is requested to search the model information corresponding to the target equipment according to the key information, and then the model information fed back by the server is received. Optionally, the server side may store in advance a correspondence between key information and model information of a plurality of devices.
And finally, the electronic equipment searches for the control protocol adopted by the equipment with the model information according to the model information, and matches the control information corresponding to the preset control key according to the control protocol information.
Optionally, in an embodiment of the present invention, after the step of uploading the key information to a preset server, the method further includes:
if the preset server feeds back that the key information is not stored, sending prompt information for prompting to store the key information and the model information of the target equipment so that a user can input the model information manually and improve the equipment information stored locally in the electronic equipment.
As a fourth example, referring to fig. 6, taking a target device as an audio device and an electronic device as a mobile phone as an example, the method for controlling the target device provided in the embodiment of the present invention mainly includes the following processes:
step 601, the intelligent device identification switch is turned on.
And opening an intelligent equipment identification switch in the setting of the mobile phone.
Step 602, detecting that a sound box is placed on a mobile phone screen, and starting scanning.
When the sound box is placed on a mobile phone screen, the mobile phone screen is identified to be a plurality of preset models through pressure sensing, a wide-angle mode of a front wide-angle camera of the camera mobile phone is opened, a scanning mode is automatically started, and the model of an object is scanned and identified through an object identification technology.
Step 603, scanning is successful, and key information of the sound is obtained.
If the scanning fails in three attempts, closing the front camera, and ending the operation;
if the scanning is successful, the key information of the identified article, such as length, width and height, key icon information, production date and the like, is compared with the local database of the mobile phone.
Step 604, the mobile phone detects whether the communication connection matched with the key information is stored locally; if yes, go to step 605, initiate connection to the audio through the bluetooth port, and go to step 609.
If not, step 606 is executed, and the key information is sent to the server, and the model information is matched.
If the server does not respond or the issued matching model is null, the operation is finished.
Step 607, receiving the control protocol of the sound equipment fed back by the server according to the model information.
And the mobile phone queries a local corresponding key (device-key) through the model information (device-model).
If the appropriate device-key is found locally, a pop-up dialog box prompts the user to actively connect with another password, such as a Personal Identification Number (PIN) of a Subscriber Identity Module (SIM) card.
Step 608, initiating connection to the sound according to the control protocol, and executing step 609.
Step 609, displaying a preset control key around the sound on the screen of the mobile phone, as shown in fig. 2.
In the embodiment of the invention, under the condition that target equipment is placed in a first area on a screen of the electronic equipment, a picture of the target equipment is shot; and then extracting key information in the picture, displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture, placing a preset control key and a controlled target device on the same screen, and enabling a user to control the target device in a close range by touching the key in the second area, so that the interactive sense of reality is enhanced.
Having described the control method of the target device according to the embodiment of the present invention, the electronic device according to the embodiment of the present invention will be described with reference to the accompanying drawings.
Referring to fig. 7, an embodiment of the present invention further provides an electronic device 700, where the electronic device 700 may be various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, and various forms of mobile stations, terminal devices, and the like, and the electronic device 700 includes:
the shooting module 701 is configured to shoot a picture of a target device when the target device is placed in a first area on a screen of the electronic device.
Wherein, receive gravity on the accessible sensor detection screen, or scan the mode of placing the object on the screen through leading camera, detect and be in whether target device has been placed in first region on electronic equipment's the screen.
And if the target equipment is detected to be placed in the first area, shooting a picture of the target equipment for identifying the target equipment. The target device may be a stereo, a smart watch, an electronic toothbrush, etc.
The key information may be characteristics of the target device, such as appearance information, configuration information, brand identification, etc. The key information is used to identify the target device, and optionally, when the electronic device 700 initially establishes a connection with the target device, the corresponding relationship between the key information of the target device and the control key may be recorded, and when the key information is subsequently extracted again, the control key may be displayed according to the recorded corresponding relationship.
A display module 702, configured to display, according to the key information in the picture, a control key corresponding to the key information in a second area of the screen.
The key information may be characteristics of the target device, such as appearance information, configuration information, brand identification, and the like. The key information is used to identify the target device, and optionally, when the electronic device 700 initially establishes a connection with the target device, the corresponding relationship between the key information of the target device and the control key may be recorded, and when the key information is subsequently extracted again, the control key may be displayed according to the recorded corresponding relationship.
And determining a preset control key corresponding to the key information according to the key information, wherein the preset control key is used for controlling the target equipment. Optionally, in addition to the above-mentioned manner of describing the corresponding relationship between the key information of the target device and the control key, the method may further include sending the key information to a server in communication connection with the electronic device 700, and requesting the server to search for the control key corresponding to the target device according to the key information.
After the preset control key is determined, displaying the preset control key in a second area of the screen, and controlling the target equipment by a user through touching the preset control key; because the target equipment is positioned on the screen at the moment, the control key area of the target equipment is simultaneously displayed on the screen, and the reality of interactive experience is enhanced; alternatively, if the width of the side of the target device in contact with the screen is smaller than the width of the screen, that is, the screen is not completely covered, the area surrounding the first area is taken as the second area, as shown in fig. 2, the target device is an audio device, S1 is the first area, S2 is the second area, S2 surrounds the S1 area, and preset control keys related to the audio device are displayed in S2.
If the width of the side of the target device in contact with the screen is greater than or equal to the width of the screen, that is, the screen is completely covered, the other area around the first area is taken as the second area, as shown in fig. 3, the target device is an audio device, S1 is the first area, S2 is the second area, and preset control keys related to the audio device are displayed in S2.
Optionally, in this embodiment of the present invention, the electronic device 700 further includes:
the receiving module is used for receiving touch operation on the control key;
and the sending module is used for responding to the touch operation and sending control information corresponding to the touch operation to the target equipment.
Optionally, in an embodiment of the present invention, the electronic device 700 includes:
and the connection module is used for establishing communication connection with the target equipment according to the key information in the picture.
Optionally, in an embodiment of the present invention, the connection module includes:
the obtaining submodule is used for obtaining a preset key corresponding to the key information;
and the starting submodule is used for starting the communication connection with the target equipment according to the preset secret key.
Optionally, in this embodiment of the present invention, the display module 702 includes:
the first display sub-module is used for displaying a preset control key in a second area of the screen under the condition that the preset control key corresponding to the key information is stored in the electronic equipment;
the uploading sub-module is used for uploading the key information to a preset server under the condition that the electronic equipment does not store a preset control key corresponding to the key information;
the receiving submodule is used for receiving the model information of the target equipment sent by the preset server;
and the second display submodule is used for matching the preset control key of the target equipment according to the model information and displaying the preset control key in a second area of the screen.
Optionally, in this embodiment of the present invention, the electronic device 700 further includes:
and the prompting module is used for sending prompting information for prompting storage of the key information and the model information of the target equipment if the preset server feeds back that the key information is not stored.
Optionally, in an embodiment of the present invention, the electronic device 700 includes:
the parameter acquisition module is used for acquiring identification parameters through the pressure sensing equipment of the screen under the condition that an object is placed on the screen of the electronic equipment;
the judging module is used for determining the object as the target equipment according to the identification parameters;
wherein the identification parameters include at least one of:
a mass of the object;
the area of the surface of the object in contact with the screen.
The electronic device 700 provided in the embodiment of the present invention can implement each process implemented by the electronic device 700 in the above method embodiments, and for avoiding repetition, details are not described here.
FIG. 8 is a diagram illustrating a hardware configuration of an electronic device implementing various embodiments of the invention;
the electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, a processor 810, a power supply 811, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 8 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The image capturing device 812 may be configured to take a picture of a target device when the target device is placed in a first area on a screen of the electronic device;
the display unit 806 may be configured to display, according to key information in the picture, a control key corresponding to the key information in a second area of the screen.
In the embodiment of the invention, under the condition that target equipment is placed in a first area on a screen of the electronic equipment, a picture of the target equipment is shot; and then extracting key information in the picture, displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture, placing a preset control key and a controlled target device on the same screen, and enabling a user to control the target device in a close range by touching the key in the second area, so that the interactive sense of reality is enhanced.
It should be noted that, in this embodiment, the electronic device 800 may implement each process in the method embodiment of the present invention and achieve the same beneficial effects, and for avoiding repetition, details are not described here.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 801 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 810; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio frequency unit 801 can also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 802, such as to assist the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 may also provide audio output related to a specific function performed by the electronic apparatus 800 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.
The input unit 804 is used for receiving an audio or video signal. The input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics processor 8041 processes image data of a still picture or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 806. The image frames processed by the graphics processor 8041 may be stored in the memory 809 (or other storage medium) or transmitted via the radio frequency unit 801 or the network module 802. The microphone 8042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 801 in case of a phone call mode.
The electronic device 800 also includes at least one sensor 805, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 8061 according to the brightness of ambient light and a proximity sensor that can turn off the display panel 8061 and/or the backlight when the electronic device 800 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 805 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The Display unit 806 may include a Display panel 8061, and the Display panel 8061 may be configured in the form of a liquid Crystal Display (L acquired Crystal Display, L CD), an Organic light-Emitting Diode (O L ED), or the like.
The user input unit 807 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus. Specifically, the user input unit 807 includes a touch panel 8071 and other input devices 8072. The touch panel 8071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 8071 (e.g., operations by a user on or near the touch panel 8071 using a finger, a stylus, or any other suitable object or accessory). The touch panel 8071 may include two portions of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 810, receives a command from the processor 810, and executes the command. In addition, the touch panel 8071 can be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 8071, the user input unit 807 can include other input devices 8072. In particular, other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 8071 can be overlaid on the display panel 8061, and when the touch panel 8071 detects a touch operation on or near the touch panel 8071, the touch operation is transmitted to the processor 810 to determine the type of the touch event, and then the processor 810 provides a corresponding visual output on the display panel 8061 according to the type of the touch event. Although in fig. 8, the touch panel 8071 and the display panel 8061 are two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 8071 and the display panel 8061 may be integrated to implement the input and output functions of the electronic device, and the implementation is not limited herein.
The interface unit 808 is an interface for connecting an external device to the electronic apparatus 800. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 808 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 800 or may be used to transmit data between the electronic device 800 and external devices.
The memory 809 may be used to store software programs as well as various data. The memory 809 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 809 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 810 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 809 and calling data stored in the memory 809, thereby monitoring the whole electronic device. Processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.
The electronic device 800 may also include a power supply 811 (e.g., a battery) for powering the various components, and preferably, the power supply 811 may be logically coupled to the processor 810 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.
In addition, the electronic device 800 includes some functional modules that are not shown, and are not described in detail herein.
Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 810, a memory 809, and a computer program stored in the memory 809 and capable of running on the processor 810, where the computer program, when executed by the processor 810, implements each process of the above-mentioned control method embodiment of the target device, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the control method embodiment of the target device, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (10)

1. A control method of a target device is applied to an electronic device, and is characterized by comprising the following steps:
shooting a picture of a target device under the condition that the target device is placed in a first area on a screen of the electronic device;
and displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture.
2. The method for controlling a target device according to claim 1, wherein after the step of displaying the control key corresponding to the key information in the second area of the screen, the method further comprises:
receiving touch operation on the control key;
and responding to the touch operation, and sending control information corresponding to the touch operation to the target equipment.
3. The method of controlling a target device according to claim 1, wherein after the step of taking a picture of the target device, the method further comprises:
and establishing communication connection with the target equipment according to the key information in the picture.
4. The method according to claim 3, wherein the step of establishing the communication connection with the target device includes:
acquiring a preset key corresponding to the key information;
and starting communication connection with the target equipment according to the preset secret key.
5. The method for controlling the target device according to claim 1, wherein the step of displaying the control key corresponding to the key information in the second area of the screen according to the key information in the picture comprises:
displaying a preset control key in a second area of the screen under the condition that the preset control key corresponding to the key information is stored in the electronic equipment;
uploading the key information to a preset server under the condition that the electronic equipment does not store a preset control key corresponding to the key information;
receiving the model information of the target equipment sent by the preset server;
and matching a preset control key of the target equipment according to the model information, and displaying the preset control key in a second area of the screen.
6. The method for controlling the target device according to claim 1, wherein before the step of taking the picture of the target device in a case where the target device is placed in a first area on the screen of the electronic device, the method further comprises:
under the condition that an object is placed on a screen of the electronic equipment, acquiring identification parameters through pressure sensing equipment of the screen;
determining the object as target equipment according to the identification parameters;
wherein the identification parameters include at least one of:
a mass of the object;
the area of the surface of the object in contact with the screen.
7. An electronic device, characterized in that the electronic device comprises:
the shooting module is used for shooting a picture of the target equipment under the condition that the target equipment is placed in a first area on a screen of the electronic equipment;
and the display module is used for displaying a control key corresponding to the key information in a second area of the screen according to the key information in the picture.
8. The electronic device of claim 7, further comprising:
the receiving module is used for receiving touch operation on the control key;
and the sending module is used for responding to the touch operation and sending control information corresponding to the touch operation to the target equipment.
9. An electronic device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the control method of a target device according to any one of claims 1 to 6.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the method of controlling a target device according to any one of claims 1 to 6.
CN202010256465.9A 2020-04-02 2020-04-02 Target device control method and electronic device Active CN111506228B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010256465.9A CN111506228B (en) 2020-04-02 2020-04-02 Target device control method and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010256465.9A CN111506228B (en) 2020-04-02 2020-04-02 Target device control method and electronic device

Publications (2)

Publication Number Publication Date
CN111506228A true CN111506228A (en) 2020-08-07
CN111506228B CN111506228B (en) 2022-05-17

Family

ID=71872598

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010256465.9A Active CN111506228B (en) 2020-04-02 2020-04-02 Target device control method and electronic device

Country Status (1)

Country Link
CN (1) CN111506228B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112351507A (en) * 2020-10-30 2021-02-09 维沃移动通信有限公司 Interaction control method, interaction control device, electronic equipment and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104598137A (en) * 2013-10-31 2015-05-06 联想(北京)有限公司 Information interaction method, device and facility
CN105204742A (en) * 2015-09-28 2015-12-30 小米科技有限责任公司 Control method and device of electronic equipment and terminal
CN106126014A (en) * 2016-06-16 2016-11-16 北京小米移动软件有限公司 The generation method and device of interactive interface
CN108345907A (en) * 2018-02-09 2018-07-31 广东美的制冷设备有限公司 Recognition methods, augmented reality equipment and storage medium
US20190354178A1 (en) * 2019-06-28 2019-11-21 Lg Electronics Inc. Artificial intelligence device capable of being controlled according to user action and method of operating the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104598137A (en) * 2013-10-31 2015-05-06 联想(北京)有限公司 Information interaction method, device and facility
CN105204742A (en) * 2015-09-28 2015-12-30 小米科技有限责任公司 Control method and device of electronic equipment and terminal
CN106126014A (en) * 2016-06-16 2016-11-16 北京小米移动软件有限公司 The generation method and device of interactive interface
CN108345907A (en) * 2018-02-09 2018-07-31 广东美的制冷设备有限公司 Recognition methods, augmented reality equipment and storage medium
US20190354178A1 (en) * 2019-06-28 2019-11-21 Lg Electronics Inc. Artificial intelligence device capable of being controlled according to user action and method of operating the same

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112351507A (en) * 2020-10-30 2021-02-09 维沃移动通信有限公司 Interaction control method, interaction control device, electronic equipment and readable storage medium

Also Published As

Publication number Publication date
CN111506228B (en) 2022-05-17

Similar Documents

Publication Publication Date Title
CN109461117B (en) Image processing method and mobile terminal
CN108279948B (en) Application program starting method and mobile terminal
CN108319442B (en) Audio playing control method and mobile terminal
CN111083755B (en) Equipment switching method and related equipment
CN108196815B (en) Method for adjusting call sound and mobile terminal
CN109639863B (en) Voice processing method and device
CN109523253B (en) Payment method and device
CN110096203B (en) Screenshot method and mobile terminal
CN109521684B (en) Household equipment control method and terminal equipment
CN107682359B (en) Application registration method and mobile terminal
CN109544172B (en) Display method and terminal equipment
CN111756696A (en) Login method of application program, first electronic device and second electronic device
CN110225040B (en) Information processing method and terminal equipment
CN109788114B (en) Call processing method and terminal
CN108196663B (en) Face recognition method and mobile terminal
CN111125800A (en) Icon display method and electronic equipment
CN111506228B (en) Target device control method and electronic device
CN109451143B (en) Call method and mobile terminal
CN108810276B (en) Face recognition method and mobile terminal
CN109164951B (en) Mobile terminal operation method and mobile terminal
CN108418961B (en) Audio playing method and mobile terminal
CN108897467B (en) Display control method and terminal equipment
CN111444491B (en) Information processing method and electronic equipment
CN111416955B (en) Video call method and electronic equipment
CN110826044B (en) Unlocking method and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant