EP3147826A1 - Method and apparatus for controlling electronic device - Google Patents

Method and apparatus for controlling electronic device Download PDF

Info

Publication number
EP3147826A1
EP3147826A1 EP16165951.1A EP16165951A EP3147826A1 EP 3147826 A1 EP3147826 A1 EP 3147826A1 EP 16165951 A EP16165951 A EP 16165951A EP 3147826 A1 EP3147826 A1 EP 3147826A1
Authority
EP
European Patent Office
Prior art keywords
controlled
unit
control interface
target image
component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP16165951.1A
Other languages
German (de)
English (en)
French (fr)
Inventor
Xiao Zhang
Yongli SUN
Ziguang Gao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiaomi Inc
Original Assignee
Xiaomi Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiaomi Inc filed Critical Xiaomi Inc
Publication of EP3147826A1 publication Critical patent/EP3147826A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00—Systems controlled by a computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G06F3/005—Input arrangements through a video camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/06009—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
    • G06K19/06018—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking one-dimensional coding
    • G06K19/06028—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking one-dimensional coding using bar codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404—Methods for optical code recognition
    • G06K7/1439—Methods for optical code recognition including a method step for retrieval of the optical code
    • G06K7/1447—Methods for optical code recognition including a method step for retrieval of the optical code extracting optical codes from image or text carrying said optical code
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/23—Pc programming
    • G05B2219/23067—Control, human or man machine interface, interactive, HMI, MMI
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/24—Pc safety
    • G05B2219/24012—Use camera of handheld device, head mounted display
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/22—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
    • G06V10/225—Image preprocessing by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition based on a marking or identifier characterising the area
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/50—Receiving or transmitting feedback, e.g. replies, status updates, acknowledgements, from the controlled devices
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/50—Receiving or transmitting feedback, e.g. replies, status updates, acknowledgements, from the controlled devices
    • G08C2201/51—Remote controlling of devices based on replies, status thereof
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/90—Additional features
    • G08C2201/92—Universal remote control
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/90—Additional features
    • G08C2201/93—Remote control using other portable devices, e.g. mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q2209/00—Arrangements in telecontrol or telemetry systems
    • H04Q2209/40—Arrangements in telecontrol or telemetry systems using a wireless architecture

Definitions

  • the present disclosure generally relates to the field of communication technology, and more particularly, to a method and apparatus for controlling an electronic device and a terminal.
  • a software application for controlling an intelligent device may be installed in an smart terminal.
  • Such an APP may provide different user interfaces corresponding to different intelligent devices, so that the corresponding intelligent device may be controlled through the user interface.
  • searching for the corresponding intelligent device within the APP when many intelligent devices are present, which lacks convenience.
  • the present disclosure provides in embodiments a method and apparatus for controlling an electronic device, and a terminal.
  • a method for controlling an electronic device including:
  • acquiring the target image comprises:
  • determining the device to be controlled by recognizing the target image comprises:
  • determining the device to be controlled by recognizing the target image comprises:
  • displaying the control interface of the device to be controlled comprises:
  • determining the device to be controlled by recognizing the target image comprises: determining a component to be controlled in the device to be controlled by recognizing the target image; and displaying the control interface of the device to be controlled comprises: displaying a control interface of the component to be controlled.
  • displaying the control interface of the component to be controlled comprises:
  • controlling the device to be controlled to operate in response to detecting the control operation for the control interface comprises:
  • an apparatus for controlling an electronic device including:
  • the image acquiring unit comprises:
  • the device determining unit comprises:
  • the device determining unit comprises:
  • the interface displaying unit comprises:
  • the device determining unit comprises: a component determining sub-unit, configured to determine a component to be controlled in the device to be controlled by recognizing the target image; and the interface displaying unit comprises: a second displaying sub-unit, configured to display a control interface corresponding to the component to be controlled determined by the component determining sub-unit.
  • the second displaying sub-unit comprises:
  • the operation controlling unit comprises:
  • a terminal including:
  • the technical solution provided by embodiments of the present disclosure may have the following advantageous effects.
  • the technical solution of the present disclosure may acquire the target image, and may display the control interface of the device to be controlled after the device to be controlled is determined by recognizing the target image.
  • Such a control interface may enable the user to trigger the control operation on the intelligent device, so as to control the device to be controlled to operate, such that manual operations of the user may be reduced significantly, thereby accelerating speed of displaying the control interface of the intelligent device, and providing the user convenience.
  • the technical solution of the present disclosure may activate the image acquiring device and acquire the target image by the image acquiring device, which is easy to implement.
  • the target image may be acquired by a simple operation from the user, thereby significantly reducing manual operations of the user, and providing the user greater convenience.
  • the profile information of the object included in the image may be extracted from the target image using the image recognition algorithm, so as to recognize the device to be controlled quickly, which is easy to be achieved with high accuracy.
  • the barcode information of the object included in the image may be extracted from the target image using the image recognition algorithm, so as to recognize the device to be controlled quickly, which is easy to be achieved with high accuracy.
  • the technical solution of the present disclosure may set different correspondences between the device to be controlled and the control interface in advance, one device to be controlled may correspond to one or more control interfaces, and different control interfaces may include different functions for the device to be controlled, so as to control the device more flexibly.
  • the technical solution of the present disclosure may further determine the component to be controlled in the device to be controlled in accordance with the target image, so as to display the control interface of the component to be controlled, thereby further providing the user a more delicate device controlling function, and thus facilitating the user to operate.
  • the technical solution may set different correspondences between the component to be controlled and the control interface in advance.
  • a control interface may merely include a control function corresponding to the component to be controlled, so as to enable the control function provided by the control interface to be more specific, allowing the control interface to be more concise, and providing the user a more convenient operation.
  • the control instruction when receiving the control operation from the user by the control interface, the control instruction may be generated and sent to the device to be controlled, so as to instruct the device to be controlled to operate in accordance with the control instruction accordingly, thereby improving the convenience of device control, and thus proving the user convenience.
  • first, second, and third are used herein for describing various information, but the information should not be limited by these terms. The terms are only used for distinguishing the information of the same type from each other. For example, first information may also be called second information, and similarly, the second information may also be called the first information, without departing from the scope of the present disclosure.
  • first information may also be called second information, and similarly, the second information may also be called the first information, without departing from the scope of the present disclosure.
  • the term “if” may be construed to mean “when” or “upon” or “in response to determining”.
  • Fig. 1 is a flow chart showing a method for controlling an electronic device according to an illustrative embodiment. As shown in Fig. 1 , the method applicable to a smart terminal includes the following steps 101 to 103.
  • step 101 a target image is acquired.
  • the method may be applied to an intelligent environment provided with several intelligent devices, like a typical smart home environment.
  • the intelligent device may include a smart fan, a smart air conditioner, an air cleaner and a smart power socket and the like.
  • the method according to embodiments of the present disclosure may be implemented by a smart terminal in the intelligent environment.
  • the smart terminal may be smart glasses, a smart phone, a tablet computer, a personal digital assistant (PDA) and the like.
  • PDA personal digital assistant
  • the smart terminal may have an image processing function.
  • the smart terminal may have an image storing function capable of storing a plurality of images; the smart terminal may be provided with an image acquiring device, such as a camera capable of acquiring an image in real time and taking a picture.
  • an image acquiring device such as a camera capable of acquiring an image in real time and taking a picture.
  • a target image may be acquired from a photo gallery, or taken by activating the camera.
  • a user may activate the camera and aim at a device to be controlled when requiring controlling the electronic device, so that the smart terminal may acquire the target image currently including the device to be controlled.
  • step 102 a device to be controlled is determined by recognizing the target image.
  • the device to be controlled may be recognized from the target image.
  • an object included in the target image may be recognized using an image recognition algorithm, so as to determine the device to be controlled.
  • step 103 a control interface of the device to be controlled is displayed.
  • the control interface of the device to be controlled is displayed automatically.
  • a control interface corresponds to the device to be controlled, and may include one or more functions available for the user to trigger, so as to enable the user to trigger the control of the device to be controlled.
  • step 104 the device to be controlled is controlled to operate in response to detecting a control operation for the control interface.
  • the control interface may provide one or more functions available for the user to trigger and configured for controlling the device to be controlled.
  • the control interface may include a switch option corresponding to respective physical button disposed at the device to be controlled. If the control operation for the control interface from the user is detected, the smart terminal may control the device to be controlled accordingly.
  • the technical solution of the present disclosure may acquire the target image; and display the control interface of the device to be controlled after determining the device to be controlled by recognizing the target image.
  • Such a control interface may enable the user to trigger the control operation on the intelligent device, so as to control the device to be controlled to operate.
  • the technical solution of the present disclosure may reduce manual operations of the user, accelerate speed of displaying the control interface of the intelligent device, and provide the user convenience.
  • the smart terminal may acquire the target image by various ways.
  • acquiring the target image may include:
  • the image acquiring device may be integrated in the smart terminal.
  • the user may trigger the smart terminal to activate the camera, like selecting a camera APP icon or other preset activating instructions in a user interface of the smart terminal, e.g., when detecting that a preset button for activating the camera is pressed by the user or a preset track is received, and the like.
  • the user interface of the smart terminal may display a picture taken by the camera at a current time, the user may enable the camera to aim at the device to be controlled, allowing the device to be controlled to be within a camera frame, such that the smart terminal may acquire the target image by the camera.
  • the technical solution of the present disclosure is easy to be achieved, i.e., the target image may be acquired merely with a simple operation of the user, such that the manual operations of the user are reduced significantly, resulting in the higher convenience.
  • the smart terminal may determine the device to be controlled from the target image by various ways.
  • barcode information is disposed at the device to be controlled, such that the device to be controlled may be determined by recognizing the barcode information; or by recognizing various kinds of profile information of the intelligent device.
  • the profile information of an object included in the target image is extracted from the target image using an image recognition algorithm, and the device to be controlled is determined in accordance with the profile information.
  • the smart home environment may include various electronic devices, e.g., an air conditioner, a fan, a socket, or a lamp, etc.
  • electronic devices e.g., an air conditioner, a fan, a socket, or a lamp, etc.
  • Different electronic devices are of different appearance, resulting in different profiles thereof with large differences.
  • the profile information may be used as identification information for the electronic device, such that the corresponding device to be controlled may be determined accurately from the target image by means of the profile information.
  • the electronic device is generally provided with a plurality of functional components.
  • the smart power socket may be provided with a power button, a plurality of three-hole sockets, a plurality of two-hole sockets and a plurality of universal serial bus (USB) interfaces, etc.
  • the smart fan may be provided with a power button, a plurality buttons corresponding to different levels of wind scale and a swinging button, etc.
  • the profile information may correspond to the profile of entire or part of the electronic device.
  • the image recognition algorithm may be any existing algorithm for recognizing an object profile.
  • various kinds of profile information may be preset in accordance with the appearance of the intelligent device, like setting profile information under different perspectives, including a front view, a left view or a right view of the intelligent device; or setting profile information corresponding to different components in the intelligent device, for recognizing the profile information of the object included in the target image.
  • the device to be controlled may be recognized accurately by extracting the profile information of the object included in the image from the target image using the image recognition algorithm, which is easy to be achieved with high accuracy.
  • the barcode information of an object included in the target image is extracted from the target image using an image recognition algorithm, and the device to be controlled is determined in accordance with the barcode information.
  • the image recognition algorithm may be any existing algorithm for recognizing a barcode.
  • a manufacturer of the electronic device may provide the barcode information at any position (e.g., an outer surface) of the electronic device during manufacturing the device.
  • Such barcode information may be a one-dimension or two-dimension code, capable of recognizing the intelligent device uniquely.
  • the barcode information may record unique identification of the intelligent device, like a device code or a media access control (MAC) address, etc. Accordingly, the intelligent device may be recognized by acquiring image data of the intelligent device and detecting the barcode information.
  • MAC media access control
  • the device to be controlled may be recognized accurately by extracting the barcode information of the object included in the image from the target image using the image recognition algorithm, which is easy to be achieved with high accuracy.
  • step 103 after the device to be controlled is recognized, the control interface of the device to be controlled may be displayed.
  • displaying the control interface of the device to be controlled may include:
  • different correspondences between the device to be controlled and the control interface may be set in advance.
  • One device to be controlled may correspond to one or more control interfaces, and different control interfaces may include different functions for the device to be controlled.
  • the device to be controlled may correspond to different control interfaces, each of which may include different control functions.
  • the control interface may be designed for different electronic devices and functions thereof accordingly.
  • controlling the device to be controlled to operate in response to detecting the control operation for the control interface may include:
  • the smart terminal displays the control interface of the device to be controlled on a display screen of the terminal.
  • the user may perform the control operation in the control interface.
  • the control instruction may be generated and sent to the device to be controlled, so as to instruct the device to be controlled to operate in accordance with the control instruction accordingly.
  • Fig. 2A is a flow chart showing another method for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the method applicable to a smart terminal includes the following steps 201 to 206.
  • a user may trigger the smart terminal to activate the image acquiring device, so as to acquire the target image of the device to be controlled.
  • corresponding operations may be performed by single-clicking, clicking for predetermined times or long-pressing the target position in a user interface by the user, pressing a physical button of the terminal by the user in a predetermined pressing manner, or inputting a predetermined touch track at a target position in the user interface by the user; while for smart glasses, corresponding operations may be performed by clicking the sliding core region in each direction, blinking, swinging head, or voice controlling. Since the user may trigger the smart terminal rapidly to acquire the target image of the device to be controlled, thereby providing the user convenience.
  • the smart terminal activates the image acquiring device.
  • the image acquiring device may be a camera integrated in the smart terminal.
  • the user may hold the smart terminal in hand, enabling the camera disposed at the smart terminal to aim at an electronic device to be controlled, so as to acquire the target image acquired by the image acquiring device, thereby determining the device to be controlled through the target image subsequently.
  • the target image is acquired by the above manner of activating the image acquiring device, so as to reduce the manual operations of the user, determine the device to be controlled rapidly, further accelerate the speed of displaying the control interface, and improve convenience of controlling the electronic device.
  • the profile information of the object included may be extracted from the image data using the image recognition algorithm, and the corresponding device to be controlled is further determined in accordance with the profile information; or the device to be controlled may further be determined by extracting the barcode information using the image recognition algorithm.
  • the device correspondence between the device to be controlled and the control interface may be set in advance; and when it is determined that the device to be controlled is recorded in the device correspondence between the device to be controlled and the control interface set in advance, the control interface corresponding to the device to be controlled may be obtained in accordance with the device correspondence.
  • Fig. 2B is a schematic diagram showing a correspondence between a smart fan and a control interface according to an illustrative embodiment of the present disclosure.
  • a target image including a smart fan is demonstrated.
  • a right view of the smart fan is taken as an example, overall profile information of the smart fan may be recognized from the target image, and the device to be controlled may be determined as the smart fan in accordance with the profile information.
  • the smart fan may correspond to a control interface including functions for controlling all the buttons.
  • the control interface may include a control function corresponding to each physical button disposed at the smart fan.
  • the control function corresponding to each physical button may be a control function corresponding to a button and for executing turning on or off.
  • FIG. 2B another target image including a smart fan is also demonstrated.
  • a front view of the smart fan is taken as an example, overall profile information of the smart fan is recognized from the target image, and the device to be controlled may be determined as the smart fan in accordance with the profile information.
  • the smart fan may correspond to a control interface including functions for controlling all the buttons.
  • the control interface may include a control function corresponding to each physical button disposed at the smart fan.
  • the control function corresponding to each physical button may be a control function corresponding to a button and for executing turning on or off.
  • Fig. 2C is a schematic diagram showing an application scenario of a method for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the application scenario as shown in Fig. 2C includes one smart fan as the electronic device, and one smart phone as the smart terminal.
  • the smart fan and the smart phone are connected wirelessly, and information transmission and interaction are conducted therebetween based on the wireless connection.
  • the smart fan is merely taken as an example for explaining the intelligent device in the present embodiment
  • the smart phone is merely taken as an example for explaining the smart terminal.
  • the intelligent device may also be other various devices such as a smart air conditioner, a smart socket and a smart electronic cooker; while the smart terminal may also be other various smart terminals such as a tablet computer or smart glasses.
  • the user may click a camera APP icon displayed on a display screen of the smart phone; accordingly the smart terminal activates the cameral integrated in the smart phone; as the user enables the camera to aim at the smart fan, it can be known from the user interface 1 of the smart phone in Fig. 2C that the smart phone is able to obtain the target image acquired by the camera.
  • the smart phone extracts the overall profile information of the intelligent device from the target image using the image recognition algorithm or may extract the two-dimensional code information of the intelligent device from the image data using the image recognition algorithm, and then determines that the smart fan corresponds thereto in accordance with the profile information or the two-dimensional code information accordingly.
  • the corresponding control interface may be obtained. It can be known from the user interface 2 in the smart phone as shown in Fig. 2C , a control interface of the smart fan is displayed on the display screen of the smart phone. Such a control interface includes all control functions corresponding to all buttons disposed at the smart fan.
  • Fig. 3A is a flow chart showing another method for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the method applicable to the smart terminal includes the following steps 301 to 306.
  • the component to be controlled in the device to be controlled may be further determined.
  • the terminal recognizes partial profile information of the electronic device from the target image acquired, determines the device to be control and the component to be control therein in accordance with the partial profile information, and further displays a corresponding control interface in accordance with the component to be controlled.
  • a control interface may merely include a control function corresponding to the component to be controlled, so as to enable the control function provided by the control interface to be more specific, thereby allowing the control interface more concise, and providing the user a more convenient operation.
  • the present embodiment only determines the device to be controlled and determines the corresponding control interface in accordance with the device to be controlled; while the present embodiment may further determine the component to be controlled after determining the device to be controlled, and further determine the control interface corresponding to the component to be controlled.
  • the control interface to be displayed may include the control function of all components in the device to be controlled.
  • the component to be controlled may be further determined after the device to be controlled is determined, so as to display the control interface corresponding to the component to be controlled.
  • the target image may correspond to a control interface including control functions of all components; while in the case of merely presenting some components of the device, the target image may correspond to a control interface including control functions of some components.
  • Fig. 3B is a schematic diagram showing an application scenario of another method for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the user enables the camera of the smart phone to aim at a region corresponding to the swing head button of the smart fan, it can be seen from the user interface 1 of the smart phone in Fig. 3B that, the smart phone acquires the target image acquired by the camera.
  • the smart phone extracts the profile information corresponding to the partial region of the device to be controlled from the image data using the image recognition algorithm, and further determines that the device to be controlled is the smart fan and the component to be controlled is the swinging button in accordance with the profile information.
  • the component to be controlled may correspond to a control interface merely including one control function of the swinging button.
  • a control function of the swinging button may be a control function corresponding to the swinging button and for executing turning on or off.
  • the display screen of the smart phone displays a control interface of the smart fan.
  • a control interface merely includes the control function of the swinging button disposed at the smart fan.
  • the present disclosure further provides in embodiments an apparatus for controlling the electronic device.
  • Fig. 4 is a block diagram illustrating an apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the apparatus includes: an image acquiring unit 41, a device determining unit 42, an interface displaying unit 43 and an operation controlling unit 44.
  • the image acquiring unit 41 is configured to acquire a target image.
  • the device determining unit 42 is configured to determine a device to be controlled by recognizing the target image acquired by the image acquiring unit 41.
  • the interface displaying unit 43 is configured to display a control interface of the device to be controlled determined by the device determining unit 42.
  • the operation controlling unit 44 is configured to control the device to be controlled to operate in response to detecting a control operation for the control interface displayed by the interface displaying unit 43.
  • the technical solution of the present disclosure may acquire the target image, and display the control interface of the device to be controlled after the device to be controlled is determined by recognizing the target image.
  • the control interface may enable the user to trigger the control operation on the intelligent device, and thereby controlling the device to be controlled to operate.
  • the technical solution of the present disclosure may reduce the manual operations of the user, accelerate the speed of displaying the control interface of the intelligent device, and provide the user convenience.
  • Fig. 5 is a block diagram illustrating another apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the image acquiring unit 41 includes an activating sub-unit 411 and an acquiring sub-unit 412.
  • the technical solution of the present disclosure may activate the image acquiring device to acquire the target image by the image acquiring device, which is easy to be achieved, the target image may be acquired merely with a simple operation of the user, thereby significantly reducing manual operations of the user, and providing the user greater convenience.
  • Fig. 6 is a block diagram illustrating another apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the device determining unit 42 includes a profile extracting sub-unit 421 and a first device determining sub-unit 422.
  • the profile extracting sub-unit 421 is configured to extract profile information of an object included in the target image from the target image using an image recognition algorithm.
  • the first device determining sub-unit 422 is configured to determine the device to be controlled in accordance with the profile information extracted by the profile extracting sub-unit 421.
  • the profile information of the object included in the image is extracted from the target image using the image recognition algorithm, so as to recognize the device to be controlled accurately, which is easy to be achieved with high accuracy.
  • Fig. 7 is a block diagram illustrating another apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the device determining unit 42 includes a barcode extracting sub-unit 423 and a second device determining sub-unit 424.
  • the barcode extracting sub-unit 423 is configured to extract barcode information of an object included from the target image using an image recognition algorithm.
  • the second device determining sub-unit 424 is configured to determine the device to be controlled in accordance with the barcode information extracted by the barcode extracting sub-unit 423.
  • the barcode information of the object included in the image is extracted from the target image using the image recognition algorithm, so as to recognize the device to be controlled accurately, which is easy to be achieved with high accuracy.
  • Fig. 8 is a block diagram illustrating another apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the interface displaying unit 43 includes a first obtaining sub-unit 431 and a first displaying sub-unit 432.
  • the first obtaining sub-unit 431 is configured to obtain the control interface corresponding to the device to be controlled in accordance with a preset device correspondence in response to determining that the device to be controlled is recorded in the preset device correspondence between the device to be controlled and the control interface.
  • the first displaying sub-unit 432 is configured to display the control interface corresponding to the device to be controlled obtained by the first obtaining sub-unit 431.
  • the technical solution of the present disclosure may preset different correspondences between the device to be controlled and the control interface, one device to be controlled may correspond to one or more control interfaces, and different control interfaces may include different functions for the device to be controlled, so as to control the device more flexibly.
  • Fig. 9 is a block diagram illustrating another apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the device determining unit 42 includes a component determining sub-unit 425, configured to determine a component to be controlled in the device to be controlled by recognizing the target image.
  • the interface displaying unit 43 includes a second displaying sub-unit 433, configured to display a control interface corresponding to the component to be controlled determined by the component determining sub-unit 425.
  • the technical solution of the present disclosure may further determine the component to be controlled in the device to be controlled in accordance with the target image, so as to display the control interface corresponding to the component to be controlled, thereby further providing the user a more delicate device controlling function, and thus facilitating the user to operate.
  • Fig. 10 is a block diagram illustrating another apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the second displaying sub-unit 433 includes an obtaining module 4331 and a displaying module 4332.
  • the obtaining module 4331 is configured to obtain the control interface corresponding to the component to be controlled in accordance with a preset component correspondence in response to determining that the component to be controlled is recorded in the preset component correspondence between the component to be controlled and the control interface.
  • the displaying module 4332 is configured to display the control interface corresponding to the component to be controlled obtained by the obtaining module 4331.
  • the technical solution of the present disclosure may set different correspondences between the component to be controlled and the control interface in advance.
  • a control interface may merely include a control function corresponding to the component to be controlled, so as to enable the control function provided by the control interface to be more specific, thereby allowing the control interface to be more concise, and providing the user a more convenient operation.
  • Fig. 11 is a block diagram illustrating another apparatus for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the operation controlling unit 44 includes an instruction generating sub-unit 441 and an instruction sending sub-unit 442.
  • the instruction generating sub-unit 441 is configured to generate a control instruction corresponding to a control operation in response to detecting the control operation for the control interface.
  • the instruction sending sub-unit 442 is configured to send the control instruction generated by the instruction generating sub-unit 441 to the device to be controlled, so as to trigger the device to be controlled to operate in accordance with the control instruction.
  • the control instruction when receiving the control operation by the control interface from the user, the control instruction may be generated and sent to the device to be controlled, so as to instruct the device to be controlled to operate in accordance with the control instruction accordingly, thereby improving convenience of device control, and thus proving the user convenience.
  • a terminal including:
  • a unit or module described as a separate component may be or not be separated physically
  • a component displayed as a unit or module may be or not be a physical unit, i.e., may be located at one position, or distributed in a plurality of network elements.
  • the object of the present disclosure may be achieved by selecting all or part of the modules as practical required. It would be appreciated and implemented by those skilled in the art without creative labor work.
  • Fig. 12 is a block diagram illustrating an apparatus 1200 for controlling an electronic device according to an illustrative embodiment of the present disclosure.
  • the apparatus 1200 may be a mobile phone; a computer; a digital broadcast terminal; a message receiving and sending device; a gaming console, a tablet device, a medical device, exercise equipment, a personal digital assistant, having a routing function.
  • the apparatus 1200 may include one or more of the following components: a processing component 1202, a memory 1204, a power component 1206, a multimedia component 1208, an audio component 1210, an input/output (I/O) interface 1212, a sensor component 1214, and a communication component 1216.
  • a processing component 1202 a memory 1204, a power component 1206, a multimedia component 1208, an audio component 1210, an input/output (I/O) interface 1212, a sensor component 1214, and a communication component 1216.
  • the processing component 1202 typically controls overall operations of the apparatus 1200, such as the operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 1202 may include one or more processors 1220 to execute instructions to perform all or part of the steps in the above described methods.
  • the processing component 1202 may include one or more modules which facilitate the interaction between the processing component 1202 and other components.
  • the processing component 1202 may include a multimedia module to facilitate the interaction between the multimedia component 1208 and the processing component 1202.
  • the memory 1204 is configured to store various types of data to support the operation of the apparatus 1200. Examples of such data include instructions for any applications or methods operated on the apparatus 1200, contact data, phonebook data, information, pictures, video, etc.
  • the memory 1204 may be implemented using any type of volatile or non-volatile memory devices, or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic or optical disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable programmable read-only memory
  • PROM programmable read-only memory
  • ROM read-only memory
  • magnetic memory a magnetic memory
  • flash memory a flash memory
  • magnetic or optical disk a magnetic
  • the power component 1206 provides power to various components of the apparatus 1200.
  • the power component 1206 may include a power management system, one or more power sources, and any other components associated with the generation, management, and distribution of power in the apparatus 1200.
  • the multimedia component 1208 includes a screen providing an output interface between the apparatus 1200 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may not only sense a boundary of a touch or swipe action, but also sense a period of time and a pressure associated with the touch or swipe action.
  • the multimedia component 1208 includes a front camera and/or a rear camera. The front camera and the rear camera may receive an external multimedia datum while the apparatus 1200 is in an operation mode, such as a photographing mode or a video mode. Each of the front camera and the rear camera may be a fixed optical lens system or have focus and optical zoom capability.
  • the audio component 1210 is configured to output and/or input audio signals.
  • the audio component 1210 includes a microphone ("MIC") configured to receive an external audio signal when the apparatus 1200 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in the memory 1204 or transmitted via the communication component 1216.
  • the audio component 1210 further includes a speaker to output audio signals.
  • the I/O interface 1212 provides an interface between the processing component 1202 and peripheral interface modules, such as a keyboard, a click wheel, buttons, and the like.
  • the buttons may include, but are not limited to, a home button, a volume button, a starting button, and a locking button.
  • the sensor component 1214 includes one or more sensors to provide status assessments of various aspects of the apparatus 1200. For instance, the sensor component 1214 may detect an open/closed status of the apparatus 1200, relative positioning of components, e.g., the display and the keypad, of the apparatus 1200, a change in position of the apparatus 1200 or a component of the apparatus 1200, a presence or absence of user contact with the apparatus 1200, an orientation or an acceleration/deceleration of the apparatus 1200, and a change in temperature of the apparatus 1200.
  • the sensor component 1214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • the sensor component 1214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 1214 may also include an accelerometer sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 1216 is configured to facilitate communication, wired or wirelessly, between the apparatus 1200 and other devices.
  • the apparatus 1200 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof.
  • the communication component 1216 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 1216 further includes a near field communication (NFC) module to facilitate short-range communications.
  • the NFC module may be implemented based on a radio frequency identification (RFID) technology, an infrared data association (IrDA) technology, an ultra-wideband (UWB) technology, a Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • BT Bluetooth
  • the apparatus 1200 may be implemented with one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components, for performing the above described methods.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • controllers micro-controllers, microprocessors, or other electronic components, for performing the above described methods.
  • non-transitory computer-readable storage medium including instructions, such as included in the memory 1204, executable by the processor 1220 in the apparatus 1200, for performing the above-described methods.
  • the non-transitory computer-readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storage device, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Automation & Control Theory (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • General Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)
EP16165951.1A 2015-09-28 2016-04-19 Method and apparatus for controlling electronic device Ceased EP3147826A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510627896.0A CN105204742B (zh) 2015-09-28 2015-09-28 电子设备的控制方法、装置及终端

Publications (1)

Publication Number Publication Date
EP3147826A1 true EP3147826A1 (en) 2017-03-29

Family

ID=54952465

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16165951.1A Ceased EP3147826A1 (en) 2015-09-28 2016-04-19 Method and apparatus for controlling electronic device

Country Status (8)

Country Link
US (1) US20170091551A1 (ja)
EP (1) EP3147826A1 (ja)
JP (1) JP6315855B2 (ja)
KR (1) KR20180050188A (ja)
CN (1) CN105204742B (ja)
MX (1) MX2017011212A (ja)
RU (1) RU2669575C2 (ja)
WO (1) WO2017054356A1 (ja)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020005575A1 (en) * 2018-06-25 2020-01-02 Google Llc Identifying and controlling smart devices
CN110718217A (zh) * 2019-09-04 2020-01-21 上海博泰悦臻电子设备制造有限公司 一种控制方法、终端及计算机可读存储介质
EP3855261A1 (en) * 2020-01-27 2021-07-28 ABB Schweiz AG Determining control parameters for an industrial automation device
AT17724U1 (de) * 2021-06-10 2022-12-15 Ars Electronica Linz Gmbh & Co Kg System zur räumlich begrenzten Aktivierung einer Steuereinheit

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106101783A (zh) * 2016-05-24 2016-11-09 乐视控股（北京）有限公司 设备的控制方法和装置
CN105955041A (zh) * 2016-05-25 2016-09-21 北京行云时空科技有限公司 可穿戴设备与智能家居交互控制方法、系统及可穿戴设备
CN106054641A (zh) * 2016-06-29 2016-10-26 Tcl集团股份有限公司 一种开启智能家电控制界面的方法、装置和系统
US11156375B2 (en) * 2016-07-22 2021-10-26 Ademco Inc. Migration of settings from a non-connected building controller to another building controller
JP7030770B2 (ja) * 2016-07-27 2022-03-07 コーニンクレッカ フィリップス エヌ ヴェ 患者監視システム
CN106200433A (zh) * 2016-08-17 2016-12-07 北京小米移动软件有限公司 设备远程控制方法及装置、电子设备
CN106445298A (zh) * 2016-09-27 2017-02-22 三星电子（中国）研发中心 用于物联网设备的可视化操作方法和装置
CN106502154B (zh) * 2016-11-04 2019-10-01 三星电子（中国）研发中心 用于电器控制系统的电器控制方法、装置和终端
CN106778723B (zh) * 2016-11-28 2017-09-26 华中科技大学 一种复杂背景环境中的风力机叶片表面图像提取方法
WO2018120768A1 (zh) * 2016-12-30 2018-07-05 华为技术有限公司 一种遥控方法和终端
CN106730683A (zh) * 2016-12-30 2017-05-31 浙江大学 基于TensorFlow的自动捡乒乓球机器人
CN107426068A (zh) * 2017-07-31 2017-12-01 北京小米移动软件有限公司 设备控制方法及装置
CN109426165B (zh) * 2017-08-29 2020-05-26 珠海格力电器股份有限公司 一种智能家电的控制方法及设备
RU2673464C1 (ru) * 2017-10-06 2018-11-27 Дмитрий Владимирович Клепиков Способ распознавания и управления бытовой техникой мобильным телефоном и мобильный телефон для его реализации
CN107861768A (zh) * 2017-10-27 2018-03-30 上海斐讯数据通信技术有限公司 一种目标控制app的启动方法及系统
US10559194B2 (en) * 2018-02-23 2020-02-11 Samsung Electronics Co., Ltd. System and method for providing customized connected device functionality and for operating a connected device via an alternate object
CN110858814B (zh) * 2018-08-23 2020-12-15 珠海格力电器股份有限公司 一种智能家居设备的控制方法及装置
CN109218145B (zh) * 2018-08-24 2021-10-08 英华达（上海）科技有限公司 Iot设备控制界面的显示方法、系统、设备及存储介质
CN109334010B (zh) * 2018-10-10 2021-07-23 成都我有科技有限责任公司 3d打印机实现方法、装置及电子设备
KR20200089957A (ko) 2019-01-18 2020-07-28 삼성전자주식회사 전자 장치 및 이의 제어 방법
CN109917922A (zh) * 2019-03-28 2019-06-21 更藏多杰 一种交互方法及可穿戴交互设备
CN110336719B (zh) * 2019-06-03 2021-10-12 武汉工程大学 一种实时视频家居环境设备识别交互的远程智能家居控制方法
CN110471296B (zh) * 2019-07-19 2022-05-13 深圳绿米联创科技有限公司 设备控制方法、装置、系统、电子设备及存储介质
US11445107B2 (en) 2019-08-08 2022-09-13 Qorvo Us, Inc. Supervised setup for control device with imager
EP4309705A3 (en) * 2019-08-21 2024-05-01 Eli Lilly and Company Methods and apparatus for aspects of a dose detection system
CN110928466A (zh) * 2019-12-05 2020-03-27 北京小米移动软件有限公司 控制界面显示方法、装置、设备及存储介质
CN111599148A (zh) * 2020-03-06 2020-08-28 维沃移动通信有限公司 一种电子设备的连接方法及电子设备
CN111506228B (zh) * 2020-04-02 2022-05-17 维沃移动通信有限公司 目标设备的控制方法及电子设备
CN111638817A (zh) * 2020-04-27 2020-09-08 维沃移动通信有限公司 目标对象显示方法及电子设备
CN111597207A (zh) * 2020-05-22 2020-08-28 北京小米移动软件有限公司 智能设备的识别方法、处理方法、装置及存储介质
CN112187592A (zh) * 2020-09-23 2021-01-05 江西玉祥智能装备制造有限公司 一种电器的管理系统
CN114968387A (zh) * 2022-06-07 2022-08-30 三星电子（中国）研发中心 外接设备切换方法和装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6784918B1 (en) * 1998-12-22 2004-08-31 Intel Corporation System for obtaining state information from consumer electronic devices
EP1461791A1 (en) * 2001-12-28 2004-09-29 Koninklijke Philips Electronics N.V. Universal remote control unit with automatic appliance identification and programming
DE102006015045A1 (de) * 2006-03-31 2007-10-04 Siemens Ag Fernbedienung, Gebäudesteuerungssystem und Verfahren zur Gebäudesteuerung
US20120154108A1 (en) * 2010-12-16 2012-06-21 Optim Corporation Portable terminal, method, and program of changing user interface
US20130241697A1 (en) * 2012-03-14 2013-09-19 Digi International Inc. Spatially aware smart device provisioning
US20140269614A1 (en) * 2013-03-15 2014-09-18 Facebook, Inc. Portable Platform for Networked Computing
CN104678963A (zh) * 2015-02-03 2015-06-03 葛武 一种基于计算机视觉的采集仪表设备信息的系统及方法

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2127019C1 (ru) * 1997-08-01 1999-02-27 Рыжов Владимир Александрович Пульт дистанционного управления устройствами бытовой техники и компьютерными системами
US8818274B2 (en) * 2009-07-17 2014-08-26 Qualcomm Incorporated Automatic interfacing between a master device and object device
US20120068857A1 (en) * 2010-09-22 2012-03-22 Apple Inc. Configurable remote control
US8683086B2 (en) * 2010-11-17 2014-03-25 Flextronics Ap, Llc. Universal remote control with automated setup
WO2013024922A1 (ko) * 2011-08-17 2013-02-21 엘지전자 주식회사 전자기기 및 전자기기의 동작 방법
MX2014004073A (es) * 2011-10-10 2014-09-11 Yewon Comm Co Ltd Aparato y metodo para reconocer de manera automatica un codigo de respuesta rapira (qr).
CN103581251A (zh) * 2012-08-01 2014-02-12 鸿富锦精密工业（深圳）有限公司 遥控装置及其控制方法
JP2014064115A (ja) * 2012-09-20 2014-04-10 Sharp Corp 端末装置、遠隔操作システム及び遠隔操作方法
CN103873959B (zh) * 2012-12-13 2019-02-05 联想(北京)有限公司 一种控制方法和电子设备
CN103472971B (zh) * 2013-09-03 2017-10-17 小米科技有限责任公司 一种设置拍摄参数的方法、装置及终端设备
WO2016017945A1 (en) * 2014-07-29 2016-02-04 Samsung Electronics Co., Ltd. Mobile device and method of pairing the same with electronic device
US9824578B2 (en) * 2014-09-03 2017-11-21 Echostar Technologies International Corporation Home automation control using context sensitive menus
CN104699244B (zh) * 2015-02-26 2018-07-06 小米科技有限责任公司 智能设备的操控方法及装置
CN104915094A (zh) * 2015-05-18 2015-09-16 小米科技有限责任公司 终端控制方法、装置及终端
CN105160854B (zh) * 2015-09-16 2019-01-11 小米科技有限责任公司 设备控制方法、装置和终端设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6784918B1 (en) * 1998-12-22 2004-08-31 Intel Corporation System for obtaining state information from consumer electronic devices
EP1461791A1 (en) * 2001-12-28 2004-09-29 Koninklijke Philips Electronics N.V. Universal remote control unit with automatic appliance identification and programming
DE102006015045A1 (de) * 2006-03-31 2007-10-04 Siemens Ag Fernbedienung, Gebäudesteuerungssystem und Verfahren zur Gebäudesteuerung
US20120154108A1 (en) * 2010-12-16 2012-06-21 Optim Corporation Portable terminal, method, and program of changing user interface
US20130241697A1 (en) * 2012-03-14 2013-09-19 Digi International Inc. Spatially aware smart device provisioning
US20140269614A1 (en) * 2013-03-15 2014-09-18 Facebook, Inc. Portable Platform for Networked Computing
CN104678963A (zh) * 2015-02-03 2015-06-03 葛武 一种基于计算机视觉的采集仪表设备信息的系统及方法

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020005575A1 (en) * 2018-06-25 2020-01-02 Google Llc Identifying and controlling smart devices
US10725629B2 (en) 2018-06-25 2020-07-28 Google Llc Identifying and controlling smart devices
CN112219405A (zh) * 2018-06-25 2021-01-12 谷歌有限责任公司 识别和控制智能设备
US11086493B2 (en) 2018-06-25 2021-08-10 Google Llc Identifying and controlling smart devices
CN112219405B (zh) * 2018-06-25 2022-03-15 谷歌有限责任公司 识别和控制智能设备
US11921988B2 (en) 2018-06-25 2024-03-05 Google Llc Identifying and controlling smart devices
CN110718217A (zh) * 2019-09-04 2020-01-21 上海博泰悦臻电子设备制造有限公司 一种控制方法、终端及计算机可读存储介质
EP3855261A1 (en) * 2020-01-27 2021-07-28 ABB Schweiz AG Determining control parameters for an industrial automation device
US11520316B2 (en) 2020-01-27 2022-12-06 Abb Schweiz Ag Determining control parameters for an industrial automation device
AT17724U1 (de) * 2021-06-10 2022-12-15 Ars Electronica Linz Gmbh & Co Kg System zur räumlich begrenzten Aktivierung einer Steuereinheit

Also Published As

Publication number Publication date
CN105204742B (zh) 2019-07-09
RU2669575C2 (ru) 2018-10-12
RU2017102685A3 (ja) 2018-08-06
CN105204742A (zh) 2015-12-30
WO2017054356A1 (zh) 2017-04-06
MX2017011212A (es) 2018-02-09
JP6315855B2 (ja) 2018-04-25
JP2017535977A (ja) 2017-11-30
RU2017102685A (ru) 2018-08-06
US20170091551A1 (en) 2017-03-30
KR20180050188A (ko) 2018-05-14

Similar Documents

Publication Publication Date Title
EP3147826A1 (en) Method and apparatus for controlling electronic device
EP3136230B1 (en) Method and client terminal for remote assistance
EP3035738A1 (en) Method for connecting appliance to network and device for the same
EP3136793B1 (en) Method and apparatus for awakening electronic device
US9491371B2 (en) Method and device for configuring photographing parameters
EP3163411A1 (en) Method, device and apparatus for application switching
CN109284149B (zh) 启动应用程序的方法及装置
EP3244597A1 (en) Method and apparatus for controlling devices
EP3125093A1 (en) Method and device for application interaction
EP3099042A1 (en) Methods and devices for sending cloud card
EP3099063A1 (en) Video communication method and apparatus
EP3131235A1 (en) Method and apparatus for controlling device
EP3246886A1 (en) Alarm method and device, control device and sensing device
CN104506772A (zh) 拍摄参数调节方法和装置
EP3119040B1 (en) Method and device for controlling a smart device
CN104486451B (zh) 应用程序推荐方法及装置
CN105528151A (zh) 亮度调整方法及装置
CN104244045B (zh) 控制视频画面呈现的方法及装置
US10042328B2 (en) Alarm setting method and apparatus, and storage medium
EP3015965A1 (en) Method and apparatus for prompting device connection
US20150288764A1 (en) Method and apparatus for controlling smart terminal
EP3322227A1 (en) Methods and apparatuses for controlling wireless connection, computer program and recording medium
CN104243829A (zh) 自拍的方法及装置
CN104020628A (zh) 闪光灯的提醒方法及装置
EP3015949A1 (en) Method and device for displaying information

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20170929

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20180724

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20200130