EP3007146A1 - Système pour commander un dispositif électronique et unité de tête pour un tel système - Google Patents

Système pour commander un dispositif électronique et unité de tête pour un tel système Download PDF

Info

Publication number
EP3007146A1
EP3007146A1 EP14306571.2A EP14306571A EP3007146A1 EP 3007146 A1 EP3007146 A1 EP 3007146A1 EP 14306571 A EP14306571 A EP 14306571A EP 3007146 A1 EP3007146 A1 EP 3007146A1
Authority
EP
European Patent Office
Prior art keywords
electronic device
video processing
user interface
processing unit
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP14306571.2A
Other languages
German (de)
English (en)
Inventor
Didier Doyen
Sylvain Thiebaud
Stéphane Szymanski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Priority to EP14306571.2A priority Critical patent/EP3007146A1/fr
Publication of EP3007146A1 publication Critical patent/EP3007146A1/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/20—Binding and programming of remote control devices

Definitions

  • the present invention relates generally to the field of the user interaction with devices connected together. More specifically, the present invention concerns a system for controlling an electronic device through a user interface displayed on a display device of a head mounted unit. It also concerns a head mounted unit for such a system.
  • the present invention aims at improving the communication with any electronic devices present in the home. It is still a problem for people in their living room to be able to find the right remote control to communicate with a given electronic device. This problem becomes a nightmare when the number of electronic devices is high and when each of them is equipped with its own remote control. So there is a clear need of a universal remote control.
  • a remote control should be able to address any electronic device whatever the type of command to be applied. This is generally not feasible to have a simplified set of buttons so as to address every kind of electronic devices for any command.
  • Some universal remote control units exist. They are able to address different electronic devices thanks to a pre-setting of each command to a given button of the remote control unit. So the electronic devices controlled by the remote control unit belong to a predefined list. The addition of a device to this list requires pre-setting other buttons of the remote control. As buttons should be associated with a command in a comprehensive way, their number can be huge.
  • any electronic device having a display e.g. a TV
  • any electronic devices directly connected to a display e.g. a set-top-box
  • the remote control unit associated with the electronic device can be simpler.
  • a purpose of the present invention is to propose a remote control for any electronic devices connected to at least a local network.
  • the see-through glasses display the user interface associated with the electronic device to be controlled.
  • the selection of a command in the user interface can be performed by moving the head in such a way that the command to be performed is aligned with the device to be controlled.
  • Such a system is for example disclosed in the patent application US 2003/0020707 .
  • This system does not require any dedicated remote control unit but the action of alignment to be made for selecting a command is not so easy to be executed, especially if there are lots of electronic devices in the field of view of the user. So the selection of commands by head moving is not easy, especially if the user interface comprises a lot of buttons.
  • a purpose of the present invention is to propose a system able to reliably select a command of a user interface displayed through a head mounted display.
  • the present invention concerns a system for controlling an electronic device through a user interface associated with said electronic device, said user interface comprising a plurality of commands.
  • the system comprises a head mounted unit comprising a display device for displaying said dedicated user interface and a camera for capturing an image of the electronic device to be controlled, a video processing unit, and a remote control unit.
  • the head mounted unit, the video processing unit, the remote control unit and the electronic device are configured to communicate with each other.
  • the video processing unit is configured to identify the electronic device to be controlled in the image captured by the camera, to transmit the user interface associated with the identified electronic device to the display device, and to transmit to the electronic device a command instruction associated with the command selected by the remote control unit in said user interface displayed by the display device.
  • he head mounted unit, the video processing unit, the remote control unit and the electronic device are configured to communicate via a communication framework.
  • the communication framework designates a framework by which devices connected to this framework can exchange data.
  • the data are exchanged on one or more communication networks. These communication networks may be wireless or not. And the data are exchanged according to one or more communication protocols.
  • the communication framework is for example a home communication framework like QeO framework developed by Technicolor.
  • the invention exploits the connection of electronic devices of any type to a communication framework to allow exchanges between a remote control combined with a display for controlling a connected electronic device.
  • the remote control unit is any electronic device connected to the communication framework having means to navigate in the menus of the user interface.
  • the remote control unit is a hand-held device. It can be a smartphone or any hand held electronic device like a portable media player.
  • the head mounted device comprises see-through glasses, said see-through glasses being equipped with said camera.
  • the video processing unit is carried by the head mounted unit and is connected directly to the display device and/or the camera.
  • the video processing unit is included in the remote control unit.
  • the video processing unit is configured to identify, in the image captured by the camera, the electronic device to be controlled by detecting, in said image, a visual code associated with said electronic device.
  • the visual code is a barcode or a QR code.
  • the video processing unit is configured to identify, in the image captured by the camera, the electronic device to be controlled by detecting, in said image, the picture of the front end of said electronic device.
  • the invention concerns also a head mounted unit comprising a display device for displaying a user interface, a camera for capturing an image of the electronic device to be controlled, and a video processing unit configured to identify the electronic device to be controlled in the image captured by the camera, to transmit the user interface associated with the identified electronic device to the display device, to receive a command from a remote control, and to transmit a command instruction associated with the selected command to the electronic device.
  • the video processing unit receives the command from the remote control via a communication framework and transmits the command instruction associated with the selected command to the electronic device via said communication framework.
  • the video processing unit is configured to identify, in the image captured by the camera, the electronic device to be controlled by detecting, in said image, a visual code associated with said electronic device.
  • the visual code is a barcode or a QR code.
  • the video processing unit is configured to identify, in the image captured by the camera, the electronic device to be controlled by detecting, in said image, the front end of said electronic device.
  • the system according to the invention comprises a see through glasses 10 having a display for displaying user interface of electronic devices 20 to be controlled, a camera 11 for capturing an image of the electronic devices 20 to be controlled, a video processing unit 12, and a remote control unit 13.
  • the see-through glasses 10 are worn by a user. All these components are connected together and are able to communicate with each other.
  • the communication framework 14 is preferably a local framework like a home communication framework.
  • the components of the system are all connected to a local network, for example a wireless network (WiFi), and communicate together via a communication protocol like QeO framework developed by Technicolor.
  • WiFi wireless network
  • QeO framework developed by Technicolor.
  • the communication framework 14 can also be used through a global network like internet.
  • the remote control unit 13 is an electronic device connected to the network and using the communication framework and having means to navigate in the menus of a user interface. It can be a smartphone or any hand held electronic device like a portable media player. This device may comprise keys (tactile or not), like arrow keys and enter key, for navigating in menus of user interfaces.
  • the video processing unit 12 may be a separate unit as illustrated by Figure 1 , may be integrated to the see-through glasses 10 or may be the processing means of a set top box.
  • the video processing unit may also be processing means of the remote control unit, for example processing means of a smart phone.
  • the video processing unit 12 is integrated to the see-through glasses 10, it is directly connected to the camera 11 and the display of the see-through glasses without using the communication framework 14.
  • the video processing unit 12 is configured to identify the electronic device 20 to be controlled in the image captured by the camera 11 and to transmit to the display device the user interface associated with the identified electronic device via the communication framework 14.
  • This user interface is displayed by the see-through glasses 10 and the remote control unit 13 is used to select commands in this user interface.
  • Figure 3 shows the successive steps implemented by the system of Figure 1 and 2 .
  • a step S1 the camera 11 captures an image of the device 20 to be controlled.
  • the camera is directed towards the device 20 by the user by looking at the device.
  • An image of the front end of the device is captured by the camera 11 as shown in Figure 4 .
  • the captured image is sent to the video processing unit 12 via the communication framework 14.
  • the image is processed by the video processing unit 12 to detect the device 20 to be controlled and to identify it.
  • the device 20 is detected and identified by detecting a visual code present in its front end, for example a QR code 21, or by comparing a picture of its front end to pre-stored front ends pictures.
  • a user interface associated with the identified device 20 is selected.
  • a step S4 the video processing unit 14 sends the user interface software associated with the identified device 20 to the display 10 of the see through glasses.
  • step S5 the display device 10 of the see through glasses displays the received user interface software and displays the user interface on its screen.
  • a step S6 the user selects by the remote control unit 13 a command in the displayed user interface for controlling the electronic device 20. This selection is displayed on the see-through glasses. It can correspond to different menus that are reached using the remote control unit. So the video processing unit 12 receives a command representative of the command selected by the user in the user interface.
  • step S7 the video processing unit 12 transmits a command instruction associated with the command selected by the user to the electronic device 20.
  • the video processing unit 12 displays a menu for proposing to the user to select the electronic device to be controlled. This menu is displayed by the display device 10 and the selection of the device to be controlled is made by the remote control unit 13.
  • the video processing unit 12 sends through the communication framework 14 a message to the selected electronic device 20 asking it to show that it has been selected by lighting a LED of the front end of the electronic device 20.
  • any electronic device 20 connected to the communication framework 14 and identifiable by a specific visual code or by identifying the front end picture can be controlled by the system. It is then easy to drive these electronic devices with a simple universal remote control 13 that can be a dedicated device or even a smartphone.
  • the great advantage is to simplify the way you drive your electronic devices at home, avoiding spending time to find the right remote control in your living room.
  • the way to control the electronic device 20 is then as simple as with any electronic device having a display.
  • the previously mentioned processing means and/or means to navigate can be implemented in hardware in a programmable FPGA ("Field Programmable Gate Array ”) component or ASIC ( "Application-Specific Integrated Circuit” ) component.
  • a device such as a head mounted unit or the video processing unit or a remote control unit, comprises a computing unit (for example a CPU, for " Central Processing Unit” ) , and one or several memory units (for example a RAM (for " Random Access Memory ”) block in which intermediate results can be stored temporarily during the execution of instructions a computer program, or a ROM block in which, among other things, computer programs are stored, or an EEPROM (" Electrically-Erasable Programmable Read-Only Memory ”) block, or a flash block).
  • Computer programs are made of instructions that can be executed by the computing unit.
  • Such device can also comprise a dedicated unit constituting an input-output interface to allow the device to communicate with other devices.
  • this dedicated unit can be connected with an antenna (in order to perform communication without contacts), or with serial ports (to carry communications via physical contacts). These units can exchange data through buses for example together.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)
EP14306571.2A 2014-10-07 2014-10-07 Système pour commander un dispositif électronique et unité de tête pour un tel système Withdrawn EP3007146A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP14306571.2A EP3007146A1 (fr) 2014-10-07 2014-10-07 Système pour commander un dispositif électronique et unité de tête pour un tel système

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14306571.2A EP3007146A1 (fr) 2014-10-07 2014-10-07 Système pour commander un dispositif électronique et unité de tête pour un tel système

Publications (1)

Publication Number Publication Date
EP3007146A1 true EP3007146A1 (fr) 2016-04-13

Family

ID=51868921

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14306571.2A Withdrawn EP3007146A1 (fr) 2014-10-07 2014-10-07 Système pour commander un dispositif électronique et unité de tête pour un tel système

Country Status (1)

Country Link
EP (1) EP3007146A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016207009A1 (de) * 2016-04-26 2017-10-26 Krones Aktiengesellschaft Bediensystem für eine Maschine der Lebensmittelindustrie, insbesondere der Getränkemittelindustrie
DE102017219067A1 (de) * 2017-10-25 2019-04-25 Bayerische Motoren Werke Aktiengesellschaft Vorrichtung und verfahren zur visuellen unterstützung eines benutzers in einem arbeitsumfeld

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030020707A1 (en) 2001-06-27 2003-01-30 Kangas Kari J. User interface
US20110234386A1 (en) 2010-03-29 2011-09-29 Kouichi Matsuda Information processor, information processing method and program
US20130257690A1 (en) * 2012-03-27 2013-10-03 Seiko Epson Corporation Head-mounted display device
US20140118631A1 (en) * 2012-10-29 2014-05-01 Lg Electronics Inc. Head mounted display and method of outputting audio signal using the same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030020707A1 (en) 2001-06-27 2003-01-30 Kangas Kari J. User interface
US20110234386A1 (en) 2010-03-29 2011-09-29 Kouichi Matsuda Information processor, information processing method and program
US20130257690A1 (en) * 2012-03-27 2013-10-03 Seiko Epson Corporation Head-mounted display device
US20140118631A1 (en) * 2012-10-29 2014-05-01 Lg Electronics Inc. Head mounted display and method of outputting audio signal using the same

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016207009A1 (de) * 2016-04-26 2017-10-26 Krones Aktiengesellschaft Bediensystem für eine Maschine der Lebensmittelindustrie, insbesondere der Getränkemittelindustrie
DE102017219067A1 (de) * 2017-10-25 2019-04-25 Bayerische Motoren Werke Aktiengesellschaft Vorrichtung und verfahren zur visuellen unterstützung eines benutzers in einem arbeitsumfeld

Similar Documents

Publication Publication Date Title
US20200177792A1 (en) Mobile device and control method
JP6205067B2 (ja) パン・チルト操作装置、カメラシステム、パン・チルト操作用プログラム及びパン・チルト操作方法
JP6205072B2 (ja) 撮像制御装置、撮像制御方法、カメラ、カメラシステム及びプログラム
US10474414B2 (en) Image display system, information processing apparatus, and image display method
CN111897507B (zh) 投屏方法、装置、第二终端和存储介质
US20150070247A1 (en) Information processing apparatus, information processing method, and program
JP6558527B2 (ja) 電子機器、電子機器の制御方法、プログラム及び無線通信システム
CN102685197A (zh) 基于nfc来控制装置的方法和使用该方法的装置控制系统
JP2007274567A (ja) 情報機器システム及び情報機器システムに用いる電子カメラ
US11467711B2 (en) Systems and methods for displaying and associating context images with zones of a security system
CN109068161A (zh) 一种设备连接建立方法和装置
CN108040273B (zh) 控制机顶盒游戏的方法、远端控制系统及手持电子装置
US20150160826A1 (en) Electronic Device
KR102174858B1 (ko) 네트워크에서 데이터를 렌더링하는 방법 및 연관된 모바일 디바이스
US20160048311A1 (en) Augmented reality context sensitive control system
EP3007146A1 (fr) Système pour commander un dispositif électronique et unité de tête pour un tel système
US9652128B2 (en) Method and apparatus for controlling electronic device
US10779148B2 (en) Data transmission method and first electronic device
KR20150081643A (ko) 디스플레이 장치, 모바일 장치, 이를 포함하는 시스템 및 그 접속 제어방법
CN105187878A (zh) 电视蓝牙连接方法及装置
JP2012119935A (ja) 情報機器、操作対象機器、操作方法
JP6460322B2 (ja) 制御端末装置
WO2016092823A1 (fr) Terminal d'affichage d'image, système d'affichage d'image, programme d'affichage d'image et procédé d'affichage d'image
US9548894B2 (en) Proximity based cross-screen experience App framework for use between an industrial automation console server and smart mobile devices
US20150237225A1 (en) Image processing system and image processing apparatus

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20161014