WO2012149713A1 - Method and apparatus for human-machine interaction - Google Patents
Method and apparatus for human-machine interaction Download PDFInfo
- Publication number
- WO2012149713A1 WO2012149713A1 PCT/CN2011/078867 CN2011078867W WO2012149713A1 WO 2012149713 A1 WO2012149713 A1 WO 2012149713A1 CN 2011078867 W CN2011078867 W CN 2011078867W WO 2012149713 A1 WO2012149713 A1 WO 2012149713A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- human eye
- parameter
- display screen
- terminal display
- relative
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
Definitions
- the present invention relates to the field of electronic technologies, and in particular, to a method and apparatus for human-computer interaction. Background technique
- the invention provides a method and device for human-computer interaction, which can realize human-computer interaction in visual effect.
- the present invention adopts the following technical solutions:
- a method of human-computer interaction including:
- Obtaining at least one of a human eye characteristic parameter and a position parameter of the human eye relative to the terminal display screen is specifically: Obtaining a picture in front of the terminal display through the camera;
- At least one of a human eye feature parameter and a positional parameter of the human eye relative to the terminal display screen is obtained from the picture.
- Obtaining at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen from the picture is specifically:
- the human eye characteristic parameter obtained from the picture and the position parameter of the human eye relative to the terminal display screen are At least one of the mapped values results in a corresponding human eye characteristic parameter and/or a human visual parameter relative to the terminal display screen.
- the method for performing preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen includes: according to the human eye feature parameter at the current time and/or The positional parameter of the human eye relative to the display screen of the terminal directly adjusts the display image of the terminal display screen.
- the method for performing preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the display screen of the terminal includes: the human eye feature according to the current time and the previous time
- the parameters and/or changes in the positional parameters of the human eye relative to the display of the terminal are preset to the display image of the terminal display.
- the human eye characteristic parameter includes one or more of a human eye's size, or a shape characteristic parameter.
- a human-machine interaction device including a terminal display screen, further includes a parameter acquisition module and an adjustment module, wherein
- the parameter acquisition module is configured to acquire at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen;
- the adjusting module is configured to perform preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen.
- the camera is further configured to acquire a picture in front of the display screen of the terminal, and the parameter is configured to determine whether there is a human eye in the picture, and if so, obtain a human eye feature from the picture. At least one of a parameter and a positional parameter of the human eye relative to the terminal display.
- the parameter obtaining module is specifically configured to obtain, from the picture, a mapping value of at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen, and according to the preset human eye feature parameter and the human eye a mapping relationship between a position parameter of the terminal display screen and its mapping value, and a human eye corresponding to a mapping value of at least one of a human eye characteristic parameter obtained from the picture and a position parameter of the human eye relative to the terminal display screen Characteristic parameters and/or positional parameters of the human eye relative to the terminal display.
- the adjusting module is specifically configured to directly adjust the display image of the terminal display screen according to the human eye characteristic parameter at the current time and/or the position parameter of the human eye relative to the terminal display screen, or according to the current time and the previous time
- the change in the human eye characteristic parameter and/or the positional parameter of the human eye relative to the terminal display screen is preset to the display image of the terminal display screen.
- the method and device for human-computer interaction acquires at least one of a human eye characteristic parameter and a position parameter of a human eyesight for a terminal display screen, and displays according to the acquired human eye characteristic parameter and/or the human eye relative to the terminal
- the position parameter of the screen is preset to the display image of the terminal display screen, and the invention realizes the human-computer interaction in the visual effect by the technical solution, so that the screen of the terminal display screen is adjusted according to the change of the eye, thereby greatly Improve the experience of human-computer interaction.
- FIG. 1 is a flowchart of a human-computer interaction method according to an embodiment of the present invention
- FIG. 2 is a block diagram of a human-machine interaction device according to an embodiment of the present invention. detailed description
- the embodiment of the invention provides a method for human-computer interaction, including:
- the display image of the terminal display screen is presetly adjusted according to the acquired human eye characteristic parameter and/or the positional parameter of the human eye relative to the terminal display screen.
- FIG. 1 is a flowchart of a human-computer interaction method according to an embodiment of the present invention. As shown in FIG. 1, the method includes:
- the front camera starts to run, and the video in front of the mobile phone display screen is obtained through the front camera of the mobile phone.
- a mapping table is set in the database, and the mapping table lists a plurality of bits of the human eye in the picture.
- Set, size or shape information and correspondingly list the positional parameters of the human eye relative to the terminal display screen corresponding to the positional information of each human eye in the picture, and the size of each human eye in the picture or
- the human eye characteristic parameter corresponding to the shape information compares the position, size or shape information of the human eye in the picture with the list at the current time, and can obtain the human eye characteristic parameter at the current time and the human eye relative to the terminal display screen.
- Position parameter is set in the database, and the mapping table lists a plurality of bits of the human eye in the picture.
- the human eye characteristic parameter includes one or more of the characteristic parameters such as the size and shape of the human eye, and the positional parameters of the human eye relative to the display screen of the terminal include positional parameters such as the direction, angle, and distance of the human eye relative to the display screen of the terminal, It is represented by the coordinates of the human eye relative to the display screen.
- S16 Perform preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter at the current time and/or the position parameter of the human eye relative to the terminal display screen.
- the display image of the terminal display screen may be presetly adjusted according to the change of the human eye characteristic parameter at the current time and the previous time and/or the position parameter of the human eye relative to the terminal display screen.
- the preset adjustment includes various adjustment schemes, such as the change of the position of the human eye relative to the terminal display from left to right, from right to left, from top to bottom or from bottom to top compared with the previous moment.
- the display image of the terminal display can be adjusted to change according to the change of the human eye, and accordingly, changes from left to right, from right to left, from top to bottom, or from bottom to top occur, so that the adjusted image is always Pointing at the human eye.
- a small animal can be designed on the UI (User Interface) so that the animal displayed on the screen of the mobile phone always looks at the direction of the user's eyes, and allows the mobile phone to display when the user's eyes change sharply with respect to the coordinates of the mobile phone.
- the animal displayed above performs the corresponding limb movement, for example, the current time characteristic parameter changes compared with the previous moment, such as wide eyes or closed eyes, the animal displayed on the screen of the mobile phone can be adjusted to follow the human eye. Change and change, and close your eyes or close accordingly.
- the position of the human eye relative to the display of the terminal is rapidly approaching or rapidly changing, so that the animals displayed on the screen of the mobile phone can always be used.
- the direction of the eye of the household while letting the animal ⁇ ⁇ similar to the frightened or happy body movements.
- the human-machine interaction device includes a terminal display screen 21, and further includes a parameter acquisition module 22 and an adjustment module 23, wherein the parameter acquisition module 22 is configured to acquire at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen 21; the adjustment module 23 is configured to be based on the acquired human eye feature parameter and/or the human eye relative to the terminal display screen
- the positional parameter of 21 performs a preset adjustment on the display image of the terminal display 21.
- the human-machine interaction device further includes a camera 24, and the camera 24 is configured to acquire a picture in front of the display screen 21, and the parameter is obtained from the ear block 22 to determine whether there is a human eye in the picture, and if so, obtain the human eye from the picture.
- mapping value of the feature parameter and at least one of a position parameter of the human eye relative to the terminal display screen 21 and according to a preset mapping relationship between the human eye feature parameter and the position parameter of the human eye relative to the terminal display screen 21 and its mapping value,
- Corresponding human eye feature parameters and/or positions of the human eye relative to the terminal display screen 21 are obtained from mapping values of at least one of a human eye feature parameter obtained from a picture and a position parameter of the human eye relative to the terminal display screen 21. parameter.
- the adjusting module 23 is specifically configured to directly adjust the display image of the terminal display screen 21 according to the human eye characteristic parameter at the current time and/or the position parameter of the human eye relative to the terminal display screen 21, or according to the current time and the front.
- the display image of the terminal display screen 21 is presetly adjusted by a change in the human eye characteristic parameter at a time and/or a change in the positional parameter of the human eye relative to the terminal display screen 21.
- the 3D mobile phone is taken as an example, the video is acquired by the front camera of the mobile phone, the picture is obtained from the video, and at least one of the human eye characteristic parameter and the position parameter of the human eye relative to the terminal display screen is obtained from the image, and then according to The acquired human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen are presetly adjusted to the display image of the terminal display screen, so that the adjusted display image of the terminal display screen can be aligned with the person according to a preset manner. Eyes, or make corresponding changes, achieve human-computer interaction in visual effects, thus greatly improving the experience of human-computer interaction. It is to be understood that the specific embodiments of the invention are limited only by the description. It will be apparent to those skilled in the art that the present invention may be made without departing from the spirit and scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Disclosed are a method and an apparatus for human-machine interaction. The method comprises obtaining at least one of a human eye feature parameter and a position parameter of a human eye relative to a terminal display screen, and performing preset adjustment on a displayed image of the terminal display screen according to the human eye feature parameter and/or the position parameter of the human eye relative to the terminal display screen. The present invention, through the above technical solution, solves the technical problem of implementing human-machine interaction in the visual effect.
Description
一种人机交互的方法及装置 技术领域 Method and device for human-computer interaction
本发明涉及电子技术领域， 尤其涉及一种人机交互的方法及装置。 背景技术 The present invention relates to the field of electronic technologies, and in particular, to a method and apparatus for human-computer interaction. Background technique
随着电子技术的发展， 电子终端设备从黑白屏幕到彩色液晶屏幕， 再 到 3D屏幕， 用户对显示屏画面的追求越来越高， 人机交互的设计越来越受 到关注。 With the development of electronic technology, electronic terminal devices from black and white screens to color LCD screens, to 3D screens, users are increasingly seeking the display screens, and the design of human-computer interaction is getting more and more attention.
在现有的人机交互方案中， 比如触摸技术、 声控技术、 摄像头手势等, 虽然在一定程度上达到了可用性、 易用性、 情趣性、 安全性等效果， 但是 其采用的都是简单的功能替代技术， 即通过触摸方式、 声控方式、 摄像头 手势等方式替代以往的按键方式。 所以， 在人机交互领域， 技术人员都倾 向于功能替代方案的设计， 而在视效上未能实现人机交互。 发明内容 In the existing human-computer interaction schemes, such as touch technology, voice control technology, camera gestures, etc., although the effects of usability, ease of use, interest, security, etc. are achieved to some extent, they are all simple. The function replacement technology replaces the previous button mode by means of touch mode, voice control mode, camera gesture and the like. Therefore, in the field of human-computer interaction, technicians are inclined to design alternatives, and human-computer interaction cannot be achieved in visual effects. Summary of the invention
本发明提供一种人机交互的方法及装置， 能够在视效上实现人机交互。 为解决上述技术问题， 本发明采用以下技术方案： The invention provides a method and device for human-computer interaction, which can realize human-computer interaction in visual effect. In order to solve the above technical problems, the present invention adopts the following technical solutions:
一种人机交互的方法， 包括： A method of human-computer interaction, including:
获取人眼特征参数和人眼相对于终端显示屏的位置参数中的至少一 者； Obtaining at least one of a human eye characteristic parameter and a positional parameter of the human eye relative to the terminal display screen;
根据所述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数对 终端显示屏的显示图像进行预设调整。 Presetting the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen.
获取人眼特征参数和人眼相对于终端显示屏的位置参数中的至少一者 具体为：
通过摄像头获取终端显示屏前方的图片； Obtaining at least one of a human eye characteristic parameter and a position parameter of the human eye relative to the terminal display screen is specifically: Obtaining a picture in front of the terminal display through the camera;
判断所述图片中是否有人眼； Determining whether there is a human eye in the picture;
如果有， 则从所述图片中获取人眼特征参数和人眼相对于终端显示屏 的位置参数中的至少一者。 If so, at least one of a human eye feature parameter and a positional parameter of the human eye relative to the terminal display screen is obtained from the picture.
从所述图片中获取人眼特征参数和人眼相对于终端显示屏的位置参数 中的至少一者具体为： Obtaining at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen from the picture is specifically:
从所述图片中获取人眼特征参数和人眼相对于终端显示屏的位置参数 中至少一者的映射值； Obtaining, from the picture, a mapping value of at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen;
根据预设的人眼特征参数和人眼相对于终端显示屏的位置参数与其映 射值的映射关系， 由从所述图片中获取的人眼特征参数和人眼相对于终端 显示屏的位置参数中至少一者的映射值得到相对应的人眼特征参数和 /或人 目艮相对于终端显示屏的位置参数。 According to the preset human eye characteristic parameter and the mapping relationship between the position parameter of the human eye and the terminal display screen and the mapping value thereof, the human eye characteristic parameter obtained from the picture and the position parameter of the human eye relative to the terminal display screen are At least one of the mapped values results in a corresponding human eye characteristic parameter and/or a human visual parameter relative to the terminal display screen.
根据所述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数对 终端显示屏的显示图像进行预设调整的方法包括： 根据当前时刻的所述人 目艮特征参数和 /或所述人眼相对于终端显示屏的位置参数直接对终端显示屏 的显示图像进行预设调整。 The method for performing preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen includes: according to the human eye feature parameter at the current time and/or The positional parameter of the human eye relative to the display screen of the terminal directly adjusts the display image of the terminal display screen.
根据所述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数对 终端显示屏的显示图像进行预设调整的方法包括： 根据当前时刻与前一时 刻的所述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数的变化 对终端显示屏的显示图像进行预设调整。 The method for performing preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the display screen of the terminal includes: the human eye feature according to the current time and the previous time The parameters and/or changes in the positional parameters of the human eye relative to the display of the terminal are preset to the display image of the terminal display.
所述人眼特征参数包括人眼大'〗、或形状特征参数中的一种或多种。 一种人机交互装置， 包括终端显示屏， 还包括参数获取模块和调整模 块， 其中， The human eye characteristic parameter includes one or more of a human eye's size, or a shape characteristic parameter. A human-machine interaction device, including a terminal display screen, further includes a parameter acquisition module and an adjustment module, wherein
所述参数获取模块设置为获取人眼特征参数和人眼相对于终端显示屏 的位置参数中的至少一者；
所述调整模块设置为根据所述人眼特征参数和 /或所述人眼相对于终端 显示屏的位置参数对终端显示屏的显示图像进行预设调整。 The parameter acquisition module is configured to acquire at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen; The adjusting module is configured to perform preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen.
还包括摄像头， 所述摄像头设置为获取终端显示屏前方的图片， 所述 参数获耳 4莫块具体设置为判断所述图片中是否有人眼， 如果有， 则从所述 图片中获取人眼特征参数和人眼相对于终端显示屏的位置参数中的至少一 者。 The camera is further configured to acquire a picture in front of the display screen of the terminal, and the parameter is configured to determine whether there is a human eye in the picture, and if so, obtain a human eye feature from the picture. At least one of a parameter and a positional parameter of the human eye relative to the terminal display.
所述参数获取模块具体设置为从所述图片中获取人眼特征参数和人眼 相对于终端显示屏的位置参数中至少一者的映射值， 并根据预设的人眼特 征参数和人眼相对于终端显示屏的位置参数与其映射值的映射关系， 由从 所述图片中获取的人眼特征参数和人眼相对于终端显示屏的位置参数中至 少一者的映射值得到相对应的人眼特征参数和 /或人眼相对于终端显示屏的 位置参数。 The parameter obtaining module is specifically configured to obtain, from the picture, a mapping value of at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen, and according to the preset human eye feature parameter and the human eye a mapping relationship between a position parameter of the terminal display screen and its mapping value, and a human eye corresponding to a mapping value of at least one of a human eye characteristic parameter obtained from the picture and a position parameter of the human eye relative to the terminal display screen Characteristic parameters and/or positional parameters of the human eye relative to the terminal display.
所述调整模块具体设置为根据当前时刻的人眼特征参数和 /或人眼相对 于终端显示屏的位置参数直接对终端显示屏的显示图像进行预设调整， 或 者根据当前时刻与前一时刻的人眼特征参数和 /或人眼相对于终端显示屏的 位置参数的变化对终端显示屏的显示图像进行预设调整。 The adjusting module is specifically configured to directly adjust the display image of the terminal display screen according to the human eye characteristic parameter at the current time and/or the position parameter of the human eye relative to the terminal display screen, or according to the current time and the previous time The change in the human eye characteristic parameter and/or the positional parameter of the human eye relative to the terminal display screen is preset to the display image of the terminal display screen.
本发明提供的人机交互的方法及装置， 获取人眼特征参数和人目 目对 于终端显示屏的位置参数中的至少一者， 根据获取的人眼特征参数和 /或所 人眼相对于终端显示屏的位置参数对终端显示屏的显示图像进行预设调 整， 本发明通过该技术方案实现了在视效上的人机交互， 使终端显示屏的 画面根据眼睛的变化而调整， 从而极大的提升人机交互的体验度。 附图说明 The method and device for human-computer interaction provided by the present invention acquires at least one of a human eye characteristic parameter and a position parameter of a human eyesight for a terminal display screen, and displays according to the acquired human eye characteristic parameter and/or the human eye relative to the terminal The position parameter of the screen is preset to the display image of the terminal display screen, and the invention realizes the human-computer interaction in the visual effect by the technical solution, so that the screen of the terminal display screen is adjusted according to the change of the eye, thereby greatly Improve the experience of human-computer interaction. DRAWINGS
图 1为本发明实施例一种人机交互方法的流程图； 1 is a flowchart of a human-computer interaction method according to an embodiment of the present invention;
图 2为本发明实施例一种人机交互装置的模块图。
具体实施方式 2 is a block diagram of a human-machine interaction device according to an embodiment of the present invention. detailed description
下面通过具体实施方式结合附图对本发明作进一步详细说明。 The present invention will be further described in detail below with reference to the accompanying drawings.
本发明实施例提出一种人机交互的方法， 包括： The embodiment of the invention provides a method for human-computer interaction, including:
获取人眼特征参数和人眼相对于终端显示屏的位置参数中的至少一 者； Obtaining at least one of a human eye characteristic parameter and a positional parameter of the human eye relative to the terminal display screen;
根据获取的人眼特征参数和 /或人眼相对于终端显示屏的位置参数对终 端显示屏的显示图像进行预设调整。 The display image of the terminal display screen is presetly adjusted according to the acquired human eye characteristic parameter and/or the positional parameter of the human eye relative to the terminal display screen.
图 1为本发明实施例一种人机交互方法的流程图， 如图 1所示， 该方 法包括： FIG. 1 is a flowchart of a human-computer interaction method according to an embodiment of the present invention. As shown in FIG. 1, the method includes:
511、 用户在手机 3D界面开启动态跟踪人眼功能后， 前置摄像头开始 运行， 通过手机前置摄像头获取手机显示屏前方视频。 511. After the user starts the dynamic tracking human eye function on the 3D interface of the mobile phone, the front camera starts to run, and the video in front of the mobile phone display screen is obtained through the front camera of the mobile phone.
512、从视频中获取图片，将图片与数据库中预存的人眼图像进行比对， 判断图片中是否存在人眼， 如果否， 则回到 S11 , 继续进行视频采集； 如果 是， 则执行 S13。 512. Obtain a picture from the video, compare the picture with a pre-stored human eye image in the database, and determine whether there is a human eye in the picture. If not, return to S11 to continue the video collection; if yes, execute S13.
513、 获取人眼在图片中的位置、 大小或形状信息中的一种或多种， 位 置信息可以通过坐标体现， 比如人眼在图片中的坐标。 513. Obtain one or more of a position, a size, or a shape information of a human eye in a picture, and the position information may be represented by a coordinate, such as a coordinate of a human eye in the picture.
514、 将当前时刻与前一时刻获取的人眼在图片中的位置、 大小或形状 信息中的一种或多种进行比较， 判断比较结果是否一致， 如果是， 则回到 S11 , 如果否， 则执行 S15。 514. Compare the current time with one or more of the position, size, or shape information of the human eye acquired in the picture at the previous moment to determine whether the comparison result is consistent. If yes, return to S11, if no, Then execute S15.
515、 将当前时刻获取的人眼在图片中的位置、 大小或形状信息中的一 种或多种作为当前时刻人眼特征参数和 /或人眼相对于终端显示屏的位置参 数的映射值， 根据数据库中预设的人眼特征参数和 /或人眼相对于终端显示 屏的位置参数与其映射值的映射关系， 得到相对应的人眼特征参数和 /或人 眼相对于终端显示屏的位置参数。 515. Use one or more of the position, size, or shape information of the human eye acquired in the picture at the current time as a mapping value of the current time human eye feature parameter and/or a position parameter of the human eye relative to the terminal display screen. Corresponding human eye feature parameters and/or positions of the human eye relative to the terminal display screen are obtained according to a preset relationship between the human eye feature parameters in the database and/or a positional parameter of the human eye relative to the terminal display screen and its mapped value. parameter.
比如在数据库中设定一映射表， 映射表中列出多种人眼在图片中的位
置、 大小或形状信息， 并相应地列出与每一种人眼在图片中的位置信息相 对应的人眼相对于终端显示屏的位置参数， 与每一种人眼在图片中的大小 或形状信息相对应的人眼特征参数， 将当前时刻的人眼在图片中的位置、 大小或形状信息与列表一比对， 可得出当前时刻的人眼特征参数和人眼相 对于终端显示屏的位置参数。 人眼特征参数包括人眼大小、 形状等特征参 数中的一种或多种， 人眼相对于终端显示屏的位置参数包括人眼相对于终 端显示屏的方向、 角度、 距离等位置参数， 可以通过人眼相对于显示屏的 坐标来表示。 For example, a mapping table is set in the database, and the mapping table lists a plurality of bits of the human eye in the picture. Set, size or shape information, and correspondingly list the positional parameters of the human eye relative to the terminal display screen corresponding to the positional information of each human eye in the picture, and the size of each human eye in the picture or The human eye characteristic parameter corresponding to the shape information compares the position, size or shape information of the human eye in the picture with the list at the current time, and can obtain the human eye characteristic parameter at the current time and the human eye relative to the terminal display screen. Position parameter. The human eye characteristic parameter includes one or more of the characteristic parameters such as the size and shape of the human eye, and the positional parameters of the human eye relative to the display screen of the terminal include positional parameters such as the direction, angle, and distance of the human eye relative to the display screen of the terminal, It is represented by the coordinates of the human eye relative to the display screen.
S16、根据当前时刻的人眼特征参数和 /或人眼相对于终端显示屏的位置 参数直接对终端显示屏的显示图像进行预设调整。 S16中还可以是根据当前 时刻与前一时刻的人眼特征参数和 /或人眼相对于终端显示屏的位置参数的 变化对终端显示屏的显示图像进行预设调整。 S16: Perform preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter at the current time and/or the position parameter of the human eye relative to the terminal display screen. In S16, the display image of the terminal display screen may be presetly adjusted according to the change of the human eye characteristic parameter at the current time and the previous time and/or the position parameter of the human eye relative to the terminal display screen.
预设调整包括多种调整方案， 比如当前时刻与前一时刻相比， 人眼相 对于终端显示屏的位置发生从左到右、 从右到左、 从上到下或者从下到上 等变化， 则可以调整终端显示屏的显示图像跟随人眼的变化而变化， 相应 地发生从左到右、 从右到左、 从上到下或者从下到上等变化， 使得调整后 的图像总是对准人眼。 The preset adjustment includes various adjustment schemes, such as the change of the position of the human eye relative to the terminal display from left to right, from right to left, from top to bottom or from bottom to top compared with the previous moment. , the display image of the terminal display can be adjusted to change according to the change of the human eye, and accordingly, changes from left to right, from right to left, from top to bottom, or from bottom to top occur, so that the adjusted image is always Pointing at the human eye.
进一步， 还可以在 UI ( User Interface , 用户界面）上设计一只小动物， 让手机画面上显示的动物始终看着用户的眼睛方向， 并在用户的眼睛相对 手机坐标剧烈变化时， 让手机画面上显示的动物做出相应的肢体动作， 比 如当前时刻与前一时刻相比， 人眼特征参数发生变化， 如睁大眼睛或闭上 眼睛， 则可以调整手机画面上显示的动物跟随人眼的变化而变化， 相应地 睁大眼睛或闭上。 Further, a small animal can be designed on the UI (User Interface) so that the animal displayed on the screen of the mobile phone always looks at the direction of the user's eyes, and allows the mobile phone to display when the user's eyes change sharply with respect to the coordinates of the mobile phone. The animal displayed above performs the corresponding limb movement, for example, the current time characteristic parameter changes compared with the previous moment, such as wide eyes or closed eyes, the animal displayed on the screen of the mobile phone can be adjusted to follow the human eye. Change and change, and close your eyes or close accordingly.
还比如， 当前时刻与前一时刻相比， 人眼相对于终端显示屏的位置发 生急速靠近或急速远离等变化， 可以让手机画面上显示的动物始终看着用
户的眼睛方向， 同时让动物^ ^出类似惊吓或开心的肢体动作。 For example, compared with the previous moment, the position of the human eye relative to the display of the terminal is rapidly approaching or rapidly changing, so that the animals displayed on the screen of the mobile phone can always be used. The direction of the eye of the household, while letting the animal ^ ^ similar to the frightened or happy body movements.
图 2为本发明实施例一种人机交互装置的模块图， 如图 2所示， 该人 机交互装置包括终端显示屏 21 , 还包括参数获取模块 22和调整模块 23, 其中， 参数获取模块 22设置为获取人眼特征参数和人眼相对于终端显示屏 21的位置参数中的至少一者；调整模块 23设置为根据获取的人眼特征参数 和 /或所述人眼相对于终端显示屏 21的位置参数对终端显示屏 21的显示图 像进行预设调整。 2 is a block diagram of a human-machine interaction device according to an embodiment of the present invention. As shown in FIG. 2, the human-machine interaction device includes a terminal display screen 21, and further includes a parameter acquisition module 22 and an adjustment module 23, wherein the parameter acquisition module 22 is configured to acquire at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen 21; the adjustment module 23 is configured to be based on the acquired human eye feature parameter and/or the human eye relative to the terminal display screen The positional parameter of 21 performs a preset adjustment on the display image of the terminal display 21.
进一步， 该人机交互装置还包括摄像头 24,摄像头 24设置为获取显示 屏 21前方的图片， 参数获耳 4莫块 22具体设置为判断图片中是否有人眼， 如果有， 从图片中获取人眼特征参数和人眼相对于终端显示屏 21的位置参 数中至少一者的映射值， 并根据预设的人眼特征参数和人眼相对于终端显 示屏 21的位置参数与其映射值的映射关系， 由从图片中获取的人眼特征参 数和人眼相对于终端显示屏 21的位置参数中至少一者的映射值得到相对应 的人眼特征参数和 /或人眼相对于终端显示屏 21的位置参数。 Further, the human-machine interaction device further includes a camera 24, and the camera 24 is configured to acquire a picture in front of the display screen 21, and the parameter is obtained from the ear block 22 to determine whether there is a human eye in the picture, and if so, obtain the human eye from the picture. a mapping value of the feature parameter and at least one of a position parameter of the human eye relative to the terminal display screen 21, and according to a preset mapping relationship between the human eye feature parameter and the position parameter of the human eye relative to the terminal display screen 21 and its mapping value, Corresponding human eye feature parameters and/or positions of the human eye relative to the terminal display screen 21 are obtained from mapping values of at least one of a human eye feature parameter obtained from a picture and a position parameter of the human eye relative to the terminal display screen 21. parameter.
进一步，调整模块 23具体设置为根据当前时刻的人眼特征参数和 /或人 眼相对于终端显示屏 21的位置参数直接对终端显示屏 21的显示图像进行 预设调整， 或者根据当前时刻与前一时刻的人眼特征参数和 /或人眼相对于 终端显示屏 21的位置参数的变化对终端显示屏 21的显示图像进行预设调 整。 Further, the adjusting module 23 is specifically configured to directly adjust the display image of the terminal display screen 21 according to the human eye characteristic parameter at the current time and/or the position parameter of the human eye relative to the terminal display screen 21, or according to the current time and the front. The display image of the terminal display screen 21 is presetly adjusted by a change in the human eye characteristic parameter at a time and/or a change in the positional parameter of the human eye relative to the terminal display screen 21.
本实施例以 3D手机为例， 通过手机前置摄像头获取视频， 从视频中获 取图片， 从图片中获取人眼特征参数和人眼相对于终端显示屏的位置参数 中的至少一者， 再根据获取的人眼特征参数和 /或人眼相对于终端显示屏的 位置参数对终端显示屏的显示图像进行预设调整， 使得调整后的终端显示 屏的显示图像可以根据预设的方式对准人眼， 或做出相应的变化， 实现了 在视效上的人机交互， 从而极大的提升了人机交互的体验度。
能认定本发明的具体实施只局限于这些说明。 对于本发明所属技术领域的 普通技术人员来说， 在不脱离本发明构思的前提下， 还可以做出若干简单 推演或替换， 都应当视为属于本发明的保护范围。
In this embodiment, the 3D mobile phone is taken as an example, the video is acquired by the front camera of the mobile phone, the picture is obtained from the video, and at least one of the human eye characteristic parameter and the position parameter of the human eye relative to the terminal display screen is obtained from the image, and then according to The acquired human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen are presetly adjusted to the display image of the terminal display screen, so that the adjusted display image of the terminal display screen can be aligned with the person according to a preset manner. Eyes, or make corresponding changes, achieve human-computer interaction in visual effects, thus greatly improving the experience of human-computer interaction. It is to be understood that the specific embodiments of the invention are limited only by the description. It will be apparent to those skilled in the art that the present invention may be made without departing from the spirit and scope of the invention.
Claims
1、 一种人机交互的方法， 其中， 该方法包括： A method for human-computer interaction, wherein the method comprises:
获取人眼特征参数和人眼相对于终端显示屏的位置参数中的至少一 者； Obtaining at least one of a human eye characteristic parameter and a positional parameter of the human eye relative to the terminal display screen;
根据所述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数对 终端显示屏的显示图像进行预设调整。 Presetting the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen.
2、 如权利要求 1所述的方法， 其中， 所述获取人眼特征参数和人眼相 对于终端显示屏的位置参数中的至少一者具体为： 2. The method according to claim 1, wherein the acquiring at least one of a human eye characteristic parameter and a position parameter of the human eye relative to the terminal display screen is specifically:
通过摄像头获取终端显示屏前方的图片； Obtaining a picture in front of the terminal display through the camera;
判断所述图片中是否有人眼； Determining whether there is a human eye in the picture;
判定所述图片中有人眼， 则从所述图片中获取人眼特征参数和人眼相 对于终端显示屏的位置参数中的至少一者。 Determining a human eye in the picture, obtaining at least one of a human eye feature parameter and a positional parameter of the human eye relative to the terminal display screen from the picture.
3、 如权利要求 2所述的方法， 其中， 3. The method of claim 2, wherein
从所述图片中获取人眼特征参数人眼相对于终端显示屏的位置参数中 的至少一者具体为： Obtaining at least one of a human eye characteristic parameter from the picture and a position parameter of the human eye relative to the terminal display screen is specifically:
从所述图片中获取人眼特征参数和人眼相对于终端显示屏的位置参数 的映射值； Obtaining, from the picture, a mapping value of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen;
根据预设的人眼特征参数和人眼相对于终端显示屏的位置参数与其映 射值的映射关系， 由从所述图片中获取的人眼特征参数和人眼相对于终端 显示屏的位置参数中至少一者的映射值得到相对应的人眼特征参数和 /或人 目艮相对于终端显示屏的位置参数。 According to the preset human eye characteristic parameter and the mapping relationship between the position parameter of the human eye and the terminal display screen and the mapping value thereof, the human eye characteristic parameter obtained from the picture and the position parameter of the human eye relative to the terminal display screen are At least one of the mapped values results in a corresponding human eye characteristic parameter and/or a human visual parameter relative to the terminal display screen.
4、 如权利要求 1所述的方法， 其中， 4. The method of claim 1, wherein
根据所述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数对 终端显示屏的显示图像进行预设调整包括： 根据当前时刻的所述人眼特征 参数和 /或所述人眼相对于终端显示屏的位置参数直接对终端显示屏的显示 图像进行预设调整。 Performing preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen includes: according to the human eye feature parameter of the current time and/or the The position of the human eye relative to the display of the terminal directly displays the display of the terminal The image is preset for adjustment.
5、 如权利要求 1所述的方法， 其中， 5. The method of claim 1, wherein
根据所述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数对 终端显示屏的显示图像进行预设调整包括： 根据当前时刻与前一时刻的所 述人眼特征参数和 /或所述人眼相对于终端显示屏的位置参数的变化对终端 显示屏的显示图像进行预设调整。 Performing preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the display screen of the terminal includes: according to the human eye characteristic parameter of the current time and the previous time / or a change in the positional parameter of the human eye relative to the terminal display screen to preset the display image of the terminal display screen.
6、 如权利要求 1至 5任一项所述的方法， 其中， 6. The method according to any one of claims 1 to 5, wherein
所述人眼特征参数包括人眼大'〗、或形状特征参数中的一种或多种。 The human eye characteristic parameter includes one or more of a human eye's size, or a shape characteristic parameter.
7、 一种人机交互装置， 包括终端显示屏， 其中， 该装置还包括参数获 耳 4莫块和调整模块， 其中， 7. A human-machine interaction device, comprising a terminal display screen, wherein the device further comprises a parameter acquisition module and an adjustment module, wherein
所述参数获取模块设置为获取人眼特征参数和人眼相对于终端显示屏 的位置参数中的至少一者； The parameter acquisition module is configured to acquire at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen;
所述调整模块设置为根据所述人眼特征参数和 /或所述人眼相对于终端 显示屏的位置参数对终端显示屏的显示图像进行预设调整。 The adjustment module is configured to perform preset adjustment on the display image of the terminal display screen according to the human eye characteristic parameter and/or the position parameter of the human eye relative to the terminal display screen.
8、 如权利要求 7所述的装置， 其中， 8. The apparatus according to claim 7, wherein
该装置还包括摄像头， 所述摄像头设置为获取终端显示屏前方的图片， 所述参数获耳 4莫块具体设置为判断所述图片中是否有人眼， 如果有， 则从 所述图片中获取人眼特征参数和人眼相对于终端显示屏的位置参数中的至 少一者。 The device further includes a camera, the camera is configured to acquire a picture in front of the display screen of the terminal, and the parameter is configured to determine whether there is a human eye in the picture, and if so, obtain a person from the picture. At least one of an eye characteristic parameter and a positional parameter of the human eye relative to the terminal display.
9、 如权利要求 8所述的装置， 其中， 9. The apparatus according to claim 8, wherein
所述参数获取模块具体设置为从所述图片中获取人眼特征参数和人眼 相对于终端显示屏的位置参数中至少一者的映射值， 并根据预设的人眼特 征参数和人眼相对于终端显示屏的位置参数与其映射值的映射关系， 由从 所述图片中获取的人眼特征参数和人眼相对于终端显示屏的位置参数中至 少一者的映射值得到相对应的人眼特征参数和 /或人眼相对于终端显示屏的 位置参数。 The parameter obtaining module is specifically configured to obtain, from the picture, a mapping value of at least one of a human eye feature parameter and a position parameter of the human eye relative to the terminal display screen, and according to the preset human eye feature parameter and the human eye a mapping relationship between a position parameter of the terminal display screen and its mapping value, and a human eye corresponding to a mapping value of at least one of a human eye characteristic parameter obtained from the picture and a position parameter of the human eye relative to the terminal display screen Characteristic parameters and/or human eye relative to the terminal display Location parameter.
10、 如权利要求 7至 9任一项所述的装置， 其中， 10. The apparatus according to any one of claims 7 to 9, wherein
所述调整模块具体设置为根据当前时刻的人眼特征参数和 /或人眼相对 于终端显示屏的位置参数直接对终端显示屏的显示图像进行预设调整， 或 者根据当前时刻与前一时刻的人眼特征参数和 /或人眼相对于终端显示屏的 位置参数的变化对终端显示屏的显示图像进行预设调整。 The adjusting module is specifically configured to directly adjust the display image of the terminal display screen according to the human eye characteristic parameter at the current time and/or the position parameter of the human eye relative to the terminal display screen, or according to the current time and the previous time The change in the human eye characteristic parameter and/or the positional parameter of the human eye relative to the terminal display screen is preset to the display image of the terminal display screen.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101142862A CN102207822A (en) | 2011-05-04 | 2011-05-04 | Method and device for man-machine interaction |
| CN201110114286.2 | 2011-05-04 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2012149713A1 true WO2012149713A1 (en) | 2012-11-08 |
Family
ID=44696681
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2011/078867 WO2012149713A1 (en) | 2011-05-04 | 2011-08-24 | Method and apparatus for human-machine interaction |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102207822A (en) |
| WO (1) | WO2012149713A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024146A (en) * | 2012-11-20 | 2013-04-03 | 广东欧珀移动通信有限公司 | Method for controlling display screen and mobile intelligent terminal |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103377643B (en) * | 2012-04-26 | 2017-02-15 | 富泰华工业（深圳）有限公司 | System and method for adjusting fonts |
| CN102880289B (en) * | 2012-08-20 | 2016-03-30 | 广东步步高电子工业有限公司 | Detect control system and method that eyeball fixes point can realize video playback and time-out |
| CN102945077B (en) * | 2012-10-24 | 2015-12-16 | 广东欧珀移动通信有限公司 | A kind of picture inspection method, device and intelligent terminal |
| CN103941984A (en) * | 2013-01-18 | 2014-07-23 | 维沃移动通信有限公司 | Method and system for browser webpage interface intelligent sliding in mobile handheld equipment |
| CN104423546A (en) * | 2013-08-28 | 2015-03-18 | 联芯科技有限公司 | Direction sensing implementing method and terminal device |
| CN103713728B (en) * | 2014-01-14 | 2016-09-21 | 东南大学 | A kind of detection method of complication system man machine interface availability |
| CN106873853A (en) * | 2017-01-18 | 2017-06-20 | 上海木爷机器人技术有限公司 | Screen display method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751209A (en) * | 2008-11-28 | 2010-06-23 | 联想(北京)有限公司 | Method and computer for adjusting screen display element |
| CN101893934A (en) * | 2010-06-25 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for intelligently adjusting screen display |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101454742A (en) * | 2006-05-31 | 2009-06-10 | 皇家飞利浦电子股份有限公司 | Controlling a viewing parameter |
-
2011
- 2011-05-04 CN CN2011101142862A patent/CN102207822A/en active Pending
- 2011-08-24 WO PCT/CN2011/078867 patent/WO2012149713A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751209A (en) * | 2008-11-28 | 2010-06-23 | 联想(北京)有限公司 | Method and computer for adjusting screen display element |
| CN101893934A (en) * | 2010-06-25 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for intelligently adjusting screen display |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024146A (en) * | 2012-11-20 | 2013-04-03 | 广东欧珀移动通信有限公司 | Method for controlling display screen and mobile intelligent terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102207822A (en) | 2011-10-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2012149713A1 (en) | Method and apparatus for human-machine interaction | |
| US10627902B2 (en) | Devices, methods, and graphical user interfaces for a wearable electronic ring computing device | |
| US10013083B2 (en) | Utilizing real world objects for user input | |
| US9886086B2 (en) | Gesture-based reorientation and navigation of a virtual reality (VR) interface | |
| US11170580B2 (en) | Information processing device, information processing method, and recording medium | |
| KR102494698B1 (en) | Method and apparatus for changing focus of camera | |
| JP2021536059A (en) | User interface for simulated depth effects | |
| US10521648B2 (en) | Body information analysis apparatus and method of auxiliary comparison of eyebrow shapes thereof | |
| KR101038323B1 (en) | Picture frame processing apparatus used image recognition technicque | |
| CN105573485B (en) | A kind of display content adjustment method and terminal | |
| WO2012142869A1 (en) | Method and apparatus for automatically adjusting terminal interface display | |
| US20220262080A1 (en) | Interfaces for presenting avatars in three-dimensional environments | |
| WO2013067776A1 (en) | Method for controlling terminal display interface, and terminal | |
| WO2021036420A1 (en) | Video communication method, terminal and storage medium | |
| CN105677040A (en) | Terminal control method, device and wearable device | |
| US10444831B2 (en) | User-input apparatus, method and program for user-input | |
| WO2020080107A1 (en) | Information processing device, information processing method, and program | |
| US9392223B2 (en) | Method for controlling visual light source, terminal, and video conference system | |
| US20240028177A1 (en) | Devices, methods, and graphical user interfaces for interacting with media and three-dimensional environments | |
| CN111988522B (en) | Shooting control method and device, electronic equipment and storage medium | |
| US20230343049A1 (en) | Obstructed objects in a three-dimensional environment | |
| US20230316674A1 (en) | Devices, methods, and graphical user interfaces for modifying avatars in three-dimensional environments | |
| US10503278B2 (en) | Information processing apparatus and information processing method that controls position of displayed object corresponding to a pointing object based on positional relationship between a user and a display region | |
| JP2015052895A (en) | Information processor and method of processing information | |
| WO2019176218A1 (en) | Information processing device, information processing method, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11864849 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 11864849 Country of ref document: EP Kind code of ref document: A1 |