WO2016177312A1 - Interaction indication method based on display interface - Google Patents
Interaction indication method based on display interface Download PDFInfo
- Publication number
- WO2016177312A1 WO2016177312A1 PCT/CN2016/080929 CN2016080929W WO2016177312A1 WO 2016177312 A1 WO2016177312 A1 WO 2016177312A1 CN 2016080929 W CN2016080929 W CN 2016080929W WO 2016177312 A1 WO2016177312 A1 WO 2016177312A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- display interface
- icon
- image
- party
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Definitions
- the invention relates to a terminal communication method.
- the terminal has a display screen and a human body input device capable of making an operation mark on a display interface of the display screen, and the communication method enables each terminal to display a display interface on one of the terminals.
- the manufacturer sells one device to the user, and the user fails when using the device.
- the producer and the user use the mobile phone for remote communication, and the user uses the mobile phone to transmit the real-time captured device image or the already completed image or image to the production in real time through the video.
- the producer can only inform the user by voice how to operate at a certain position of the device, and the user should find the corresponding position on the device according to the producer's voice description. Communication is still difficult due to differences in the description and understanding of a device's location.
- the object of the present invention is to provide an interactive indication method based on a display interface capable of transmitting the indicated position of the display interface on the display screen to the other party in real time, so that the communication between the two parties becomes simple and accurate. .
- the display interface-based interactive indication method of the present invention comprises at least two terminals, each terminal comprising a processor, a display screen connected to the processor, and at least one input device capable of marking on the display interface;
- the terminals can communicate with each other; when any two terminals communicate, the display interface of one display can be transmitted to the other party in real time and displayed on the other display;
- the interactive indication method includes the following steps:
- the processor of the party processes the marked action information, and displays an indication icon on the display interface of the user; then, the indicator icon displayed by the party is displayed.
- the information and the icon location information of the indication icon are transmitted to the other party; the other party receives the indication icon information and the icon location After the information, the indication icon is displayed on the corresponding position of the display interface; the other party displays the indication icon on the interface and its position on the display interface, and the indication icon on the display interface of one side and the position on the display interface are the same.
- At least one of the communication parties further has a camera; when the communication party communicates with other parties, the display interface of the display screen is an image captured by the camera in real time or an image or image that has been captured.
- the indication icon is a line or a pattern corresponding to the marked motion track.
- the marking action is pressing
- the pointing icon is a circle or a square
- the marking action is a straight sliding
- the pointing icon is a straight line with an arrow, the pointing of the arrow is consistent with the sliding direction
- the marking action is a curved sliding
- the indicator icon is an arc with an arrow pointing in the direction of the sliding direction.
- Different indication icons can give the other party a clearer indication, and the indication icon with an arrow can clearly inform the other party of the direction of performing an action on an indication area of the display interface, such as a straight line with an arrow indicating movement in the direction of the arrow,
- the arc of the arrow can indicate a rotation in the direction of the arrow.
- the indication icon may be a line or a pattern corresponding to the motion trajectory.
- the display on one side can display information that distinguishes the parties with which it communicates.
- the information may be icons or other information representing different terminals, such that each of the terminals with which it communicates can be distinguished by the information.
- the indication icons have two or more icons, and each of the indication icons respectively corresponds to a marking action at a different place on the display interface or a different marking action at the same place.
- a plurality of indication icons are simultaneously displayed, and multiple indication areas of the display interface can be simultaneously explained and indicated.
- the icon position information is position information associated with a feature of a display image as a display interface, and when the display image moves on the display screen, the indication icon and the display image move together, indicating The position of the icon relative to the displayed image remains unchanged. Thus, when the position of the display image on the display screen moves, the indicator icon moves with the displayed image and does not need to be reset.
- the icon position information is position information associated with a feature of the display screen, and when the display image as the display interface moves on the display screen, the position of the indication icon relative to the display screen is maintained. constant. Thus, when the position of the display image moves on the display screen, the indication icon does not move.
- each terminal communicates through a wired network, a wireless network, a Bluetooth, a wired signal, a wireless signal, and the like.
- the input device is a touch type input device and/or a mouse, for example, a touch screen integrated with the display screen.
- the invention has the beneficial effects that for any two parties of the communication, since the marking action of one party on the display interface is converted into the indicator icon, the display screen of the other party can be displayed on the other display screen, and the display interfaces of both parties are the same and displayed.
- the indicator icons on the interface are also the same on the display interface. In this way, both parties can know exactly a certain position on the display interface indicated by the indication icon without deviation; and there is no need to use language to describe where the location is, and the communication is quick and convenient.
- 1 is a schematic diagram showing an initial image of the terminal 1 corresponding to the terminals 2, 3;
- FIG. 2 is a schematic diagram of an initial image displayed by the terminal 2;
- FIG. 3 is a schematic diagram of an initial image displayed by the terminal 3;
- Figure 5 is a schematic view of the circle 31 displayed by the terminal 3;
- FIG. 6 is a schematic view showing the terminal 1 displaying a circle 11, a square 12, and a square 15;
- FIG. 7 is a schematic view showing the curved shape 13 and the square 16 of the terminal 1;
- FIG. 8 is a schematic diagram showing the display of the curved shape 23 by the terminal 2;
- Figure 9 is a schematic diagram of the image on the terminal 3 after translation
- FIG. 10 is a schematic diagram of an image on the terminal 1 corresponding to the image on the translated terminal 3.
- the terminal 1 can perform wireless and wired communication with the terminals 2, 3, respectively.
- the image (display interface) displayed on the touch screen of the terminal 2 can be transmitted to the terminal 1 in real time and displayed on the touch screen of the terminal 1.
- the image (display interface) displayed on the touch screen of the terminal 3 can be transmitted to the terminal 1 in real time and displayed on the touch screen of the terminal 1.
- the image displayed on the touch screen of the terminals 2, 3 is displayed on the touch screen of the terminal 1 in a partition. See Figure 1.
- the address or name A of the terminal 2 is displayed on the image of the terminal 2 displayed on the touch screen of the terminal 1
- the address or name B of the terminal 3 is displayed on the image of the terminal 3 displayed on the touch screen of the terminal 1.
- the terminal 2 processor when pressed with an image displayed on the touch screen of the terminal 2 with a finger or a press pen, the terminal 2 processor processes the information of the touch action (for a mark action) and asks whether it is associated with the image feature or with the touch screen feature. Associated. If the selection is associated with the image feature, the processor of the terminal 2 analyzes some features of the image (such as the R, G, and B values of some specific points on the image), and displays the pressed points on the image of the terminal 2. A circle 21 is drawn and the icon position information of the circle 21 relative to the image (such as the position of the circle 21 relative to a particular point on the image) is recorded.
- some features of the image such as the R, G, and B values of some specific points on the image
- the terminal 2 processor when pressed again on an image displayed on the touch screen of the terminal 2 with a finger or a press pen, the terminal 2 processor processes the touch action information and queries whether it is associated with the image feature or with the touch screen feature. If the selection is associated with the touch screen feature, the processor of the terminal 2 analyzes some features of the touch screen (such as recording the R, G, and B values of some specific points on the touch screen), and displays the pressed points on the image of the terminal 2.
- the square 22 is exited and the icon position information of the square 22 relative to the touch screen (e.g., the position of the square 22 relative to a particular point on the touch screen) is recorded.
- the terminal 2 processor transmits the two icon information of the circle 21 and the square 22 and the icon position information of the circle 21 and the square 22 to the terminal 1.
- the terminal 1 displays the circle 11 and the square 12 at the corresponding position on the display image of the touch screen.
- the circle 11, the square 12 and its position on the image displayed on the touch screen of the terminal 1 are the same as the circle 11, the square 12 and the position on the image displayed on the touch screen of the terminal 2.
- the terminal 1 processor processes the touch action information and asks whether it is associated with the image feature or associated with the touch screen feature. . If the selection is associated with the image feature, the processor of the terminal 1 analyzes some features of the image (such as recording the R, G, and B values of some specific points on the image), and slides the arc on the image of the terminal 1. An arc 13 with an arrow is displayed (the direction of the arrow coincides with the sliding direction), and the icon position information of the arc 13 with respect to the image (such as the position of the arc 13 with respect to a specific point on the image) is recorded.
- some features of the image such as recording the R, G, and B values of some specific points on the image
- the processor of the terminal 1 analyzes some features of the image (such as recording the R, G, and B values of some specific points on the image), and slides the arc on the image of the terminal 1.
- An arc 13 with an arrow is displayed (the direction of the arrow coincides with the sliding direction), and the icon position information of the
- the terminal 1 processor transmits the arc 13 indicating icon information and the icon position information of the arc 13 to the terminal 2.
- the terminal 2 After receiving the information transmitted by the terminal 1, the terminal 2 displays the arc 23 at the corresponding position on the display image of the touch screen.
- the arc 13 displayed on the touch screen of the terminal 1 and its position on the image are the same as the arc 23 displayed on the touch screen of the terminal 2 and its position on the image.
- the terminal 3 processor processes the touch action information and queries whether it is associated with the image feature or with the touch screen feature. If the selection is associated with the image feature, the processor of the terminal 3 analyzes some features of the image (such as R, G, B values of some specific points on the image), and displays the pressed points on the image of the terminal 3. A circle 31 is drawn and the icon position information of the circle 31 relative to the image (such as the position of the circle 31 relative to a particular point on the image) is recorded.
- some features of the image such as R, G, B values of some specific points on the image
- the terminal 3 processor transmits the circle 31 indicating icon information and the icon position information of the circle 31 to the terminal 1.
- the terminal 1 displays a circle 15 at a corresponding position on the display image of the touch screen.
- the circle 15 displayed on the touch screen of the terminal 1 and its position on the image are the same as the circle 31 displayed on the touch screen of the terminal 3 and its position on the image.
- the terminal 1 processor processes the touch action information and queries whether it is associated with the image feature or the touch screen feature.
- the processor of the terminal 1 analyzes some features of the touch screen (such as R, G, B values of some specific points on the touch screen), and displays the pressed points on the image of the terminal 1 Square 16 and record the icon position information of the square 16 relative to the touch screen (e.g., the position of the square 16 relative to a particular point on the touch screen).
- the terminal 1 processor transmits the square 16 indication icon information and the icon position information of the square 16 to the terminal 3.
- the terminal 3 After receiving the information transmitted by the terminal 1, the terminal 3 displays the square 32 at the corresponding position on the display image of the touch screen.
- the square 32 displayed on the touch screen of the terminal 3 and its position on the image are the same as the square 16 displayed on the touch screen of the terminal 1 and its position on the image.
- the input device is a touch screen integrated with the display screen.
- each terminal is an ordinary display screen, it is also possible to equip each terminal with an additional mouse as an input device.
- the user of the remote terminal can accurately indicate the position to be described to the field terminal by the method described, thereby realizing efficient and accurate interactive communication.
- the invention is particularly suitable for real-time video communication.
- the intelligent terminal and the network on the display interface of two or more terminals, as long as the part to be described is clicked on the image (display interface), the indicated part is in another
- the interface of the terminal is displayed to realize the transmission of the interface indication content, achieve the purpose of efficient and accurate communication, and make the communication simple and accurate.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (9)
- 基于显示界面的互动指示方法,它包括至少两个终端,每个终端包括处理器、与处理器相连的显示屏和至少一个可在显示界面上做出标记的输入设备;各终端之间能够进行通讯;当任意两个终端通讯后,一方显示屏的显示界面能够实时传送到另一方,并在另一方的显示屏上显示出来;其特征是:所述互动指示方法包括下述步骤:An interactive indication method based on a display interface, comprising at least two terminals, each terminal comprising a processor, a display connected to the processor, and at least one input device capable of marking on the display interface; enabling between the terminals Communication; when any two terminals communicate, the display interface of one display can be transmitted to the other party in real time and displayed on the other display; the feature is that the interactive indication method includes the following steps:当一方在自己的显示屏的显示界面上使用输入设备对显示内容做标记时,该方的处理器对标记动作信息处理,在自己的显示界面显示出指示图标;然后,一方把显示的指示图标信息和该指示图标的图标位置信息传送给另一方;另一方接收指示图标信息和图标位置信息后,在自己的显示界面的相应位置上显示出指示图标;另一方显示界面上的指示图标及其在显示界面上位置,与一方显示界面上的指示图标及其在显示界面上位置相同。When one party uses the input device to mark the display content on the display interface of the display screen, the processor of the party processes the marked action information, and displays an indication icon on the display interface of the user; then, the indicator icon displayed by the party is displayed. The information and the icon position information of the indication icon are transmitted to the other party; after receiving the indication icon information and the icon position information, the other party displays the indication icon at the corresponding position of the display interface of the user; the other party displays the indication icon on the interface and The position on the display interface is the same as the indicator on the display interface of one side and its position on the display interface.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:至少通讯的一方还具有摄像头;作为通讯的一方和其它方通讯时,它们的显示屏的显示界面是摄像头实时拍摄的图像或已经拍摄完成的图像或影像。The display interface-based interactive indication method according to claim 1, wherein at least one of the communication parties further has a camera; and when the communication party communicates with other parties, the display interface of the display screen is an image captured by the camera in real time. Or an image or image that has been taken.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:指示图标是与标记动作轨迹相应的线条或图案。The display interface-based interactive indication method according to claim 1, wherein the indication icon is a line or a pattern corresponding to the marked motion trajectory.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:指示图标有两个或两个以上,各指示图标分别与在显示界面上的不同地方的标记动作或相同地方的不同标记动作相对应。The display interface-based interactive indication method according to claim 1, wherein the indication icons are two or more, and the indication icons are respectively marked with different markings at different places on the display interface or different marks of the same place. The action corresponds.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:所述图标位置信息是与作为显示界面的显示图像的特征相关联的位置信息,当显示图像在显示屏上移动时,指示图标和显示图像一起移动,指示图标相对于显示图像的位置保持不变。The display interface-based interactive indication method according to claim 1, wherein the icon position information is position information associated with a feature of a display image as a display interface, and when the display image moves on the display screen, The indicator icon moves with the display image, indicating that the position of the icon relative to the displayed image remains unchanged.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:所述图标位置信息是与显示屏的特征相关联的位置信息,当作为显示界面的显示图像在显示屏上移动时,指示图标相对于显示屏的位置保持不变。The display interface-based interactive indication method according to claim 1, wherein the icon position information is position information associated with a feature of the display screen, and when the display image as the display interface moves on the display screen, The position of the indicator icon relative to the display remains the same.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:各终端之间通过有线网络、无线网络、蓝牙、有线信号、无线信号进行通讯。The interactive display method based on the display interface according to claim 1, wherein each terminal communicates through a wired network, a wireless network, a Bluetooth, a wired signal, or a wireless signal.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:输入设备为触控类输入设备和/或鼠标。The display interface-based interactive indication method according to claim 1, wherein the input device is a touch type input device and/or a mouse.
- 如权利要求1所述的基于显示界面的互动指示方法,其特征是:当一方与多方同时通讯时,一方的显示屏上能够显示出区分与其通讯的各方的信息。 The interactive display method based on a display interface according to claim 1, wherein when one party communicates with a plurality of parties simultaneously, information on the parties that communicate with them can be displayed on one of the display screens.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510225946.2A CN104898921A (en) | 2015-05-06 | 2015-05-06 | Display interface based interaction indicating method |
CN201510225946.2 | 2015-05-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016177312A1 true WO2016177312A1 (en) | 2016-11-10 |
Family
ID=54031608
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/080929 WO2016177312A1 (en) | 2015-05-06 | 2016-05-03 | Interaction indication method based on display interface |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN104898921A (en) |
WO (1) | WO2016177312A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104898921A (en) * | 2015-05-06 | 2015-09-09 | 林中尉 | Display interface based interaction indicating method |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1542669A (en) * | 2003-04-28 | 2004-11-03 | 商之器科技股份有限公司 | Online medical conference system capable of real time medical image transmission |
CN102436351A (en) * | 2011-12-22 | 2012-05-02 | 优视科技有限公司 | Method and device for controlling application interface through dragging gesture |
CN202650290U (en) * | 2012-05-28 | 2013-01-02 | 上海易酷信息技术服务有限公司 | Remote answering guidance system based on intelligent mobile phones |
CN103024588A (en) * | 2012-11-15 | 2013-04-03 | 长春指南针科技有限公司 | Multi-screen interactive system and method |
US20140366057A1 (en) * | 2013-06-06 | 2014-12-11 | Activevideo Networks, Inc. | Overlay Rendering of User Interface Onto Source Video |
CN104898921A (en) * | 2015-05-06 | 2015-09-09 | 林中尉 | Display interface based interaction indicating method |
-
2015
- 2015-05-06 CN CN201510225946.2A patent/CN104898921A/en active Pending
-
2016
- 2016-05-03 WO PCT/CN2016/080929 patent/WO2016177312A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1542669A (en) * | 2003-04-28 | 2004-11-03 | 商之器科技股份有限公司 | Online medical conference system capable of real time medical image transmission |
CN102436351A (en) * | 2011-12-22 | 2012-05-02 | 优视科技有限公司 | Method and device for controlling application interface through dragging gesture |
CN202650290U (en) * | 2012-05-28 | 2013-01-02 | 上海易酷信息技术服务有限公司 | Remote answering guidance system based on intelligent mobile phones |
CN103024588A (en) * | 2012-11-15 | 2013-04-03 | 长春指南针科技有限公司 | Multi-screen interactive system and method |
US20140366057A1 (en) * | 2013-06-06 | 2014-12-11 | Activevideo Networks, Inc. | Overlay Rendering of User Interface Onto Source Video |
CN104898921A (en) * | 2015-05-06 | 2015-09-09 | 林中尉 | Display interface based interaction indicating method |
Also Published As
Publication number | Publication date |
---|---|
CN104898921A (en) | 2015-09-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10948950B2 (en) | Information processing device, table, display control method, program, portable terminal, and information processing system | |
JP6353982B2 (en) | Touch interaction processing method, apparatus and system | |
US9256986B2 (en) | Automated guidance when taking a photograph, using virtual objects overlaid on an image | |
CN106233229B (en) | Remote operation device and method using camera-centered virtual touch | |
WO2015024252A1 (en) | Remote controller, information processing method and system | |
CN106896920B (en) | Virtual reality system, virtual reality equipment, virtual reality control device and method | |
WO2007098697A1 (en) | Remote control, imaging device, method and system for the same | |
CN102750044A (en) | Virtual keyboard device and realizing method thereof | |
WO2015180588A1 (en) | Gesture remote control apparatus, gesture receiving apparatus, wireless remote control system and method for operating terminal device | |
CN104620201A (en) | Apparatus for obtaining virtual 3d object information without requiring pointer | |
JP2021534478A (en) | Separate head-mounted display system and interaction method | |
CN109407863A (en) | A kind of written handwriting display methods, device, apparatus for writing and touch apparatus | |
TW201430627A (en) | System and method for identifying operation of stylus | |
WO2016177312A1 (en) | Interaction indication method based on display interface | |
TW201325101A (en) | Distant multipoint remote control device and system | |
TWI505135B (en) | Control system for display screen, control apparatus and control method | |
TWI486815B (en) | Display device, system and method for controlling the display device | |
JP6244069B1 (en) | Remote work support system, remote work support method, and program | |
WO2018010389A1 (en) | Color adjustment method, system and apparatus for displayed content | |
WO2016067745A1 (en) | Electronic instrument and feedback provision method | |
WO2020087642A1 (en) | Method for virtual interaction, physical robot, display terminal and system | |
TWI814208B (en) | Virtual image display device and object selection method for virtual image thereof | |
CN109669557A (en) | Laser mouse, remote control system and mouse pointer positioning method | |
CN109669539A (en) | A kind of wearable field operation man-machine interaction method of electric power, apparatus and system | |
US20190096130A1 (en) | Virtual mobile terminal implementing system in mixed reality and control method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16789306 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16789306 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 200418) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16789306 Country of ref document: EP Kind code of ref document: A1 |