WO2016177312A1

WO2016177312A1 - Interaction indication method based on display interface

Info

Publication number: WO2016177312A1
Application number: PCT/CN2016/080929
Authority: WO
Inventors: 林中尉
Original assignee: 林中尉
Priority date: 2015-05-06
Filing date: 2016-05-03
Publication date: 2016-11-10
Also published as: CN104898921A

Abstract

Disclosed is an interaction indication method based on a display interface, which can transmit a position indicated by one party of mutual communication on a display interface on a display screen to the other party, so that the communication between both parties regarding a certain position becomes simple and accurate. Various terminals for mutual communication comprises a processor, a display screen and an input device capable of making a mark on a display interface. When one party uses the input device to mark a displayed content on the display interface thereof, the party processes marking action information and displays an indicative icon. At the same time, indicative icon information and icon position information about the indicative icon are transmitted to the other party, and after the other party receives same, the indicative icon is displayed at a corresponding position on the display interface thereof. The display interface, the indicative icon on the display interface and the position of the indicative icon on the display interface of the other party are the same as those of one party.

Description

Interactive indication method based on display interface

Technical field

The invention relates to a terminal communication method. The terminal has a display screen and a human body input device capable of making an operation mark on a display interface of the display screen, and the communication method enables each terminal to display a display interface on one of the terminals.

Background technique

Today, communication between people can be carried out by means of voice transmission and image transmission. The communication of the sights seen is mainly transmitted to the information receiver through language description and image. The discussion and exchange of information can only be explained by language description. For example, a user of a terminal takes a photo and sends it to another An end user, when a user who receives a photo wants to comment on the photo, the language description can only tell how the location on the photo is, and the acceptor needs to convert the language to the content corresponding to the scene on the photo. To understand, and to find the location of the description according to the language description, on the one hand, the description of the location and the difference in understanding, will lead to communication bias, on the other hand, the language description is complex, communication is difficult.

As another example, the manufacturer sells one device to the user, and the user fails when using the device. In order to save costs, the producer and the user use the mobile phone for remote communication, and the user uses the mobile phone to transmit the real-time captured device image or the already completed image or image to the production in real time through the video. By. According to the current technology, the producer can only inform the user by voice how to operate at a certain position of the device, and the user should find the corresponding position on the device according to the producer's voice description. Communication is still difficult due to differences in the description and understanding of a device's location.

Summary of the invention

The object of the present invention is to provide an interactive indication method based on a display interface capable of transmitting the indicated position of the display interface on the display screen to the other party in real time, so that the communication between the two parties becomes simple and accurate. .

The display interface-based interactive indication method of the present invention comprises at least two terminals, each terminal comprising a processor, a display screen connected to the processor, and at least one input device capable of marking on the display interface; The terminals can communicate with each other; when any two terminals communicate, the display interface of one display can be transmitted to the other party in real time and displayed on the other display; the interactive indication method includes the following steps:

When one party uses the input device to mark the display content on the display interface of the display screen, the processor of the party processes the marked action information, and displays an indication icon on the display interface of the user; then, the indicator icon displayed by the party is displayed. The information and the icon location information of the indication icon are transmitted to the other party; the other party receives the indication icon information and the icon location After the information, the indication icon is displayed on the corresponding position of the display interface; the other party displays the indication icon on the interface and its position on the display interface, and the indication icon on the display interface of one side and the position on the display interface are the same.

In the above interactive display method based on the display interface, at least one of the communication parties further has a camera; when the communication party communicates with other parties, the display interface of the display screen is an image captured by the camera in real time or an image or image that has been captured.

In the above interactive display method based on the display interface, the indication icon is a line or a pattern corresponding to the marked motion track. For example, when the marking action is pressing, the pointing icon is a circle or a square; when the marking action is a straight sliding, the pointing icon is a straight line with an arrow, the pointing of the arrow is consistent with the sliding direction; when the marking action is a curved sliding, The indicator icon is an arc with an arrow pointing in the direction of the sliding direction. Different indication icons can give the other party a clearer indication, and the indication icon with an arrow can clearly inform the other party of the direction of performing an action on an indication area of the display interface, such as a straight line with an arrow indicating movement in the direction of the arrow, The arc of the arrow can indicate a rotation in the direction of the arrow. When the marking action is a straight line or an arbitrary curve, the indication icon may be a line or a pattern corresponding to the motion trajectory.

When one party communicates with multiple parties simultaneously, the display on one side can display information that distinguishes the parties with which it communicates. The information may be icons or other information representing different terminals, such that each of the terminals with which it communicates can be distinguished by the information.

In the above interactive display method based on the display interface, the indication icons have two or more icons, and each of the indication icons respectively corresponds to a marking action at a different place on the display interface or a different marking action at the same place. A plurality of indication icons are simultaneously displayed, and multiple indication areas of the display interface can be simultaneously explained and indicated.

The above-described display interface-based interactive indication method, the icon position information is position information associated with a feature of a display image as a display interface, and when the display image moves on the display screen, the indication icon and the display image move together, indicating The position of the icon relative to the displayed image remains unchanged. Thus, when the position of the display image on the display screen moves, the indicator icon moves with the displayed image and does not need to be reset.

In the above interaction display method based on the display interface, the icon position information is position information associated with a feature of the display screen, and when the display image as the display interface moves on the display screen, the position of the indication icon relative to the display screen is maintained. constant. Thus, when the position of the display image moves on the display screen, the indication icon does not move.

In the above-mentioned interactive display method based on the display interface, each terminal communicates through a wired network, a wireless network, a Bluetooth, a wired signal, a wireless signal, and the like.

In the above interactive display method based on the display interface, the input device is a touch type input device and/or a mouse, for example, a touch screen integrated with the display screen.

The invention has the beneficial effects that for any two parties of the communication, since the marking action of one party on the display interface is converted into the indicator icon, the display screen of the other party can be displayed on the other display screen, and the display interfaces of both parties are the same and displayed. The indicator icons on the interface are also the same on the display interface. In this way, both parties can know exactly a certain position on the display interface indicated by the indication icon without deviation; and there is no need to use language to describe where the location is, and the communication is quick and convenient.

DRAWINGS

1 is a schematic diagram showing an initial image of the terminal 1 corresponding to the

terminals

2, 3;

2 is a schematic diagram of an initial image displayed by the terminal 2;

3 is a schematic diagram of an initial image displayed by the terminal 3;

4 is a schematic view of the circle 21 and the square 22 displayed by the terminal 2;

Figure 5 is a schematic view of the circle 31 displayed by the terminal 3;

6 is a schematic view showing the terminal 1 displaying a circle 11, a square 12, and a square 15;

7 is a schematic view showing the curved shape 13 and the square 16 of the terminal 1;

FIG. 8 is a schematic diagram showing the display of the curved shape 23 by the terminal 2;

Figure 9 is a schematic diagram of the image on the terminal 3 after translation;

FIG. 10 is a schematic diagram of an image on the terminal 1 corresponding to the image on the translated terminal 3.

detailed description

Referring to Figures 1, 2 and 3, the terminal 1 can perform wireless and wired communication with the

terminals

2, 3, respectively.

Referring to FIG. 1 and FIG. 2, when the terminal 2 requests the initiator to communicate with the terminal 1, the image (display interface) displayed on the touch screen of the terminal 2 can be transmitted to the terminal 1 in real time and displayed on the touch screen of the terminal 1.

Referring to FIG. 1 and FIG. 3, after the terminal 3 requests the initiator to communicate with the terminal 1, the image (display interface) displayed on the touch screen of the terminal 3 can be transmitted to the terminal 1 in real time and displayed on the touch screen of the terminal 1.

Thus, the image displayed on the touch screen of the

terminals

2, 3 is displayed on the touch screen of the terminal 1 in a partition. See Figure 1. Of course, in order to distinguish the

terminals

2, 3, the address or name A of the terminal 2 is displayed on the image of the terminal 2 displayed on the touch screen of the terminal 1, and the address or name B of the terminal 3 is displayed on the image of the terminal 3 displayed on the touch screen of the terminal 1.

Referring to FIG. 4, when pressed with an image displayed on the touch screen of the terminal 2 with a finger or a press pen, the terminal 2 processor processes the information of the touch action (for a mark action) and asks whether it is associated with the image feature or with the touch screen feature. Associated. If the selection is associated with the image feature, the processor of the terminal 2 analyzes some features of the image (such as the R, G, and B values of some specific points on the image), and displays the pressed points on the image of the terminal 2. A circle 21 is drawn and the icon position information of the circle 21 relative to the image (such as the position of the circle 21 relative to a particular point on the image) is recorded.

Referring to FIG. 4, when pressed again on an image displayed on the touch screen of the terminal 2 with a finger or a press pen, the terminal 2 processor processes the touch action information and queries whether it is associated with the image feature or with the touch screen feature. If the selection is associated with the touch screen feature, the processor of the terminal 2 analyzes some features of the touch screen (such as recording the R, G, and B values of some specific points on the touch screen), and displays the pressed points on the image of the terminal 2. The square 22 is exited and the icon position information of the square 22 relative to the touch screen (e.g., the position of the square 22 relative to a particular point on the touch screen) is recorded.

Referring to FIG. 6, the terminal 2 processor transmits the two icon information of the circle 21 and the square 22 and the icon position information of the circle 21 and the square 22 to the terminal 1. After receiving the information transmitted by the terminal 2, the terminal 1 displays the circle 11 and the square 12 at the corresponding position on the display image of the touch screen. The circle 11, the square 12 and its position on the image displayed on the touch screen of the terminal 1 are the same as the circle 11, the square 12 and the position on the image displayed on the touch screen of the terminal 2.

Referring to FIG. 7, when a finger or a press pen slides on the image corresponding to the terminal 2 displayed on the touch screen of the terminal 1, the terminal 1 processor processes the touch action information and asks whether it is associated with the image feature or associated with the touch screen feature. . If the selection is associated with the image feature, the processor of the terminal 1 analyzes some features of the image (such as recording the R, G, and B values of some specific points on the image), and slides the arc on the image of the terminal 1. An arc 13 with an arrow is displayed (the direction of the arrow coincides with the sliding direction), and the icon position information of the arc 13 with respect to the image (such as the position of the arc 13 with respect to a specific point on the image) is recorded.

Referring to Fig. 8, the terminal 1 processor transmits the arc 13 indicating icon information and the icon position information of the arc 13 to the terminal 2. After receiving the information transmitted by the terminal 1, the terminal 2 displays the arc 23 at the corresponding position on the display image of the touch screen. The arc 13 displayed on the touch screen of the terminal 1 and its position on the image are the same as the arc 23 displayed on the touch screen of the terminal 2 and its position on the image.

Referring to FIG. 5, when a finger or a press pen is pressed on an image displayed on the touch screen of the terminal 3, the terminal 3 processor processes the touch action information and queries whether it is associated with the image feature or with the touch screen feature. If the selection is associated with the image feature, the processor of the terminal 3 analyzes some features of the image (such as R, G, B values of some specific points on the image), and displays the pressed points on the image of the terminal 3. A circle 31 is drawn and the icon position information of the circle 31 relative to the image (such as the position of the circle 31 relative to a particular point on the image) is recorded.

Referring to Fig. 6, the terminal 3 processor transmits the circle 31 indicating icon information and the icon position information of the circle 31 to the terminal 1. After receiving the information transmitted by the terminal 3, the terminal 1 displays a circle 15 at a corresponding position on the display image of the touch screen. The circle 15 displayed on the touch screen of the terminal 1 and its position on the image are the same as the circle 31 displayed on the touch screen of the terminal 3 and its position on the image.

Referring to FIG. 7, when a finger or a pressing pen is pressed on an image corresponding to the terminal 3 displayed on the touch screen of the terminal 1, the terminal 1 processor processes the touch action information and queries whether it is associated with the image feature or the touch screen feature. Such as The selection is associated with the touch screen feature, and the processor of the terminal 1 analyzes some features of the touch screen (such as R, G, B values of some specific points on the touch screen), and displays the pressed points on the image of the terminal 1 Square 16 and record the icon position information of the square 16 relative to the touch screen (e.g., the position of the square 16 relative to a particular point on the touch screen).

The terminal 1 processor transmits the square 16 indication icon information and the icon position information of the square 16 to the terminal 3. After receiving the information transmitted by the terminal 1, the terminal 3 displays the square 32 at the corresponding position on the display image of the touch screen. The square 32 displayed on the touch screen of the terminal 3 and its position on the image are the same as the square 16 displayed on the touch screen of the terminal 1 and its position on the image.

Referring to FIG. 9, when the position of the image on the terminal 3 is changed, since the icon position information of the circle 31 is the position information associated with the feature of the display image, the circle 31 moves with the image, and the square 32 is the touch screen. The feature is associated with the location information, so the position of the square 32 does not change (does not move as the image moves). Of course, the image corresponding to the terminal 3 on the touch screen of the terminal 1 changes accordingly, see FIG.

In the content described in the above specific embodiment, the input device is a touch screen integrated with the display screen. Of course, if each terminal is an ordinary display screen, it is also possible to equip each terminal with an additional mouse as an input device.

Also for real-time video communication, the user of the remote terminal can accurately indicate the position to be described to the field terminal by the method described, thereby realizing efficient and accurate interactive communication.

The invention is particularly suitable for real-time video communication. Through the intelligent terminal and the network, on the display interface of two or more terminals, as long as the part to be described is clicked on the image (display interface), the indicated part is in another The interface of the terminal is displayed to realize the transmission of the interface indication content, achieve the purpose of efficient and accurate communication, and make the communication simple and accurate.

Claims

An interactive indication method based on a display interface, comprising at least two terminals, each terminal comprising a processor, a display connected to the processor, and at least one input device capable of marking on the display interface; enabling between the terminals Communication; when any two terminals communicate, the display interface of one display can be transmitted to the other party in real time and displayed on the other display; the feature is that the interactive indication method includes the following steps:

When one party uses the input device to mark the display content on the display interface of the display screen, the processor of the party processes the marked action information, and displays an indication icon on the display interface of the user; then, the indicator icon displayed by the party is displayed. The information and the icon position information of the indication icon are transmitted to the other party; after receiving the indication icon information and the icon position information, the other party displays the indication icon at the corresponding position of the display interface of the user; the other party displays the indication icon on the interface and The position on the display interface is the same as the indicator on the display interface of one side and its position on the display interface.
The display interface-based interactive indication method according to claim 1, wherein at least one of the communication parties further has a camera; and when the communication party communicates with other parties, the display interface of the display screen is an image captured by the camera in real time. Or an image or image that has been taken.
The display interface-based interactive indication method according to claim 1, wherein the indication icon is a line or a pattern corresponding to the marked motion trajectory.
The display interface-based interactive indication method according to claim 1, wherein the indication icons are two or more, and the indication icons are respectively marked with different markings at different places on the display interface or different marks of the same place. The action corresponds.
The display interface-based interactive indication method according to claim 1, wherein the icon position information is position information associated with a feature of a display image as a display interface, and when the display image moves on the display screen, The indicator icon moves with the display image, indicating that the position of the icon relative to the displayed image remains unchanged.
The display interface-based interactive indication method according to claim 1, wherein the icon position information is position information associated with a feature of the display screen, and when the display image as the display interface moves on the display screen, The position of the indicator icon relative to the display remains the same.
The interactive display method based on the display interface according to claim 1, wherein each terminal communicates through a wired network, a wireless network, a Bluetooth, a wired signal, or a wireless signal.
The display interface-based interactive indication method according to claim 1, wherein the input device is a touch type input device and/or a mouse.
The interactive display method based on a display interface according to claim 1, wherein when one party communicates with a plurality of parties simultaneously, information on the parties that communicate with them can be displayed on one of the display screens.