CN104898921A - Display interface based interaction indicating method - Google Patents

Display interface based interaction indicating method Download PDF

Info

Publication number
CN104898921A
CN104898921A CN201510225946.2A CN201510225946A CN104898921A CN 104898921 A CN104898921 A CN 104898921A CN 201510225946 A CN201510225946 A CN 201510225946A CN 104898921 A CN104898921 A CN 104898921A
Authority
CN
China
Prior art keywords
display interface
display
terminal
image
icon
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510225946.2A
Other languages
Chinese (zh)
Inventor
林中尉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201510225946.2A priority Critical patent/CN104898921A/en
Publication of CN104898921A publication Critical patent/CN104898921A/en
Priority to PCT/CN2016/080929 priority patent/WO2016177312A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present invention provides a display interface based interaction indicating method. According to the method, for two parties communicating with each other, an indication position on a display interface of a display screen of one party can be transmitted to the other party in real time, so that communication about a certain position between the two parties becomes simple and accurate. Mutually flexible terminals each comprise a processor, a display screen and an output device that can make a mark on a display interface. When one party marks a displayed content on the display interface of the party by using the output device, the party performs information processing on a mark action and displays an indication icon; meanwhile the party transmits indication icon information and icon position information of the indication icon to the other party; and after receiving the information, the other party displays an indication icon on a corresponding position on the display interface of the other party. The display interface, the indication icon on the display interface and the position of the indication icon on the display interface of the other party are the same as those of the one party.

Description

Based on the interactive indicating means of display interface
Technical field
The present invention relates to a kind of terminal called method, described terminal has display screen and can make the human input devices of operational label on the display interface of display screen, and these means of communication can make each terminal demonstration go out display interface in one of them terminal.
Background technology
Now, interpersonal communication exchange can the mode such as voice transfer and image transmission carry out.For the interchange of seen scene, receiver is passed to mainly through language description and imaging modality, discuss and exchange for information can only be described by language and illustrate, such as: the user of a terminal has taken a photo, send to another one terminal user, when the user receiving photo will comment on this photo, can only be described by language and say so-and-so position on photo how, and accept reviewer and need language to be converted into the content corresponding with the scene on photo and go to understand, and need to describe according to language to go to find the position described, on the one hand, to the description of position with understand difference, can cause linking up deviation, on the other hand, language describes complicated, communication difficulty is large.
And for example, the producer sells an equipment to user, and user is broken down when the equipment of use.The producer is helping user when fixing a breakdown, in order to save cost, the producer and user use mobile phone to carry out long-range communication, and user uses mobile phone, by video, the equipment drawing picture of captured in real-time or the image taken or image are sent to the producer in real time.According to current technology, the producer can only pass through voice informing user, how to go how to operate in certain position of equipment, and user will be described on equipment according to the voice of the producer and finds corresponding position.Due to the description of certain position of equipment and the difference on understanding, link up still difficulty.
Summary of the invention
The object of this invention is to provide and a kind ofly the indicating positions of the side display interface on a display screen of mutual communication can be sent to the other side in real time, make the communication of both sides to certain position become simple again accurately based on the interactive indicating means of display interface.
Interactive indicating means based on display interface of the present invention, it comprises at least two terminals, and each terminal comprises processor, the display screen be connected with processor and input equipment that at least one can make a mark on display interface; Communication can be carried out between each terminal; When after any two terminal calleds, the display interface of side's display screen can be sent to the opposing party in real time, and shows on the display screen of the opposing party; Described interactive indicating means comprises the steps:
When a side uses input equipment to make marks to displaying contents on the display interface of the display screen of oneself, the processor of the party, to the process of mark action message, demonstrates instruction icon at the display interface of oneself; Then, a side sends the opposing party to the instruction icon information of display and this index map target icon location information; The opposing party demonstrates instruction icon after receiving instruction icon information and icon location information on the relevant position of the display interface of oneself; Instruction icon on the opposing party's display interface and on display interface position, with the instruction icon on side's display interface and on display interface position identical.
The above-mentioned interactive indicating means based on display interface, a side of at least communication also has camera; During as a side of communication and other square tube news, the display interface of their display screen is the image of camera captured in real-time or the image taken or image.
The above-mentioned interactive indicating means based on display interface, instruction icon is the lines corresponding to mark movement locus or pattern.Such as, when mark action is pressing, index map is designated as circle or square; When mark action is linear slide, index map is designated as the straight line with arrow, and the sensing of arrow is consistent with glide direction; When mark action is arc sliding, index map is designated as the arc with arrow, and the sensing of arrow is consistent with glide direction.Different instruction icons can give the clearer instruction of the other side, instruction icon with arrow clearly can inform that the direction of certain action is carried out in the other side certain indicating area to display interface, straight line as having arrow can represent to the direction of arrow and moves, and the arc with arrow can represent to the direction of arrow and rotates.When the action that makes marks be straight line or arbitrary curve time, instruction icon can be the lines corresponding to movement locus or pattern.
When a side and simultaneous communications in many ways, the display screen of a side can demonstrate the information distinguished with each side of its communication.Described information can be the icon or the out of Memory that represent different terminals, like this, can be distinguished the terminal of each and its communication by described information.
The above-mentioned interactive indicating means based on display interface, index map indicates two or more, each instruction icon respectively from the mark action in the different places on display interface or the not isolabeling action of same place corresponding.Multiple instruction icon shows simultaneously, can be described multiple indicating areas of display interface, indicate simultaneously.
The above-mentioned interactive indicating means based on display interface, described icon location information is the positional information be associated with the feature of the display image as display interface, when showing image and moving on a display screen, instruction icon moves together with display image, and instruction icon remains unchanged relative to the position of display image.Like this, when display image position is on a display screen moved, instruction icon moves, without the need to resetting with display image again.
The above-mentioned interactive indicating means based on display interface, described icon location information is the positional information be associated with the feature of display screen, and when the display image as display interface moves on a display screen, instruction icon remains unchanged relative to the position of display screen.Like this, when display image position is on a display screen moved, instruction icon is motionless.
The above-mentioned interactive indicating means based on display interface, carries out communication by cable network, wireless network, bluetooth, wire signal, wireless signal etc. between each terminal.
The above-mentioned interactive indicating means based on display interface, input equipment is touch-control class input equipment and/or mouse, such as, the touch-screen be integrated with display screen.
Beneficial effect of the present invention: for communication in many ways in any two sides, because the mark action of a side on display interface is converted into instruction icon, can demonstrate on the display screen of the opposing party, and the position that the display interface of both sides is identical, index map on display interface is marked on display interface is also identical.Like this, both sides all can know for sure certain position on this display interface indicated by instruction icon, and there will not be deviation; And without the need to where describing this position with language on earth, link up efficient and convenient.
Accompanying drawing explanation
Fig. 1 is that terminal 1 shows and terminal 2,3 corresponding initial pictures schematic diagram;
Fig. 2 is the initial pictures schematic diagram that terminal 2 shows;
Fig. 3 is the initial pictures schematic diagram that terminal 3 shows;
Fig. 4 is the circle 21 of terminal 2 display, the schematic diagram of square 22;
Fig. 5 is the schematic diagram of the circle 31 that terminal 3 shows;
Fig. 6 is that terminal 1 shows circle 11, the square schematic diagram of 12, square 15;
Fig. 7 be terminal 1 show arc 13, square 16 schematic diagram;
Fig. 8 is the schematic diagram of terminal 2 display arc 23;
Fig. 9 is the schematic diagram after the image translation in terminal 3;
Figure 10 is the image schematic diagram corresponding with the image in the terminal 3 after translation in terminal 1.
Embodiment
Shown in Fig. 1,2,3, terminal 1 can carry out wireless, wire communication with terminal 2,3 respectively.
See Fig. 1,2, after terminal 2 is as initiator's request and terminal 1 communication, the image (display interface) that terminal 2 touches screen display can be sent to terminal 1 in real time, and shows on the touch-screen of terminal 1.
See Fig. 1,3, after terminal 3 is as initiator's request and terminal 1 communication, the image (display interface) that terminal 3 touches screen display can be sent to terminal 1 in real time, and shows on the touch-screen of terminal 1.
Like this, the touch-screen of terminal 1 goes out with regard to multi-section display the image that terminal 2,3 touches screen display.See Fig. 1.Certainly, in order to distinguishing terminal 2,3, the address of display terminal 2 or name A on the image of the terminal 2 of terminal 1 touch-screen display, the address of display terminal 3 or name B on the image of the terminal 3 of terminal 1 touch-screen display.
See Fig. 4, when utilization finger or pressing pen press on the image of the touch screen display of terminal 2, terminal 2 processor is to touch action (being the action of a kind of mark) information processing, and inquiry is associated with characteristics of image or is associated with touch-screen feature.As selected to be associated with characteristics of image, the processor of terminal 2 is just analyzed (R, G, B numerical value as some specified points on image records) some features of image, press points on the image of terminal 2 is demonstrated circular 21, and record circular 21 is relative to the icon location information (if circle 21 is relative to the position of the specified point on image) of image.
See Fig. 4, when utilization finger or pressing pen again press on the image of the touch screen display of terminal 2, terminal 2 processor is to touch action information processing, and inquiry is associated with characteristics of image or is associated with touch-screen feature.As selected to be associated with touch-screen feature, the processor of terminal 2 is just analyzed (R, G, B numerical value as some specified points on touch-screen records) some features of touch-screen, press points on the image of terminal 2 is demonstrated square 22, and records square 22 relative to the icon location information (as square 22 relative to the position of the specified point on touch-screen) of touch-screen.
See Fig. 6, terminal 2 processor sends terminal 1 to the icon location information of circle 21, square 22 two instruction icon informations and circle 21, square 22.After the information that terminal 1 receiving terminal 2 transmits, the relevant position of oneself touch-screen display image shows circular 11, square 12.Terminal 1 touch screen display circle 11, square 12 and on image position, with terminal 2 touch screen display circle 11, square 12 and on image position identical.
See Fig. 7, when finger or pressing pen touch arc sliding on the image corresponding to terminal 2 of screen display in terminal 1, terminal 1 processor is to touch action information processing, and inquiry is associated with characteristics of image or is associated with touch-screen feature.As selected to be associated with characteristics of image, the processor of terminal 1 is just analyzed (R, G, B numerical value as some specified points on image records) some features of image, direction arc sliding on the image of terminal 1 being demonstrated the arc 13(arrow of band arrow is consistent with glide direction), and record the icon location information (if arc 13 relative to the position of specified point image on) of arc 13 relative to image.
See Fig. 8, terminal 1 processor indicates the icon location information of icon information and arc 13 to send terminal 2 to arc 13.After the information that terminal 2 receiving terminal 1 transmits, the relevant position of oneself touch-screen display image shows arc 23.Terminal 1 touch screen display arc 13 and on image position, with terminal 2 touch screen display arc 23 and on image position identical.
See Fig. 5, press when finger or pressing pen touch on the image of screen display in terminal 3, terminal 3 processor is to touch action information processing, and inquiry is associated with characteristics of image or is associated with touch-screen feature.As selected to be associated with characteristics of image, the processor of terminal 3 is just analyzed (R, G, B numerical value as some specified points on image records) some features of image, press points on the image of terminal 3 is demonstrated circular 31, and record circular 31 is relative to the icon location information (if circle 31 is relative to the position of the specified point on image) of image.
See Fig. 6, terminal 3 processor sends terminal 1 to the icon location information of circular 31 instruction icon informations and circular 31.After the information that terminal 1 receiving terminal 3 transmits, the relevant position of oneself touch-screen display image shows circular 15.Terminal 1 touch screen display circle 15 and on image position, with terminal 3 touch screen display circle 31 and on image position identical.
See Fig. 7, press when finger or pressing pen touch on the image corresponding to terminal 3 of screen display in terminal 1, terminal 1 processor is to touch action information processing, and inquiry is associated with characteristics of image or is associated with touch-screen feature.As selected to be associated with touch-screen feature, the processor of terminal 1 is just analyzed (R, G, B numerical value as some specified points on touch-screen records) some features of touch-screen, press points on the image of terminal 1 is demonstrated square 16, and records square 16 relative to the icon location information (as square 16 relative to the position of the specified point on touch-screen) of touch-screen.
Terminal 1 processor sends terminal 3 to the icon location information of square 16 instruction icon informations and square 16.After the information that terminal 3 receiving terminal 1 transmits, the relevant position of oneself touch-screen display image shows square 32.Terminal 3 touch screen display square 32 and on image position, with terminal 1 touch screen display square 16 and on image position identical.
See Fig. 9, when the position of image in terminal 3 changes, icon location information due to circular 31 is the positional information be associated with the feature of display image, so circular 31 move along with image, and square 32 is the positional information be associated with the feature of touch-screen, so the invariant position of square 32 (not mobile with the movement of image).Certainly, the image corresponding to terminal 3 on the touch-screen of terminal 1 changes, see Figure 10 thereupon.
Content described by this above-mentioned embodiment, input equipment is the touch-screen be integrated with display screen.Certainly, be also fine if each terminal is common display screen, at this moment can be equipped with extra mouse as input equipment for each terminal.
When exchanging for real-time video equally, the user of remote terminal, by described method, accurately can be indicated to on-site terminal by the position that oneself will illustrate, realize the interactive communication of efficiently and accurately.
The present invention is specially adapted to real-time video and exchanges, by intelligent terminal and network, on the display interface of two or more terminal, as long as tap the position that will describe on image (display interface), namely the position of this instruction shows on the interface of another terminal, realize the transmission to interface instruction content, reach the object that efficiently and accurately is linked up, make communication become simple accurate again.

Claims (9)

1. based on the interactive indicating means of display interface, it comprises at least two terminals, and each terminal comprises processor, the display screen be connected with processor and input equipment that at least one can make a mark on display interface; Communication can be carried out between each terminal; When after any two terminal calleds, the display interface of side's display screen can be sent to the opposing party in real time, and shows on the display screen of the opposing party; It is characterized in that: described interactive indicating means comprises the steps:
When a side uses input equipment to make marks to displaying contents on the display interface of the display screen of oneself, the processor of the party, to the process of mark action message, demonstrates instruction icon at the display interface of oneself; Then, a side sends the opposing party to the instruction icon information of display and this index map target icon location information; The opposing party demonstrates instruction icon after receiving instruction icon information and icon location information on the relevant position of the display interface of oneself; Instruction icon on the opposing party's display interface and on display interface position, with the instruction icon on side's display interface and on display interface position identical.
2., as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: a side of at least communication also has camera; During as a side of communication and other square tube news, the display interface of their display screen is the image of camera captured in real-time or the image taken or image.
3. as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: instruction icon is the lines corresponding to mark movement locus or pattern.
4. as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: index map indicates two or more, each instruction icon respectively from the mark action in the different places on display interface or the not isolabeling action of same place corresponding.
5. as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: described icon location information is the positional information be associated with the feature of the display image as display interface, when showing image and moving on a display screen, instruction icon moves together with display image, and instruction icon remains unchanged relative to the position of display image.
6. as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: described icon location information is the positional information be associated with the feature of display screen, when the display image as display interface moves on a display screen, instruction icon remains unchanged relative to the position of display screen.
7., as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: between each terminal, carry out communication by cable network, wireless network, bluetooth, wire signal, wireless signal.
8., as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: input equipment is touch-control class input equipment and/or mouse.
9. as claimed in claim 1 based on the interactive indicating means of display interface, it is characterized in that: when a side and simultaneous communications in many ways, the display screen of a side can demonstrate the information distinguished with each side of its communication.
CN201510225946.2A 2015-05-06 2015-05-06 Display interface based interaction indicating method Pending CN104898921A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201510225946.2A CN104898921A (en) 2015-05-06 2015-05-06 Display interface based interaction indicating method
PCT/CN2016/080929 WO2016177312A1 (en) 2015-05-06 2016-05-03 Interaction indication method based on display interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510225946.2A CN104898921A (en) 2015-05-06 2015-05-06 Display interface based interaction indicating method

Publications (1)

Publication Number Publication Date
CN104898921A true CN104898921A (en) 2015-09-09

Family

ID=54031608

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510225946.2A Pending CN104898921A (en) 2015-05-06 2015-05-06 Display interface based interaction indicating method

Country Status (2)

Country Link
CN (1) CN104898921A (en)
WO (1) WO2016177312A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016177312A1 (en) * 2015-05-06 2016-11-10 林中尉 Interaction indication method based on display interface

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1542669A (en) * 2003-04-28 2004-11-03 商之器科技股份有限公司 Online medical conference system capable of real time medical image transmission
CN102436351A (en) * 2011-12-22 2012-05-02 优视科技有限公司 Method and device for controlling application interface through dragging gesture
CN202650290U (en) * 2012-05-28 2013-01-02 上海易酷信息技术服务有限公司 Remote answering guidance system based on intelligent mobile phones
CN103024588A (en) * 2012-11-15 2013-04-03 长春指南针科技有限公司 Multi-screen interactive system and method
US20140366057A1 (en) * 2013-06-06 2014-12-11 Activevideo Networks, Inc. Overlay Rendering of User Interface Onto Source Video

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104898921A (en) * 2015-05-06 2015-09-09 林中尉 Display interface based interaction indicating method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1542669A (en) * 2003-04-28 2004-11-03 商之器科技股份有限公司 Online medical conference system capable of real time medical image transmission
CN102436351A (en) * 2011-12-22 2012-05-02 优视科技有限公司 Method and device for controlling application interface through dragging gesture
CN202650290U (en) * 2012-05-28 2013-01-02 上海易酷信息技术服务有限公司 Remote answering guidance system based on intelligent mobile phones
CN103024588A (en) * 2012-11-15 2013-04-03 长春指南针科技有限公司 Multi-screen interactive system and method
US20140366057A1 (en) * 2013-06-06 2014-12-11 Activevideo Networks, Inc. Overlay Rendering of User Interface Onto Source Video

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016177312A1 (en) * 2015-05-06 2016-11-10 林中尉 Interaction indication method based on display interface

Also Published As

Publication number Publication date
WO2016177312A1 (en) 2016-11-10

Similar Documents

Publication Publication Date Title
US10382719B2 (en) Method and apparatus for sharing information during video call
US20160248505A1 (en) Smart device performing led-id/rf communication through a camera, and system and method for providing location-based services using the same
US20130201214A1 (en) Methods, Apparatuses, and Computer-Readable Storage Media for Providing Interactive Navigational Assistance Using Movable Guidance Markers
TWI374255B (en) Method and system for synchronizing mark on electronic map and computer program product using the same
KR101533320B1 (en) Apparatus for acquiring 3 dimension object information without pointer
US9459756B2 (en) User terminal apparatus, message exchange system, method for displaying message, and method for exchanging message
JP6230113B2 (en) Video instruction synchronization method, system, terminal, and program for synchronously superimposing instruction images on captured moving images
KR101708207B1 (en) Apparatus and method for providing user's route information in mobile communication system
CN104205857A (en) Information processing apparatus, information processing method, and program
CN110609654B (en) Data synchronous display method, device and equipment and teleconferencing system
CN102567617A (en) Apparatus and method for providing augmented reality information
CN103747308A (en) Method and system for controlling smart television with analog keys, and mobile terminal
CN106293563B (en) Control method and electronic equipment
CN111599021A (en) Virtual space roaming guiding method and device and electronic equipment
JP2013145557A (en) Instant message method to be used for portable electronic equipment and system thereof
CN105763552A (en) Transmission method, device and system in remote control
CN109587188B (en) Method and device for determining relative position relationship between terminal devices and electronic device
CN113918070A (en) Synchronous display method and device, readable storage medium and electronic equipment
CN104898921A (en) Display interface based interaction indicating method
CN106569686B (en) Method for controlling screen capture by rolling ball and related intelligent equipment
WO2014194453A1 (en) Display processing method and display processing system for functionality controls
CN102947772B (en) For the method and apparatus determining input
JPWO2018193509A1 (en) REMOTE WORK SUPPORT SYSTEM, REMOTE WORK SUPPORT METHOD, AND PROGRAM
CN114766017A (en) Equipment for amplifying and displaying screen and performing real-time rebroadcasting and operation method thereof
CN111175958A (en) Remote consultation method and system for pathological section under microscope

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150909

RJ01 Rejection of invention patent application after publication