CN107515717B - Information interaction method, system and device - Google Patents

Information interaction method, system and device Download PDF

Info

Publication number
CN107515717B
CN107515717B CN201710790437.3A CN201710790437A CN107515717B CN 107515717 B CN107515717 B CN 107515717B CN 201710790437 A CN201710790437 A CN 201710790437A CN 107515717 B CN107515717 B CN 107515717B
Authority
CN
China
Prior art keywords
screen
information
photosensitive
screen information
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710790437.3A
Other languages
Chinese (zh)
Other versions
CN107515717A (en
Inventor
丁琳
张晓飞
张媛
谢根英
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN201710790437.3A priority Critical patent/CN107515717B/en
Publication of CN107515717A publication Critical patent/CN107515717A/en
Application granted granted Critical
Publication of CN107515717B publication Critical patent/CN107515717B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F16/9554Retrieval from the web using information identifiers, e.g. uniform resource locators [URL] by using bar codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/45Structures or tools for the administration of authentication
    • G06F21/46Structures or tools for the administration of authentication by designing passwords or checking the strength of passwords
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/30Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/327Short range or proximity payments by means of M-devices
    • G06Q20/3276Short range or proximity payments by means of M-devices using a pictured code, e.g. barcode or QR-code, being read by the M-device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/30Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/327Short range or proximity payments by means of M-devices
    • G06Q20/3278RFID or NFC payments by means of M-devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • General Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Accounting & Taxation (AREA)
  • Strategic Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses an information interaction method, a system and a device, wherein after an opaque shelter is identified or a second device is identified, the first device with a photosensitive screen transmits the covered screen information to the second device for processing, one example is that the second device sends an operation instruction to the first device with the photosensitive screen according to the use scene of a user, and the screen information stored or/and displayed in the first device with the photosensitive screen is changed. Therefore, the invention can realize information interaction among different devices based on the photosensitive recognition technology according to the requirements of users.

Description

Information interaction method, system and device
Technical Field
The present invention relates to computer network technologies, and in particular, to an information interaction method, system, and apparatus.
Background
With the development of computer technology, information interaction and/or information synchronization can be performed between devices in various ways, and the devices can be wireless terminals and the like. At present, a method for performing information interaction or/and information synchronization mainly includes: bluetooth transmission between devices, Near Field Communication (NFC) transmission between devices, local area network transmission of device composition, transmission between devices over WiFi or mirror link (MirrorLink). The mirror image link technology is combined with various prior arts to meet various possible use scenarios inside the automobile, and includes performing picture display and user instruction input through virtual network operation, finding corresponding equipment through general plug and play, completing correct configuration, performing information interaction such as audio streaming by using bluetooth and a real-time transmission protocol, and the like, and the mirror image link technology also supports various technologies frequently used in the automobile at present, including bluetooth, HFP, A2DP protocols, and the like. That is, the device may establish a connection with the in-vehicle system through a Universal Serial Bus (USB), bluetooth, or WiFi, may transmit the operation interface to the in-vehicle screen, form a simple and clear menu interface on the in-vehicle screen, and operate the device through a physical key or a language command on the in-vehicle system.
In order to acquire required information from other equipment, the equipment firstly needs to identify the information from the other equipment, the identification information can adopt a camera identification technology, a character and number identification technology or a photosensitive identification technology, wherein the file and number identification technology can identify character and graphic information with certain attributes such as a telephone number, an express bill number, a postal code, a website address, a two-dimensional code and the like; the photosensitive identification technology is to enable the screen of the equipment to be provided with a sensor which can be embedded under the screen glass, the sensor can track the change of light rays and light waves, identify the shielding relation between screens of the equipment or between the terminal equipment and an object, know the information such as the position of a shielding area of the screen of the equipment, the size of a pixel of the screen and the like, and further share and process the information of the shielding area.
Compared with a camera recognition technology, the photosensitive recognition technology obtains the information of the equipment through shielding a screen of the equipment, the operation is simple, and a user does not need to click gradually to enter a photographing program and then record the information and the picture. The picture recognized by the camera is regular, and the screen area of the equipment can be shielded by an object with any shape, so that the information of the shielded area is in the range of the irregular shape, and the recognition mode is more free and more interesting. Direct information data without imaging and light interference is acquired by adopting a photosensitive identification technology, and physical picture format data with light and physical space distance interference is acquired by adopting a camera identification technology.
However, at present, the photosensitive recognition technology is not applied to information interaction between devices, and how to specifically realize the information interaction between the devices based on the photosensitive recognition technology is a technical problem to be solved urgently.
Disclosure of Invention
In view of this, embodiments of the present invention provide an information interaction method, which can implement information interaction between devices based on a photosensitive recognition technology.
The embodiment of the invention also provides an information interaction system, which can realize information interaction between devices based on the photosensitive recognition technology.
The embodiment of the invention also provides an information interaction device, which can realize information interaction between devices based on the photosensitive recognition technology.
According to the above object, the present invention is achieved by:
a method for information interaction, comprising:
the first device with a light-sensitive screen recognizes an opaque obstruction or recognizes a second device;
the first device with the photosensitive screen transmits the shielded screen information to the second device for processing.
A system for information interaction, the system comprising: a first device having a photosensitive screen and a second device, wherein,
the device comprises a first device with a photosensitive screen, a second device and a control module, wherein the first device is used for identifying an opaque shelter or identifying the second device and transmitting the information of the sheltered screen to the second device;
and the second equipment is used for processing the screen information.
An information interaction device, comprising: an identification module and a transmission module, wherein,
the identification module is used for identifying an opaque shelter or identifying second equipment;
and the transmission module is used for transmitting the shielded screen information to the second equipment.
It can be seen from the foregoing solutions that, in the device with the first photosensitive screen according to the embodiment of the present invention, after an opaque blocking object is recognized or a second device is recognized, the covered screen information is transmitted to the second device for processing, where an example is that the second device sends an operation instruction to the first device with the photosensitive screen according to a user usage scene, and changes the screen information stored or/and displayed in the first device with the photosensitive screen. Therefore, the invention can realize information interaction among different devices based on the photosensitive recognition technology according to the requirements of users.
Drawings
FIG. 1 is a flowchart of a method for information interaction according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of an information interaction system according to an embodiment of the present invention;
FIG. 3 is a structural diagram of an information interaction apparatus according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a second information interaction device according to an embodiment of the present invention;
fig. 5 is a schematic diagram illustrating a processing method of a connection module in a first device having a photosensitive screen according to an embodiment of the present invention;
FIG. 6 is a flowchart of a processing method of an identification module in a first device having a photosensitive screen according to an embodiment of the present invention;
FIG. 7 is a flowchart of a method for processing a transport module according to an embodiment of the present invention;
fig. 8 is a flowchart of a processing method of a secondary display module according to an embodiment of the present invention;
FIG. 9 is a flowchart of a processing method of a processing module according to an embodiment of the present invention;
FIG. 10 is a diagram illustrating an example of a first apparatus having a photosensitive screen for shielding a first image according to an embodiment of the present invention;
FIG. 11 is a diagram illustrating an example of a second apparatus for blocking a first photosensitive screen according to an embodiment of the present invention;
FIG. 12 is a diagram illustrating an example of a second apparatus for blocking a first photosensitive screen according to an embodiment of the present invention;
fig. 13 is a schematic diagram illustrating an example that a paper card is used to shield a first device having a photosensitive screen and screen information is displayed on an intelligent device according to an embodiment of the present invention;
fig. 14 is a schematic diagram illustrating an example of displaying screen information on a smart watch by using a pen to shield a first device having a light-sensitive screen according to an embodiment of the present invention;
fig. 15 is a schematic diagram of an example that a first device having a light-sensitive screen is shielded by a hand and screen information is displayed on an intelligent device according to an embodiment of the present invention;
fig. 16 is a schematic view of an operation entry of a smart phone according to an embodiment of the present invention;
FIG. 17 is a diagram illustrating an example process of intercepting text messages according to an embodiment of the present invention;
FIG. 18 is a diagram illustrating an example process of identifying and capturing pictures according to an embodiment of the present invention;
FIG. 19 is a diagram illustrating an example process for identifying address information according to an embodiment of the present invention;
fig. 20 is a schematic diagram of an example process of identifying a two-dimensional code according to an embodiment of the present invention;
FIG. 21 is a diagram illustrating an exemplary process for identifying website address information according to an embodiment of the present invention;
FIG. 22 is a diagram illustrating an example process for identifying telephone number information according to an embodiment of the present invention;
FIG. 23 is a diagram illustrating an example process of identifying a cursor and editing a text according to an embodiment of the present invention;
FIG. 24 is a diagram illustrating an example process for editing a highlight region in text according to an embodiment of the present invention;
FIG. 25 is a diagram illustrating an example process of copying and pasting information according to an embodiment of the present invention;
fig. 26 is a schematic diagram of an example process of deleting area information according to an embodiment of the present invention;
FIG. 27 is a diagram illustrating an example process of a secure projection screen according to an embodiment of the present invention;
FIG. 28 is a diagram illustrating an example process for encrypting private content according to an embodiment of the invention;
fig. 29 is a schematic diagram of an example process of securely logging in a personal account according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and examples.
As can be seen from the background art, although a photosensitive screen is provided, the photosensitive screen and the interactive operation based on the photosensitive performance thereof are not developed. The background technology does not realize portable interaction for rapidly acquiring information through shielding of an opaque object or overlapping of an equipment screen and an equipment screen, and does not realize secondary processing after information acquisition between different screens, such as information extraction, reconstruction display and the like. The device synchronization mode of the background art does not realize the transmission of natural screen regionalized information, but the embodiment of the invention can identify the regionalized information on the screen, and a user can naturally select the device screen region needing the synchronized information.
The transmission mode between the devices in the background art is not in a very natural and portable interactive mode, but the embodiment of the invention is an interactive mode which is particularly natural for a user to touch the screen of the device by the device and establish pairing or connection, so that the information of other devices is acquired, and the acquired information content is very consistent with the visual and psychological expectations of the user.
In the background art, information sharing among devices is generally information sharing on a whole screen, a natural selection process of a user is not required for a screen area of the information sharing, an interaction mode is only limited to gesture operation of one device to send out instructions such as information or picture sharing, and natural contact or shielding of the screen device or an object is not required, so that a technical scheme of device information interaction is triggered.
The mode of taking pictures and memorizing screen equipment information in the background art can not identify, screen and extract the information on the pictures, and the process of taking pictures also needs to open the picture taking application, click to take pictures, store the pictures and search key information required by users, so that the process is complicated.
The problems of information acquisition or synchronization in the background art, information redundancy and information synchronization between devices are solved, information requirements and application scenes of a user are not distinguished, information of any scene can be synchronously displayed on the devices, and the user cannot customize and acquire information of a certain part of a screen. The redundancy of information increases the cost of information management on each device, and also brings insecurity of information management.
The embodiment of the invention utilizes the photosensitive recognition technology of the device screen, and provides a first device with a photosensitive screen, which transmits the covered screen information to a second device for processing after recognizing an opaque blocking object or a second device, wherein one example is that the second device can send an operation instruction to the first device with the photosensitive screen according to the use scene of a user, and change the screen information stored or/and displayed in the first device with the photosensitive screen. Therefore, the invention can realize information interaction among different devices based on the photosensitive recognition technology according to the requirements of users.
Specifically, the first device with the photosensitive screen calculates the position and the size of the area of the shelter by covering the light and shade of the screen of the second device or other opaque shelters, and under the action of a user confirmatory operation, the first device with the photosensitive screen rapidly shares screen information to the second device. After the second device acquires the screen information of the first device with the photosensitive screen, different screen information can be processed according to the acquired screen information and user requirements.
Therefore, the second device can rapidly intercept and process the shielded screen information of the first device with the photosensitive screen, reconstruct the acquired screen information and display the reconstructed screen information on the second device for the second time, and a user only needs to check the second device under the condition that the first device with the photosensitive screen is inconvenient to carry or open. When the first equipment with the photosensitive screen is large and inconvenient to move, the first equipment is small and can be conveniently moved, and the shielded screen information is quickly acquired to achieve the purposes of memorandum, mobile storage and portable display, so that the operation and interaction experience is very consistent with the psychological expectation of a user.
According to the character attributes in the acquired screen information of the first device with the photosensitive screen, different operation prompts are provided for a user, such as highlighting characters of the first device with the photosensitive screen, operations of quickly inserting characters and the like, the user can conveniently and quickly input character information to the first device with the photosensitive screen on the smaller screen device, and the first device with the photosensitive screen has a larger screen and is portable in screen information editing.
In the embodiment of the present invention, the blocked screen information on the first device having the photosensitive screen may be further encrypted, so as to hide the blocked screen information. Or the shielded screen information on the first photosensitive screen is a password input area, and after the password is input on the second device, the password is directly input to the shielded screen area on the first photosensitive screen for verification processing.
In the embodiment of the present invention, the first device having a photosensitive screen may include a mobile phone, a tablet, an electronic screen, a television, a computer, and the like, and is not limited to the above devices; the second device may include: a mobile terminal device such as a mobile phone or a tablet, and is not limited to the above devices.
Fig. 1 is an information interaction method provided in an embodiment of the present invention, which includes the following specific steps:
step 101, identifying an opaque shelter or identifying a second device by a first device with a photosensitive screen;
and 102, the first device with the photosensitive screen transmits the shielded screen information to the second device for processing.
In the method, before step 101, a first device having a photosensitive screen establishes a communication connection with a second device.
In the method, the screen information is data, text or pictures.
In the method, the second device process further comprises: displayed on the second device or/and stored.
When the screen information is a picture, the second device processes including: and intercepting the covered pictures, and then splicing.
In the method, the second device processing includes: and after adding, inserting and deleting the screen information or operating according to a set operating instruction, sending the processed screen information to a first device with a photosensitive screen for storage or/and display in the shielded area.
In the method, the screen information is encrypted and is not displayed or is displayed in a fuzzy mode in the shielded area.
In the method, the screen information is a secure login interface, and the second device processing includes:
and after filling a safety account in the safety login interface, sending the safety account to a first device with a photosensitive screen for verification and displaying the safety account in the shielding area.
Fig. 2 is a schematic structural diagram of an information interaction system provided in an embodiment of the present invention, including: a first device having a photosensitive screen and a second device, wherein,
the device comprises a first device with a photosensitive screen, a second device and a control module, wherein the first device is used for identifying an opaque shelter or identifying the second device and transmitting the information of the sheltered screen to the second device;
and the second equipment is used for processing the screen information.
In the system, further comprising: the first device with the photosensitive screen is also used for establishing connection with the second device.
In the system, the second device is further used for storing or/and displaying the screen information.
In the system, the second device is further configured to add, insert, delete, or operate according to a set operation instruction to the screen information, and then send the processed screen information to the first device with the photosensitive screen for storage or/and display in the blocked area;
the first device with the photosensitive screen is further used for storing or/and displaying the processed screen information in the shielded area after receiving the processed screen information.
In the system, the screen information is data, text or pictures;
and when the screen information is a picture, the second equipment is also used for intercepting the covered picture and then splicing the intercepted picture.
In the system, the second device is also used for encrypting the screen information and sending the encrypted screen information to the first device with the photosensitive screen;
the first device with a light-sensitive screen is also used for not displaying or displaying the screen information in a fuzzy mode in the shielded area.
In the system, the screen information is a safe login interface,
the second device is further used for sending the security login interface to a first device with a photosensitive screen for verification after a security account is filled in the security login interface, and displaying the security login interface in the shielding area;
the first device with the photosensitive screen is further used for verifying the received safe account number and displaying the safe account number in the shielding area.
Fig. 3 is a schematic structural diagram of an information interaction apparatus provided in an embodiment of the present invention, the apparatus i is a first device having a photosensitive screen, and the apparatus i includes: an identification module and a transmission module, wherein,
the identification module is used for identifying an opaque shelter or identifying second equipment;
and the transmission module is used for transmitting the shielded screen information to the second equipment.
The device also comprises a connecting module which is used for connecting with the second equipment.
In the device, the transmission module is further configured to store or/and display the screen information in the shielded area by the display module after receiving the screen information that is added, inserted, deleted or operated and processed according to the set operation instruction by the second device.
In the device, the transmission module is further configured to receive encrypted screen information sent by the second device, and the display module does not display or displays the screen information in a blurred manner in the blocked area.
In the device, the transmission module is further configured to receive the security account sent by the second device, display the security account in a blocked area, and verify the security account, where screen information of the blocked area is a security login interface.
Fig. 4 is a schematic structural diagram of a second information interaction device according to an embodiment of the present invention, where the second device is a second apparatus including a secondary display module and a processing module, where,
the secondary display module is used for displaying the shielded screen information sent by the first device with the photosensitive screen;
and the processing module is used for processing the shielded screen information sent by the first device with the photosensitive screen.
In the device, the processing module is further configured to store or/and display screen information.
In the device, the screen information is pictures, texts or data;
when the screen information is a picture, the device further comprises a scanning module, wherein the scanning module is used for movably scanning the screen shielding object on the first device with the photosensitive screen, and splicing the scanned shielding object information to obtain the screen information.
The device also comprises a connecting module used for establishing connection with the first equipment with the photosensitive screen.
In the device, the processing module is further configured to add, insert, delete, or operate according to a set operation instruction to the screen information, and then send the processed screen information to a first device having a photosensitive screen.
In the device, the processing module is further configured to encrypt the screen information and send the encrypted screen information to a first device having a light-sensitive screen.
In the device, the screen information is a safe login interface,
and the processing module is also used for filling a safety account in the safety login interface and then sending the safety account to a first device with a photosensitive screen.
The essence of the embodiment of the present invention is that a user can extract the shielded screen information of a first device with a photosensitive screen in a shielding manner, so as to display the information on a second device, whereas the mirrorlink technology in the background art is to perform device migration on an operation interface and does not perform regional screening and extraction on the content on the interface. The embodiment of the invention can perform more differentiated scene operations, and further, the shielding equipment can also perform operation control on the shielded equipment.
Fig. 5 is a schematic diagram of a processing method of a connection module in a first device with a photosensitive screen, where the connection module is used to detect whether the first device with the photosensitive screen and a second device are already in a connected state, and the purpose of connection is mainly: judging whether the second equipment is safe, and only when the second equipment and the first equipment with the photosensitive screen are in safe connection authorization, the subsequent information interaction can be carried out, wherein the method comprises the following specific steps:
step 501, distance detection is carried out, and the distance between the first device and the second device is determined to be within a connection distance;
step 502, judging whether connection is needed, if not, executing step 503; if yes, ending;
step 503, prompting to establish connection between the second devices;
step 504, checking to determine whether the verification is successful, and if so, executing step 505; if not, returning to the step 503 for execution;
step 505, prompting the connection to be successful;
step 506, storing the connection information.
In the connection module, the connection information is stored, so that the user does not need to check the connection information in the next connection, and the user experience is facilitated.
Fig. 6 is a flowchart of a processing method of an identification module in a first device with a light-sensitive screen according to an embodiment of the present invention, where the first device with a light-sensitive screen identifies a relative object position or an area size of a second device or an opaque blocking object through a screen, the second device prepares to acquire screen information of the first device with a light-sensitive screen, and projects a covered screen area of the first device with a light-sensitive screen onto the second device, and a user can move the second device or the opaque blocking object left and right to achieve accurate positioning, where the specific process is as follows:
step 601, monitoring by a light sensing element arranged on the identification module;
step 602, the identification module performs light and shade detection on a screen area, judges whether a dark area exists, and if so, executes step 603; if not, executing step 601;
step 603, obtaining information of the light sensing element;
and step 604, acquiring position information of the shielding screen.
Specifically, a first device having a light-sensitive screen, due to its screen having light-sensitive properties, is used to identify where a second device or opaque object obscures its screen. When the light sensation element arranged in the identification module monitors that the light and shade of the screen are not consistent, the size and the position of the corresponding screen area to be intercepted can be judged, and the size and the position can be obtained by adopting the prior art, so that the position of the covering screen is positioned.
Here, the positioning of the photosensitive position may be realized by a conventional technique, for example, the technique includes: a photosensor transistor in a photosensitive pixel in a photosensitive apparatus is formed of an oxide semiconductor transistor for sensing light, the photosensitive apparatus including: a photosensitive pixel array having a plurality of photosensitive pixels arranged in rows and columns; and a plurality of gate lines arranged in a row direction and respectively supplying gate voltages to the light sensing pixels, wherein each of the light sensing pixels includes a photosensor transistor for sensing light and a switching transistor for outputting a light sensing signal from the photosensor transistor, and gates of the photosensor transistors of the light sensing pixels arranged in an arbitrary row are connected to the gate lines arranged in a row before or after the arbitrary row.
The scanning module performs mobile scanning on the first device with the photosensitive screen below based on the second device or the shielding object above, and splices the scanned shielding object information to obtain screen information. The method mainly comprises the following two steps: the method comprises the following steps that firstly, after a scanning mode is started, a light sensing element in a first device with a light sensing screen at the lower part continuously monitors a covered area, and the current blocked area is stored as a picture m every k milliseconds; and secondly, after the scanning mode is finished, splicing all the shielding areas collected in the first step.
For the first step, the currently covered area is reserved every k milliseconds, wherein the value of k is as small as possible, theoretically, the smaller the value is, the better the value is, but the value of 100 and 500 milliseconds are suggested in consideration of the splicing processing and performance problems of the second step.
For the splicing processing in the second step, the existing technology processing can be adopted, for example, splicing is realized by a stitcher class of opencv, which provides methods such as createDefault, estimatedTransform, composepanarama and the like, so that multiple pictures can be conveniently spliced to form a complete scene picture.
Fig. 7 is a flowchart of a processing method of a transmission module according to an embodiment of the present invention, in which the transmission module transmits screen information of an overlapping area with a second device or an opaque obstruction to the second device, and includes the screen information in the second device, and the transmission module mainly functions like a lens to transmit a picture of a covered area to the second device in real time, so as to be used for controlling the second device more clearly and more easily, and the method includes the following specific steps:
step 701, intercepting a sensing area of a photosensitive element in only equipment with a photosensitive screen;
step 702, splicing the induction areas to obtain screen information, and transmitting the screen information to second equipment in a picture format;
step 703, the second device prompts the user whether to capture a picture, and if so, step 704 is executed; if not, ending the process;
and 704, the second device stores the intercepted picture information.
Fig. 8 is a flowchart of a processing method of a secondary display module according to an embodiment of the present invention, where the secondary display module is a second device that performs secondary extraction and redisplay on screen information acquired from a first device having a photosensitive screen, and the secondary display module includes the specific steps of:
step 801, acquiring stored screen information, namely pictures;
step 802, receiving prompt information selected and displayed by a user;
step 803, whether picture display is carried out or not, if yes, step 804 is executed; if not, go to step 805;
step 804, continuously storing screen information, namely pictures;
step 805, receiving the information type selected and extracted by the user;
step 806, extracting information from the screen information.
In the secondary display module, the user can flexibly select required picture information, such as simple text information or digital information, besides directly capturing the picture, and then interface layout and content attribute definition are performed again through information identification and processing, and the picture information is stored and displayed on the second device.
Fig. 9 is a flowchart of a processing method of the processing module according to an embodiment of the present invention, which is used for processing screen information on the second device, so as to facilitate operations of a user. Further, the processing of screen information can be divided into two categories: and viewing and modifying. Furthermore, the phone number can be identified, the two-dimensional code can be identified, the website can be identified, and the express bill can be obtained. Further, modifying areas that may be high volume cut, recognizing a cursor of the text and modifying the text and synchronizing to the first device having a light sensitive screen, pasting cut areas, deleting cut areas, etc. In the method, security-related functions can be implemented, including hiding special area information:
step 901, whether the hidden mode is in, if yes, step 902 is executed; if not, ending;
step 902, confirming hidden screen information;
step 903, encrypting the determined screen information;
and step 904, displaying the determined screen information in a non-displaying or fuzzy mode.
The method can also realize safe login, and comprises the following steps:
step 905, judging whether the mobile terminal is in a safe login mode, if so, executing step 906; otherwise, ending;
step 906, sending prompt information for inputting the security password to the user;
step 907, receiving a security password input by a user;
step 908, verifying the security password input by the user;
step 909, display the verification result to the user.
The following explains the information interaction scene provided by the embodiment of the invention, which is mainly divided into three types of interaction scenes, namely a first type, and a first type, wherein the information of characters and pictures is intercepted and converted and displayed; the second type, supplementary input of information and covering area commands; and thirdly, the safety encryption of the equipment information.
First kind of character information and picture information intercepting and converting display
-text message interception
The method includes the steps that character data such as telephone numbers, two-dimensional codes, websites, addresses, express bill numbers, postcodes, date information and weather information displayed on first equipment with a photosensitive screen are intercepted by second equipment.
The first method is as follows: the second equipment shields the first equipment with a photosensitive screen
The user places the screen of the second device upwards on the first device with the photosensitive screen, and can displace the second device to read and recognize character information in more ranges, at the moment, character data information of an overlapped area of the screens of the two devices can be displayed on the screen of the second device, attribute information of the character information is recognized, important information such as telephone numbers and the like is screened out and displayed on the screen of the second device, and after the user confirms that the information recognized and displayed on the second device meets the requirements of the user, the user performs device touch operation, and transmission and storage of device information are completed.
The method comprises the following specific steps:
step 1, placing a second device above the first device with the photosensitive screen, and identifying the screen relative physical position of the first device with the photosensitive screen by the second device.
And 2, the first device with the photosensitive screen sends the display information of the screen overlapping region to the first device on the premise that the first device with the photosensitive screen establishes safe connection with the second device.
And 3, the second equipment stores the acquired display information in the second equipment.
And 4, the second equipment converts the stored display information into a display mode, redisplays the display information to a user in a proper format and form, and further associates an operation instruction.
And 5, the second equipment presents information or further processes and operates according to the operation instruction input by the user.
The second method comprises the following steps: an optional opaque shield shields the first device with a light sensitive screen
The user places the opaque sheltering object with any shape above the first device with the photosensitive screen, and can displace the opaque object to read and recognize more ranges of text information, at the moment, the character data information of the first device with the photosensitive screen, which is blocked by the opaque sheltering object, can be displayed on the screen of the second device, the attribute of the character information is recognized, the central information such as a telephone number and the like is screened out and displayed on the screen of the second device, and after the user confirms that the recognized and displayed information on the second device meets the requirements of the user, the user performs the operation of touching the device, and the transmission and storage of the text information of the device are completed.
The method comprises the following specific steps:
step 1, placing any opaque shielding object above a first device with a photosensitive screen, and identifying the relative physical position and shape of the opaque device with the photosensitive screen;
step 2, establishing safe connection between the first device with the photosensitive screen and the second device, wherein the first device with the photosensitive screen and the second device do not need to be touched in an overlapping mode, and the first device with the photosensitive screen transmits display information of an area, which is shielded by the opaque shielding object, to the second device;
step 3, the second equipment stores the display information acquired through the shielding of the opaque shielding object in the second equipment;
the second device converts the stored display information into a display mode, redisplays the display information to a user in a proper format and form, and further associates an operation instruction.
And 5, the second equipment presents information or further processes and operates according to the operation instruction input by the user.
-picture truncation
The picture capture means that the second device directly captures information displayed on the first device with the photosensitive screen in a screenshot mode and stores the information in a picture format, and a user can check screen picture content of an overlapping area of the second device with the first device with the photosensitive screen through the second device so as to determine the area position of the captured picture, and then the captured picture is stored as a picture and is separated from the first device with the photosensitive screen to be directly displayed.
Mode one, the second equipment shelters from the first equipment with photosensitive screen
Step 1, placing a second device above the first device with the photosensitive screen, and identifying the screen relative physical position of the first device with the photosensitive screen by the second device.
And 2, on the premise that the first device with the photosensitive screen establishes safe connection with the second device, the first device with the photosensitive screen sends the display information of the screen overlapping area to the first device in a screenshot mode.
And 3, the second equipment stores the acquired picture information in the second equipment.
And 4, the second equipment displays the stored picture information to the user.
Mode two, an arbitrary opaque shield shields the first device with a light sensitive screen
Step 1, placing any opaque shielding object above a first device with a photosensitive screen, and identifying the relative physical position and shape of the opaque device with the photosensitive screen;
step 2, establishing safe connection between the first device with the photosensitive screen and the second device, wherein the first device with the photosensitive screen and the second device do not need to be touched in an overlapping mode, and the first device with the photosensitive screen transmits display information of an area, which is shielded by the opaque shielding object, to the second device in a screenshot mode;
step 3, the second equipment stores the acquired picture information in the second equipment;
and 4, the second equipment displays the stored picture information to the user.
Second, supplementary input of information and cover area instruction
The supplementary input of the information and the instruction for covering the area refer to that after the second device acquires the character information on the first photosensitive screen, the supplementary input and instruction processing such as highlighting, deleting, copying and storing of the information on the first photosensitive screen can be realized through the second device according to the input instruction of the user on the second device.
The method comprises the following specific steps:
step 1, placing a second device or an opaque shelter above a first device with a photosensitive screen, wherein the first device with the photosensitive screen identifies the relative physical position of the shielded screen;
and 2, the first device with the photosensitive screen sends the display information of the screen overlapping region to the first device on the premise that the first device with the photosensitive screen establishes safe connection with the second device.
Step 3, the second equipment prompts a user with information processing instructions of editing, deleting, highlighting, storing, copying and the like;
and 4, processing the instruction of the user on the display information of the first device with the photosensitive screen by the second device.
Third, secure encryption of device information
The safe encryption of the information means that a user shields the content which is expected to be safely encrypted on the screen of the first device with the photosensitive screen, so that the intelligent hiding or locking of the content of a shielded area is realized; on the other hand, the first device with the photosensitive screen is shielded through different devices, and after the user account numbers of the different devices are successfully matched with the account number on the first device with the photosensitive screen, the safe login of different accounts is realized.
The method comprises the following specific steps:
step 1, placing a second device or an opaque shelter above a first device with a photosensitive screen, wherein the first device with the photosensitive screen identifies the relative physical position of the shielded screen;
step 2, the first equipment with a photosensitive screen intelligently encrypts, hides or locks the content of the shielded area;
in the step 2', the information attribute of the shielded area is matched with the information stored in the second device, so that different account identities are recognized.
The following embodiments are to be construed as
The first embodiment is as follows: directly sheltered from through smart device
Fig. 10 is a schematic view of an example of a device for shielding a first photosensitive screen according to an embodiment of the present invention, where as shown in the figure, a second device used by a user is a smart watch with a screen, the first photosensitive screen is directly shielded, and acquired screen information is displayed on the smart watch.
Fig. 11 is a schematic view of an example of a second device for shielding a first device with a photosensitive screen according to an embodiment of the present invention, where as shown in the figure, the second device used by a user is a mobile terminal with a screen, the first device with the photosensitive screen is directly shielded, and acquired screen information is displayed on the mobile terminal.
Fig. 12 is a schematic diagram of an example of a device for shielding a first photosensitive screen according to an embodiment of the present invention, where as shown in the drawing, the second device used by a user is a smart watch with a screen, a mobile terminal, and a smart tablet device, the first photosensitive screen device is a device with an electronic large screen, the first photosensitive screen device is directly shielded, and the acquired screen information is displayed on the smart watch, the mobile terminal, or the smart tablet device.
Example two: by opaque obscurations of arbitrary shape
A user uses any opaque shielding object beside to shield a first device with a photosensitive screen, acquired information is indirectly displayed on a second device, and the second device is an intelligent device. As shown in fig. 13, 14 and 15, fig. 13 is a schematic view of an example that a paper card is used to shield a first device having a photosensitive screen and screen information is displayed on an intelligent device according to an embodiment of the present invention; fig. 14 is a schematic diagram illustrating an example of displaying screen information on a smart watch by using a pen to shield a first device having a light-sensitive screen according to an embodiment of the present invention; fig. 15 is a schematic diagram of an example that a first device with a photosensitive screen is shielded by a hand and screen information is displayed on an intelligent device according to an embodiment of the present invention.
Example three: embodiments of identifying content and identified operational effects
Taking a smart phone as an example of the second device, fig. 16 is a schematic view of an operation entry of the smart phone according to the embodiment of the present invention.
Example four: embodiments of intercepting and processing text messages or pictures
The first equipment and the second equipment that have sensitization screen that have under current be in safe environment specifically realize as:
step 1, pairing and connecting a first device with a photosensitive screen and a second device, and safely connecting the first device with the photosensitive screen and the second device, wherein the first device with the photosensitive screen allows the second device to obtain information of the first device and the second device;
step 2, overlapping and placing a second device or an opaque shielding object above the first device with the photosensitive screen, wherein a user overlaps and places the second device or the opaque shielding object above the first device with the photosensitive screen;
step 3, when recognizing the text information, the user can move the first equipment with the photosensitive screen or the opaque shielding object, read the text information on the first equipment with the photosensitive screen one by one, and when capturing the picture, the second equipment obtains the picture on the shielded screen on the first equipment with the photosensitive screen;
step 4, the second equipment pops up a confirmation interface, the user finally confirms the operation of obtaining the information, and the obtained information is stored or operated;
and 5, checking the information, wherein the first device with the photosensitive screen is relatively large and inconvenient to move and carry, so that a user only needs to carry the second device when the first device with the photosensitive screen is far away from the scene of the second device, and the intercepted information is directly checked from the screen of the second device.
Example 1
As shown in fig. 17, fig. 17 is a schematic diagram of an example process of intercepting text messages according to an embodiment of the present invention. In this example, the second equipment of discernment express delivery order number is intelligent wrist-watch, first equipment that has the sensitization screen is the smart mobile phone, an express delivery order number information has been shown on user's the smart mobile phone, overlap the region of placing at the smart mobile phone screen display express delivery order number with the smart watch that has already paired, to the characters region that smart watch can not cover, the user can carry out the discernment of characters one by one through displacement smart watch, finally integrate and show on smart watch, the user only can go to accomplish the action of getting the express delivery without carrying smart mobile phone and carrying smart watch.
Example 2
As shown in fig. 18, fig. 18 is a schematic view of an example process of recognizing and capturing a picture according to an embodiment of the present invention. In the figure, the second device is a smart phone, the first device with the photosensitive screen is a smart tablet computer, the screen of the smart tablet computer is large and not easy to carry, the user can place the smart phone above the smart tablet computer, the smart phone is moved to position a screen area needing to be intercepted, the smart tablet computer identifies the screen area of the smart phone above the smart tablet computer, after the user touches the back of the smart phone to the smart tablet computer, photos needed by the user are directly intercepted, the images such as advertisements are in the image area, the images are transferred and stored on the smart phone, the user only needs to carry the smart phone, and the user can take notes and check the image content.
Example 3
As shown in fig. 19, fig. 19 is a schematic diagram illustrating an example process of identifying address information according to an embodiment of the present invention. In the map, the second device is an intelligent mobile terminal, the first device with the photosensitive screen is a television display screen, public text information is displayed in an advertisement area of the television display screen, a user holds the second device and the intelligent mobile terminal by hand, and touches an address display area on the television display screen by light touch, so that the contact information can be quickly acquired, specific positions can be searched in the map of the intelligent mobile terminal, and the purpose of quick checking is achieved.
Example 4
As shown in fig. 20, fig. 20 is a schematic view of an example process of identifying a two-dimensional code according to an embodiment of the present invention, in the figure, the second device is an intelligent terminal device, the first device with a light-sensitive screen is a smart phone or a tablet computer, two-dimensional code information is displayed on the screen of the smart phone or the tablet computer, the second device is used to scan a two-dimensional code area, information of the two-dimensional code can be read, and the two-dimensional code area is linked to a two-dimensional code related link, for example, a page for transfer payment can be directly opened, so that payment efficiency is improved.
Example 5
As shown in fig. 21, fig. 21 is a schematic diagram of an example process of identifying website information according to an embodiment of the present invention, in the diagram, the second device is a smart phone, the first device with a light-sensitive screen is a computer display, a text picture and website information are displayed in the screen of the computer display, the user holds the smart phone to cover the website information in the computer display screen, and the smart phone can obtain the website information and can select to directly open the website in the smart phone or store the website as a text.
Example 6
As shown in fig. 22, fig. 22 is a schematic view of an example process of identifying phone number information according to an embodiment of the present invention, in which the second device is a smart phone, the first device having a light-sensitive screen is a computer monitor, a screen of the computer monitor displays content including phone numbers, the second device is held by a user to cover or scan a phone number area in the screen of the computer monitor, and the second device obtains the phone number covering or scanning the area to prompt the user whether to save as a phone or dial a phone.
Example five: embodiment of supplementary input and instruction of text information
In this embodiment, the user touches different information areas in the first device with the photosensitive screen with the second device, and the second device prompts different information to realize different information processing functions. The specific implementation process comprises the following steps:
step 1, pairing and connecting a first device with a photosensitive screen and a second device, and safely connecting the first device with the photosensitive screen and the second device, wherein the first device with the photosensitive screen allows the second device to obtain and process information of the first device and the second device;
step 2, overlapping and placing a second device or an opaque shielding object above the first device with the photosensitive screen, wherein a user overlaps and places the second device or the opaque shielding object above the first device with the photosensitive screen;
step 3, when recognizing the text information, the user can move the first equipment with the photosensitive screen or the opaque shielding object, read the text information on the first equipment with the photosensitive screen one by one, and when capturing the picture, the second equipment obtains the picture on the shielded screen on the first equipment with the photosensitive screen;
step 4, the user confirms the operation of obtaining information;
and 5, the second equipment acquires the information on the first equipment with the photosensitive screen, pops up an operation instruction interface, and the user performs corresponding instruction operation of editing the information to modify the information on the first equipment with the photosensitive screen and store the information on the first equipment with the photosensitive screen.
The method can process the problem that the first equipment with the photosensitive screen is large and inconvenient to input, and a user can quickly process the information of the first equipment with the photosensitive screen on the second equipment.
Example 1
As shown in fig. 23, fig. 23 is a schematic diagram of an example process of identifying a cursor and editing a text according to an embodiment of the present invention, where as shown in the figure, a first device having a photosensitive screen is an intelligent device with a large electronic screen, and is large in area and difficult to input, and a second device, a user of the smartphone, uses the smartphone to swipe the large electronic screen, obtains local text information on the large electronic screen, identifies the position of the cursor, and then can quickly input and edit information on the large electronic screen on the smartphone, and the editing also includes deleting the text. Specifically, the smart phone is shielded from a cursor on the electronic large screen, the smart phone displays whether characters need to be inserted quickly, a user inputs the characters on the smart phone, and the input characters are inserted into a first screen with a photosensitive screen.
Example 2
As shown in fig. 24, fig. 24 is a schematic diagram of an example process of editing a highlight region in a text according to an embodiment of the present invention, where as shown in the figure, a first device having a photosensitive screen is an electronic large-screen smart device, which has a large area and is not easy to input, and a second device is a smart phone held by a user. After the smart phone scans the electronic large screen lightly, the area covered by the smart phone is automatically highlighted.
Example 3
As shown in fig. 25, fig. 25 is a schematic view of an example process of copying and pasting information according to an embodiment of the present invention, where a first device having a photosensitive screen is an electronic large-screen smart device, which has a large area and is not easy to input, and a second device is a smart phone held by a user. And (3) the electronic large screen is lightly swept by the smart phone, the area covered by the screen of the smart phone is locked into the copied picture area, the smart phone shields other areas of the electronic large screen or other equipment again, and the copied picture area can be selected to be pasted.
Example 4
As shown in fig. 26, fig. 26 is a schematic diagram of an example process of deleting region information according to an embodiment of the present invention, where a first device having a photosensitive screen is an electronic large-screen smart device, which has a large area and is not easy to input, and a second device is a smart phone held by a user. And (3) a user holds the smart phone by hand, the electronic large screen is lightly swept by the smart phone, the area covered by the screen of the smart phone is locked into the deleted picture area, and the content of the area is deleted after the user confirms.
Example six: encryption interaction method for information security
And the user touches the screen area of the first device with the photosensitive screen by using the second device or the opaque shielding object, the information of the screen area is locked or hidden, the first device with the photosensitive screen identifies the information attribute of the second device, and the account identity login is operated.
The specific implementation manner of the encryption process is as follows:
step 1, placing an opaque shelter on a screen of a first device with a photosensitive screen;
step 2, the user moves the opaque sheltering object to shelter the information which is expected to be encrypted;
step 3, confirming the encryption or locking operation by the user;
and 4, hiding or locking partial information of the first device with the photosensitive screen.
The specific implementation mode of the safe login account is as follows:
step 1, a first device with a light sensitive screen records different account identities, and a plurality of different devices establish secure connection with the first device with the light sensitive screen;
step 2, overlapping a certain second device which is connected safely on a first device with a photosensitive screen;
step 3, the user can move the second device or the opaque shelter, and the password area displayed on the first device with the photosensitive screen is matched with the password information input on the second device;
step 4, the user confirms that the user account is successfully matched;
and 5, successfully logging in the first device with the photosensitive screen by the personal safety account.
Example 1
As shown in fig. 27, fig. 27 is a schematic process diagram of an example of a secure projection screen according to an embodiment of the present invention. In the figure, the first device with the photosensitive screen is a mobile phone, and the user projects and displays the content of the mobile phone on a television screen, but the personal mobile phone message notification of the user belongs to personal privacy and does not want to be projected, and at the moment, the user blocks the message notification area of the mobile phone, and the area is not projected.
Example 2
As shown in fig. 28, fig. 28 is a schematic diagram of an example process of encrypting private content according to an embodiment of the present invention. In the figure, the first device with the photosensitive screen is a mobile phone, and a user can directly shield an information area which the user wants to shield, so that the content of the shielded area is hidden or blurred, encryption is realized, and the information is not seen by others.
Example 3
As shown in fig. 29, fig. 29 is a schematic diagram of an example process of securely logging in a personal account according to an embodiment of the present invention. In the figure, the first device with the photosensitive screen is a television, different existing account login entries are displayed, different users can use own mobile phone devices to shield account areas of the respective login entries, and when passwords input by the users on the personal mobile phone devices are consistent with records recorded on the television, safe login is achieved.
The method, the system and the device provided by the embodiment of the invention realize the information transmission and processing between screens with special natural sizes, the information comprises character recognition and picture interception, the processing of character information and picture information, the safe encryption of character or picture information, the safe login of an account and the like, the interactive mode of encrypting the information is realized, and the touch type interaction of equipment is very natural. The user can quickly obtain local fragment information wanted by the user only by lightly placing the mobile and carried equipment on the screen of another piece of equipment which is inconvenient to move, and can process information of a large screen through a small screen or realize safe encryption of the information, so that quick response of the information between the two pieces of equipment is realized, and great convenience is brought to the life of the user.
The objects, technical solutions and advantages of the present invention have been described in further detail with reference to the preferred embodiments, it should be understood that the above description is only illustrative of the preferred embodiments of the present invention, and should not be construed as limiting the present invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (15)

1. A method for information interaction, comprising:
the first device with a light-sensitive screen recognizes an opaque obstruction or recognizes a second device;
the first equipment with a photosensitive screen transmits the shielded screen information to the second equipment for processing;
the second device processing includes: after adding, inserting, deleting or operating according to a set operation instruction, sending the processed screen information to a first device with a photosensitive screen for storage or/and display in the shielded area;
the screen information is data, text or pictures;
when the screen information is a picture, the second device processes including: and intercepting the covered pictures, and then splicing.
2. The method of claim 1, prior to said identifying, further comprising:
the first device with the photosensitive screen is in communication connection with the second device.
3. The method of claim 1, wherein the screen information is not displayed or obscured in the occluded area by the first device having a light-sensitive screen after being encrypted by the second device.
4. The method of claim 1, wherein the screen information is a secure login interface, and the second device process comprises:
and after filling a safety account in the safety login interface, sending the safety account to a first device with a photosensitive screen for verification and displaying the safety account in the shielding area.
5. A system for information interaction, the system comprising: a first device having a photosensitive screen and a second device, wherein,
the device comprises a first device with a photosensitive screen, a second device and a control module, wherein the first device is used for identifying an opaque shelter or identifying the second device and transmitting the information of the sheltered screen to the second device;
a second device for processing the screen information;
the device is also used for adding, inserting and deleting the screen information or operating according to a set operation instruction, and then sending the processed screen information to a first device with a photosensitive screen for storage or/and display in the shielded area;
the first device with the photosensitive screen is further used for storing or/and displaying the processed screen information in the shielded area after receiving the processed screen information;
the screen information is data, text or pictures;
and when the screen information is a picture, the second equipment is also used for intercepting the covered picture and then splicing the intercepted picture.
6. The system of claim 5, wherein the first device having a light sensitive screen is further configured to establish a connection with the second device.
7. The system of claim 5, wherein the second device is further configured to encrypt the screen information and send the encrypted screen information to the first device having the photosensitive screen;
the first device with a light-sensitive screen is also used for not displaying or displaying the screen information in a fuzzy mode in the shielded area.
8. The system of claim 5, wherein the screen information is a secure login interface;
the second device is further used for sending the security login interface to a first device with a photosensitive screen for verification after a security account is filled in the security login interface, and displaying the security login interface in the shielding area;
the first device with the photosensitive screen is further used for verifying the received safe account number and displaying the safe account number in the shielding area.
9. An information interaction apparatus using the method of claim 1, comprising: an identification module and a transmission module, wherein,
the identification module is used for identifying an opaque shelter or identifying second equipment;
the transmission module is used for transmitting the shielded screen information to the second equipment;
and the transmission module is also used for storing or/and displaying the screen information in the shielded area by the display module after receiving the screen information which is added, inserted, deleted or operated and processed according to the set operation instruction by the second equipment.
10. The apparatus of claim 9, further comprising a connection module to connect with a second device.
11. The apparatus of claim 9, wherein the transmission module is further configured to receive encrypted screen information sent by the second device, and the screen information is not displayed or obscured in the occluded area by the display module.
12. The apparatus of claim 10, wherein the transmission module is further configured to receive the secured account sent by the second device, display the secured account in an occluded area, and verify the secured account, where screen information of the occluded area is a secure login interface.
13. An information interaction device, comprising: a secondary display module and a processing module, wherein,
the secondary display module is used for displaying the shielded screen information sent by the first device with the photosensitive screen;
the processing module is used for processing the shielded screen information sent by the first device with the photosensitive screen;
the processing module is further used for adding, inserting, deleting or operating the screen information according to a set operation instruction, and then sending the processed screen information to the first device with the photosensitive screen;
the screen information is pictures, texts or data;
when the screen information is a picture, the device further comprises a scanning module, wherein the scanning module is used for movably scanning the screen shielding object of the first device with the photosensitive screen, and splicing the scanned shielding object information to obtain the screen information.
14. The apparatus of claim 13, further comprising a connection module to establish a connection with a first device having a light sensitive screen.
15. The apparatus of claim 14, wherein the processing module is further configured to encrypt the screen information and send the encrypted screen information to the first device having the photosensitive screen;
or, when the screen information is a security login interface, the processing module is further configured to fill a security account in the security login interface and send the security account to the first device with the photosensitive screen.
CN201710790437.3A 2017-09-05 2017-09-05 Information interaction method, system and device Active CN107515717B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710790437.3A CN107515717B (en) 2017-09-05 2017-09-05 Information interaction method, system and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710790437.3A CN107515717B (en) 2017-09-05 2017-09-05 Information interaction method, system and device

Publications (2)

Publication Number Publication Date
CN107515717A CN107515717A (en) 2017-12-26
CN107515717B true CN107515717B (en) 2021-07-09

Family

ID=60724936

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710790437.3A Active CN107515717B (en) 2017-09-05 2017-09-05 Information interaction method, system and device

Country Status (1)

Country Link
CN (1) CN107515717B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11281334B2 (en) * 2018-11-30 2022-03-22 Samsung Electronics Co., Ltd. Interaction method, system, and device for information
CN113312536B (en) * 2021-05-28 2022-11-08 中铁十一局集团第五工程有限公司 Engineering survey intelligent management control platform
CN113709307A (en) * 2021-08-31 2021-11-26 维沃移动通信有限公司 Message display method and device and electronic equipment
CN113608647B (en) * 2021-10-11 2022-01-04 广东新空电子科技股份有限公司 Auxiliary memory note covering method and device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024508A (en) * 2011-09-20 2013-04-03 Lg电子株式会社 Digital system and method of processing service data thereof
KR20170090102A (en) * 2016-01-28 2017-08-07 엘지전자 주식회사 Digital device and method for controlling the same

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101334725B (en) * 2007-06-29 2011-05-25 联想(北京)有限公司 Method and device for enhancing windows display performance
CN106843692B (en) * 2012-08-30 2021-05-18 中兴通讯股份有限公司 Touch screen character display method and device
CN103729096A (en) * 2013-12-25 2014-04-16 京东方科技集团股份有限公司 Interaction recognition system and display unit provided with same
CN105808040B (en) * 2014-12-30 2019-01-15 华为终端(东莞)有限公司 A kind of display methods and mobile terminal of graphic user interface

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024508A (en) * 2011-09-20 2013-04-03 Lg电子株式会社 Digital system and method of processing service data thereof
KR20170090102A (en) * 2016-01-28 2017-08-07 엘지전자 주식회사 Digital device and method for controlling the same

Also Published As

Publication number Publication date
CN107515717A (en) 2017-12-26

Similar Documents

Publication Publication Date Title
WO2020248955A1 (en) Content sharing method and electronic device
CN107515717B (en) Information interaction method, system and device
US9652704B2 (en) Method of providing content transmission service by using printed matter
TWI673679B (en) Method,apparatus and computer-readable storage media for user interface
US9826143B2 (en) Mobile terminal and control method thereof
US20190235748A1 (en) Mobile terminal, and method for operating same
CN104283876A (en) Operation authorization method and device
EP2696592A1 (en) Portable terminal device and method for operating the same
CN105022581A (en) Mobile terminal and controlling method thereof
CN113191117B (en) Editing method, device and equipment of electronic document and storage medium
US11004163B2 (en) Terminal-implemented method, server-implemented method and terminal for acquiring certification document
US10735578B2 (en) Method for unlocking a mobile terminal, devices using the same, and computer-readable storage media encoding the same
US20200125707A1 (en) Methods, mechanisms, and computer-readable storage media for unlocking applications on a mobile terminal with a sliding module
CN106155494A (en) Mobile terminal and control method thereof
US20170038922A1 (en) Mobile terminal and method for controlling the same
CN111125601A (en) File transmission method, device, terminal, server and storage medium
CN114371963A (en) Fault detection method and electronic terminal
CN112989299A (en) Interactive identity recognition method, system, device and medium
US10699145B1 (en) Systems and methods for augmented reality assisted form data capture
CN107798230A (en) Terminal control method, device, terminal and computer-readable recording medium
US11281334B2 (en) Interaction method, system, and device for information
KR102421850B1 (en) Terminal device and control method
CN107192937A (en) Fingerprint chip detecting method and device, electronic equipment and storage medium
KR102292595B1 (en) Apparatus for recognizing watermark using image integrating QR code and watermark and method thereof
KR20150085603A (en) Glass device and operation method thereof

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant