CN113687760A - Interactive screen based on stacked perception interactive module, and method and system thereof - Google Patents

Interactive screen based on stacked perception interactive module, and method and system thereof Download PDF

Info

Publication number
CN113687760A
CN113687760A CN202110950435.2A CN202110950435A CN113687760A CN 113687760 A CN113687760 A CN 113687760A CN 202110950435 A CN202110950435 A CN 202110950435A CN 113687760 A CN113687760 A CN 113687760A
Authority
CN
China
Prior art keywords
content
screen
information
stacked
content information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110950435.2A
Other languages
Chinese (zh)
Inventor
陈闻杰
范圣韬
牛康宇
郭培扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
East China Normal University
Original Assignee
East China Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by East China Normal University filed Critical East China Normal University
Priority to CN202110950435.2A priority Critical patent/CN113687760A/en
Publication of CN113687760A publication Critical patent/CN113687760A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application provides an interactive screen based on a stacked perception interactive module, and a method and a system thereof, comprising; the stacked sensing interaction module comprises a plurality of NFC sensing antenna units which are arranged in a stacked mode in a transverse and longitudinal staggered mode and used for sensing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the stacked sensing interaction module, acquiring equipment state information of the mobile equipment after triggering touch response and extracting touch position information on a corresponding screen; the control module is used for analyzing the first cloud data file in the equipment state information to obtain first content information currently displayed by the corresponding mobile equipment; and identifying the currently displayed second content information of the touch position on the corresponding screen according to the touch position information. The application can greatly enrich the interaction between the screen and the mobile device in the variety of scenes, breaks through the limitation of application of two technical fields, realizes innovation and fusion, improves the popularization degree of the NFC technology, and the limitation of the touch screen technology at present.

Description

Interactive screen based on stacked perception interactive module, and method and system thereof
Technical Field
The invention relates to the technical field of NFC communication interaction, in particular to an interactive screen based on a stacked perception interaction module, and a method and a system thereof.
Background
The existing touch interactive technology is represented by the NFC technology, which is developed from the radio frequency technology, and the application modes of the NFC technology are card mode, card reader mode, and peer-to-peer mode. The card simulation mode is the most common, and is mainly used in various scenes needing to use an IC radio frequency card, and the smart phone can be simulated into a card recorded with radio frequency signals according to corresponding protocol contents to obtain services under corresponding scenes, such as various company access controls, subway gates, pos machine payment and the like. And the card reader mode is used for controlling the mobile phone to continuously scan by using a specific radio frequency, and after corresponding label information is scanned, a coil in the label can generate current and return recorded related information to the mobile phone. The corresponding labels are divided into a passive label and an active label, and the common application scene is bank card management app and the anti-counterfeiting function of valuables. In the peer-to-peer mode, the information sending and receiving functions of the NFC module are fully utilized, and two devices with NFC functions can be linked to realize peer-to-peer data transmission. This mode can be used for two smart phones to touch exchange data.
The above three modes are commonly used in the NFC technology, and currently, the most common mode in the market belongs to a card simulation mode, and the public system service accessed by each large manufacturer actually brings convenience to consumers. But the popularity of NFC technology has decreased dramatically except in limited scenarios. The core reason is that a scanning device with a radio frequency identification function is required to interact with a mobile phone simulated card in a card simulation mode state, such as a POS (point of sale) machine and a subway gate, so that very high hardware requirements are provided for interaction. The card reader mode and the peer-to-peer mode are mainly subject to software requirements, for example, you need to identify a certain type of tag (for example, bank card of a bank) and you must download a corresponding app (bank app), and the peer-to-peer mode is also performed when you need to use a certain software.
In addition, the existing mainstream touch screen technology can better realize the interaction process of the touch sliding operation of the mobile phone, but no matter from technical details and application modes, the existing touch screen can only identify whether the touch action of a foreign object (such as a finger and an induction pen) occurs or not, but cannot identify the information of the foreign object, and cannot generate any information communication with the interaction foreign object, such as a smart phone, a smart watch and the like. Colloquially, the touch screen only knows where it has been touched, whether it is sliding left or right. However, it is not known who touched the object, and the touched object is in what state, and it cannot transmit more information to the object, and only the change is displayed on the screen. This is not sufficient in the existing application environment.
Based on the above problem, the application provides one kind and will allow the user to use wearing formula equipment such as smart mobile phone, smart watch, intelligent bracelet to carry out touching formula interaction with the screen based on the NFC technique to can obtain different interaction results according to touching different contents on the screen, and break through the limitation on two technical field, realize the innovation and merge, improve NFC technique popularity, and the present limitation of touch screen technique.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, it is an object of the present application to provide an interactive screen based on a stacked perceptual interactive module, and a method and system thereof, to solve at least one problem existing in the prior art.
To achieve the above and other related objects, the present application provides an interactive screen based on a stacked perceptual interactive module for interacting with a mobile device with an NFC module, the screen comprising: the stacked sensing interaction module comprises a plurality of NFC sensing antenna units which are arranged in a stacked mode in a transverse and longitudinal staggered mode and used for sensing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the stacked sensing interaction module, acquiring equipment state information of the mobile equipment after triggering touch response and extracting touch position information on a corresponding screen; the control module is used for analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable the stacked perception interaction module to broadcast a second cloud data file capable of acquiring the second content from the cloud so as to enable the mobile device to acquire and display the second content.
In an embodiment of the present application, the stacked perceptual-interaction module includes: the NFC induction antenna units are transversely and longitudinally staggered and stacked; the system comprises a screen, a plurality of first NFC induction antennas, a plurality of second NFC induction antennas and a plurality of first NFC induction antennas, wherein the first NFC induction antennas are transversely arranged and the second NFC induction antennas are longitudinally arranged; the NFC sensing antenna unit is used for determining the horizontal and vertical coordinate position of the strongest signal strength when the touch response is triggered according to the signal strength superposed by the horizontal signal strength sensed by the first NFC sensing antenna and the longitudinal signal strength sensed by the second NFC sensing antenna and the corresponding signal strength gradient, and the horizontal and vertical coordinate position is used as touch coordinate information; the control module is further configured to modulate a second cloud data file, which enables the second content to be acquired by the cloud, on the NFC sensing antenna unit, and enable the NFC sensing antenna unit to broadcast the second content to the outside, so that the mobile device can acquire and display the second content.
In an embodiment of the application, the stacked sensing interaction module adjusts the sensing accuracy by adjusting a overlapping density of the first NFC sensing antenna arranged in the transverse direction and the second NFC sensing antenna arranged in the longitudinal direction.
In an embodiment of the present application, the device status information further includes: any one or more of the combination of a device serial number, a device model, a device Identity (ID), a device name, a Bluetooth device name, a timestamp and an interaction flow ID.
In an embodiment of the present application, the first cloud data file and the second cloud data file are structural bodies of structured boot data, and include: jump path information of the first content or the second content and first content information or second content information containing key information of the first content or the second content can be acquired from the cloud link.
In an embodiment of the present application, the first content and the second content include: application content or data; wherein the data comprises: any one of images, audio, video, and files; the first content information and the second content information include: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
In an embodiment of the application, when the first content has a higher priority, the first content currently displayed by the corresponding mobile device is acquired from the cloud according to the jump path information corresponding to the first content obtained by analyzing the first cloud data file, and the first content is displayed on the screen; or when the second content has higher priority, generating a second cloud data file capable of acquiring the second content by the cloud according to the second content information; and broadcasting the second cloud data file through the stacked sensing interaction module, so that the mobile device receives the second content and analyzes the second cloud data file to obtain the second content currently displayed on the corresponding screen touch position from the cloud.
In an embodiment of the application, the determining the priority of the first content information and the second content information based on the touch position includes any one or more of the following combinations: the priority of the second content information corresponding to the default setting screen is the highest, so that the mobile equipment can only acquire and display the second content; or, the priority of the first content information corresponding to the mobile device may be set to be the highest by default, so that only screen acquisition is realized and the first content is displayed; when the first content information and the second content information are both application program content or are both data, the priority of the first content information is higher; when the first content information or the second content information is empty, the priority is the lowest; the priority of the first content information and the second content information for the application program content is higher than that for the data.
In order to achieve the above objects and other related objects, the present application provides an interaction method applied to an interactive screen based on a stacked perception interaction module, the method comprising; the method comprises the steps of inducing a magnetic field signal broadcasted by the mobile equipment in real time to determine the relative position between the mobile equipment and the magnetic field signal, acquiring equipment state information of the mobile equipment after triggering touch response, and extracting touch position information on a corresponding screen; analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the priority of the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable a stacked perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
To achieve the above and other related objects, the present application provides an interactive system, comprising: interactive screens as described above, and mobile devices; the mobile device is provided with an NFC module and is loaded with a plurality of application programs or applets.
In summary, the present application provides an interactive screen based on a stacked sensing interaction module, and a method and a system thereof, which have the following advantages:
this application will allow the user to use smart mobile phone, smart watch, wearable equipment such as intelligent bracelet to carry out the touching formula with the screen and are interactive based on the NFC technique. The method can realize that the screen can be touched by hardware such as a mobile phone, can know the state of the mobile phone, can transmit related information, and can obtain different interaction results according to different contents on the touch screen. Interaction under multiple scenes between the screen and the mobile device can be greatly enriched, the limitation of application of two technical fields is broken through, innovation and fusion are realized, the popularization degree of the NFC technology is improved, and the current limitation of the touch screen technology is limited.
Drawings
Fig. 1 is a schematic structural diagram of an interactive system applying an interactive screen according to an embodiment of the present application.
Fig. 2 is a schematic diagram illustrating a structure of a layered perceptual interaction module according to an embodiment of the present application.
Fig. 3 is a schematic view illustrating a scene of an interactive system applying an interactive screen according to an embodiment of the present application.
Fig. 4 is a flowchart illustrating an interaction method applied to an interactive screen according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present application is provided by way of specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure herein. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings so that those skilled in the art to which the present application pertains can easily carry out the present application. The present application may be embodied in many different forms and is not limited to the embodiments described herein.
In order to clearly explain the present application, components that are not related to the description are omitted, and the same reference numerals are given to the same or similar components throughout the specification.
Throughout the specification, when a component is referred to as being "connected" to another component, this includes not only the case of being "directly connected" but also the case of being "indirectly connected" with another element interposed therebetween. In addition, when a component is referred to as "including" a certain constituent element, unless otherwise stated, it means that the component may include other constituent elements, without excluding other constituent elements.
When an element is referred to as being "on" another element, it can be directly on the other element, or intervening elements may also be present. When a component is referred to as being "directly on" another component, there are no intervening components present.
In addition to the reason of the low popularity of the NFC technology, there is a limitation in the application of the touch screen technology.
Touch screen technology is currently divided into two types, namely a resistance screen and a capacitance screen. The resistance screen is a touch screen technology which realizes accurate positioning by utilizing resistance change caused by concave-convex deformation of the screen along with the change of pressure on the surface of the touch screen; the capacitive touch screen is formed by sticking a layer of transparent special metal conductive substance on the surface of glass. When a finger touches the metal layer, the capacitance of the electric shock changes, so that the frequency of an oscillator connected with the electric shock changes, and the touch position can be determined and corresponding feedback can be generated by measuring the frequency change.
The existing mainstream touch screen technology can better realize the interaction process of the touch sliding operation of the mobile phone, but no matter from technical details and application modes, the existing touch screen can only identify whether the touch action of a foreign object (such as a finger and an induction pen) occurs or not, but cannot identify foreign object information (such as mobile phone information), and cannot generate any information communication with the interaction foreign object.
Aiming at the application limitation of an NFC technology and a touch screen technology, the application innovatively provides an interactive screen based on a stacked perception interaction module, and a method and a system thereof. The method can realize that the screen can be touched by hardware such as a mobile phone, can know the state of the mobile phone, can transmit related information, and can obtain different interaction results according to different contents on the touch screen.
Briefly, the interactive screen of the present application can mainly realize the following three functions:
1) the state in the mobile equipment can be identified and the relevant information transmitted by the mobile equipment can be received when the mobile equipment is touched;
2) when the touch occurs, the screen can identify the corresponding position touched by the mobile equipment and the content information of the corresponding position;
3) the screen can send the content information of the touched point to the mobile device at the moment the touch occurs.
In conclusion, the application can greatly enrich the interaction between the screen and the mobile device in various scenes, breaks through the application limitation of the two technical fields, realizes innovation and fusion, and improves the popularization of the NFC technology and the current limitation of the touch screen technology.
Fig. 1 is a schematic structural diagram of an interactive system of an application interactive screen according to an embodiment of the present application. As shown, the screen 100 is used for interacting with a mobile device 200 with an NFC module, and the screen 100 includes;
the stacked sensing interaction module 110 includes a plurality of NFC sensing antenna units arranged in a stacked manner in a transverse and longitudinal staggered manner, and is configured to sense a magnetic field signal broadcast by the mobile device 200 in real time to determine a relative position with the mobile device 200, acquire device state information of the mobile device 200 after triggering a touch response, and extract touch position information on the corresponding screen 100.
Preferably, the device status information includes, but is not limited to: device serial number, device model, device identity ID, device name, bluetooth device name, timestamp, and interaction flow ID, etc. are used to identify the configuration information of the interaction and the mobile device 200 itself. The device status information is mainly used to confirm identity information of the mobile device 200, establish interaction, track interaction device status information, record interaction flow, and the like, and also can provide other communication connection paths between the mobile device 200 and the screen 100.
In this application, the mobile device 200 is provided with an NFC module. Preferably, the mobile device 200 also has a number of commonly used applications or applets loaded thereon; preferably, the mobile device 200 includes: smart mobile phone, notebook computer, PAD, intelligent wrist-watch, intelligent glasses, display screen all-in-one, smart TV, intelligent stereo set, intelligent robot etc..
The stacked sensing interaction module 110 of the present application may precisely determine the relative position with the mobile device 200 through the sensed signal by setting the NFC sensing antenna units including a plurality of NFC sensing antenna units arranged in a staggered manner in the horizontal and vertical directions.
Secondly, the triggering conditions of the touch response include: when the mobile device approaches the screen to a certain distance or touches the screen. Since the NFC module or device is disposed between the screen 100 and the mobile device 200, the touch between the screen 100 and the mobile device 200 may be a physical real touch or a virtual touch that can achieve a touch response when reaching a certain sensing distance. Specific embodiments are described in detail below in the first embodiment and the second embodiment.
Preferably, when the user needs to interact, the NFC module of the mobile device is located close to the content displayed on the screen 100 that needs to interact without unlocking the screen 100.
For example, the mobile device 200 is a mobile phone, and when the mobile phone approaches the screen 100 of the present application, the mobile phone may emit a radio frequency signal or a magnetic field signal broadcasted in real time (i.e., the untargeted magnetic field signal emits a signal or broadcasts to the outside in real time), where the magnetic field signal includes device status information corresponding to the mobile phone. When the screen 100 senses a radio frequency signal or a magnetic field signal, device status information corresponding to the mobile device 200 can be obtained, so that a user can know who the mobile device sends the signal, and know what application programs are currently opened by the mobile phone, what contents are displayed, and under an agreed protocol or setting, the contents displayed by the mobile phone are displayed, or data transmission is realized with the mobile phone.
In the present application, after the device status information and the interaction of the mobile device 200 are obtained, a connection in a communication mode such as wif or bluetooth may be established according to the device status information, so as to assist in transmitting the interactive data or files. Preferably, the communication means includes, but is not limited to: any one or a plurality of combinations of 2G/3G/4G/5G, Bluetooth, infrared, NB-IoT, Rola, Zigbee, MavLink, WIFI, GPRS, GSM and Ethernet.
In one or more implementations, the interaction implemented according to the communication connection may include: screen projection of the application program content is achieved according to the established wifi communication connection mode; and/or realizing data file transmission according to the established Bluetooth communication connection mode.
For example, some APP applications and their contents may implement screen projection of application contents according to an established wifi communication connection. In addition, when some data files such as PDF and the like need to be transmitted, the data file transmission can be realized according to the established Bluetooth communication connection mode. To increase the flexibility and compatibility of the interactive screen 100 of the present application in transmitting data or information.
The control module 120 is configured to parse the first cloud data file in the device status information to obtain first content information corresponding to first content currently displayed by the mobile device 200, and identify second content information corresponding to second content currently displayed at the touch position on the screen 100 according to the touch position information; and determining priorities of the first content information and the second content information based on the touch position, so as to enable the screen 100 to acquire and display the first content, or enable the stacked sensing interaction module 110 to broadcast a second cloud data file, which is capable of acquiring the second content from the cloud, so as to enable the mobile device 200 to acquire and display the second content.
Accordingly, the stacked sensing interaction module 110 is further configured to: receiving a first cloud data file analyzed from the device status information broadcast by the mobile device 200, or sending a second cloud data file generated by the screen 100 to the mobile device 200.
Briefly, the first content information or the second content information is mainly used to characterize the content or data of the application program currently opened by the mobile device 200 or the screen 100, and the data includes: any one of images, audio, video, and files; such as the song currently played by the music APP, and the progress of playing.
Specifically, the first content information and the second content information include, but are not limited to: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
First high in the clouds data file, second high in the clouds data file specifically can be the structure of structuralized guide data, and it includes: jump path information of the first content or the second content and first content information or second content information containing key information of the first content or the second content can be acquired from the cloud link.
The transmission distance of the NFC point-to-point mode is short, and the transmission speed is low. For example, the transmission speed of 424kb/s is far away from the fastest 3mb/s speed of 4.0 of Bluetooth, so that the practicability is not high except for simple business card and picture transmission.
In order to improve the interaction speed and the use experience, the interaction can be completed at the moment of touch. The data or information interaction service form is realized by relying on cloud application. For example, the screen 100 transmits only the structured boot data of the corresponding cloud application, so as to boot the mobile device 200 to open a cloud storage file. For example, a payment interface of a cloud applet is opened, or different services may be provided by other cloud applications.
The structure is mainly used for guiding the mobile device 200 to open the storage file in the cloud. Therefore, after the control module 120 analyzes the first content information or the second content information, the main key information of the first content information or the second content information is extracted, and then the key information is sent to the mobile device 200, and the mobile device 200 searches and pulls according to the key information by using the cloud, so that the purpose of quickly acquiring the corresponding application content can be achieved.
Specifically, the first content information and/or the second content information include, but are not limited to: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
The first content information and/or the second content information comprise a plurality of pieces of key information, and then a cloud data file capable of acquiring corresponding application content by using a cloud is generated according to the key information, so that the screen 100 or the mobile device 200 can acquire corresponding content information by linking to the cloud.
In one or more embodiments, the corresponding cloud data file is generated according to the content information, for example, as follows:
the current state of the mobile phone and the software information running on the screen 100, such as running the kuku video, may be: { activity: youku; content: qmid 2903; time: (2, 30) }, only a part of the information identifiers are shown here. The corresponding explanation is as follows: the active application is youku, 2903 numbered video is played, and the current playing time is 2 minutes and 30 seconds. In addition, after the screen 100 receives the content information and obtains the content information through the cloud, a confirmed empty data packet can be returned without any mobile phone operation, and if possible, an activity: null: content: null; time: null }; alternatively, a null packet may be sent to the screen 100 when no software is running on the handset.
Usually, some APP applications and their contents may adopt the above-mentioned interactive method in the form of a structure, and certainly, a mode of communication connection may also be adopted, such as a screen projection of the application contents according to an established wifi communication connection mode. In addition, when some data files such as PDF and the like need to be transmitted, the data file transmission can be realized according to the established Bluetooth communication connection mode.
Corresponding to the present application, there should be a corresponding program in the mobile device 200 (e.g. mobile phone) that can send the self status and parse the information returned by the screen 100. The program can be woken up at the moment of touch occurrence to complete the interaction.
It should be noted that the mobile device 200 that the user needs to interact with before the interaction should have the media program required for the interaction, but the media program may also be embedded in the operating system of the mobile device 200 itself and thus not visible to the user. This is different from the existing card reader mode and the point-to-point mode, which are mainly subject to software.
This application is different with current card reader mode and the point-to-point mode then mainly be restricted to the software, the application that this application relates to be mobile device 200 on the installation arbitrary application can, in brief, in this application one or more real-time examples, what APP has on the cell-phone, just can realize interacting with screen 100 to this APP, if utilize music broadcast APP, map navigation APP, through touching screen 100, can realize utilizing the high in the clouds to acquire on the webpage or continue broadcast music, map navigation etc. on the procedure under on screen 100, and need not additionally download alone again and realize the application that the function must carry on.
As shown in fig. 2, the stacked sensing interaction module 110 includes: a plurality of NFC inductive antenna units 111 arranged in a horizontal and vertical staggered and stacked manner; the first NFC sensing antennas 111a arranged horizontally and the second NFC sensing antennas 111b arranged vertically are respectively stacked below the screen in a staggered manner.
The NFC sensing antenna unit 111 is configured to determine, according to the signal strength obtained by superimposing the horizontal signal strength sensed by the first NFC sensing antenna 111a and the longitudinal signal strength sensed by the second NFC sensing antenna 111b and the corresponding signal strength gradient, a horizontal-vertical coordinate position of the strongest signal strength when the touch response is triggered, and use the horizontal-vertical coordinate position as touch coordinate information;
the control module 120 is further configured to modulate a second cloud data file, which is capable of obtaining the second content from the cloud, on the NFC sensing antenna unit 111, and enable the NFC sensing antenna unit 111 to broadcast the second content to the outside, so that the mobile device 200 can obtain and display the second content.
Briefly, the stacked perceptual interactive module 110 corresponds to a stacked deployment scheme. In the scheme, the NFC sensing antenna unit 111 is deployed in a transverse superposition and longitudinal superposition manner, and the interaction occurrence position is determined according to the strength of a signal received by the NFC sensing antenna unit 111 when interaction occurs, as shown in the figure, the thicker the line is, the stronger the signal received by the longitudinal or transverse unit is, and the position of the horizontal and vertical coordinates where touch interaction occurs can be determined more easily according to the strongest signal strength gradient. When such a deployment is applied, the NFC sensing antenna unit 111 sensing the location may be used or a full screen tag coil or a global antenna may be additionally added to transmit data to the mobile device 200.
In an embodiment of the application, the stacked sensing interaction module adjusts the sensing accuracy by adjusting the overlapping density of the first NFC sensing antenna arranged horizontally and the second NFC sensing antenna arranged vertically. The problems that the signal strength is weak and the mobile equipment cannot sense due to the fact that other existing tag coils are too small can be solved; or the label coil is too large, so that the problem that the interaction granularity is too large and the label coil cannot be used for practical business is solved, and the signal strength and the interaction usability are greatly improved.
In the present application, it is not difficult to find that the screen 100 does not determine whether to receive or transmit when the mobile device 200 makes contact with the screen 100, and therefore, the control module 120 also sets a priority logic setting for reception and transmission. The method specifically comprises the following steps:
the priorities of the first content information and the second content information are determined based on the touch position, so that the screen 100 can acquire and display the first content, or the stacked sensing interaction module 110 can broadcast a second cloud data file of the second content acquired by the cloud, so that the mobile device 200 can acquire and display the second content.
When the first content has a higher priority, acquiring the first content currently displayed by the corresponding mobile device 200 from the cloud according to the jump path information corresponding to the first content obtained by analyzing the first cloud data file, and displaying the first content on the screen 100; or when the second content has higher priority, generating a second cloud data file capable of acquiring the second content by the cloud according to the second content information; and the second cloud data file is broadcasted through the stacked sensing interaction module 110, so that the mobile device 200 obtains the second content currently displayed at the touch position of the corresponding screen 100 from the cloud by analyzing the second cloud data file after receiving the second content.
Specifically, the determining of the priority of the first content information and the second content information based on the touch position includes any one or more of the following combinations:
A. the priority of the second content information corresponding to the default setting screen 100 is the highest, so that only the mobile device 200 is enabled to acquire and display the second content; alternatively, the priority of the first content information corresponding to the mobile device 200 may be set to be the highest by default, so that only the screen 100 is enabled to acquire and display the first content;
in short, under this rule, it is possible to set a scene in which only one of the display contents is accepted. For example, the method is suitable for scenes such as advertisement show windows, that is, the provider (merchant) of the screen 100 does not need to obtain relevant information of the user mobile phone, and only the screen 100 needs to provide commodity content to the user mobile phone.
B. When the first content information and the second content information are both application program content or are both data, the priority of the first content information is higher.
For example, assuming that the common applications such as video, audio, pictures, maps, social contacts, etc. are of the same priority, when the application contents of this priority are displayed on both the screen 100 and the mobile device 200, the mobile device 200 can be held by the user to be more active and targeted, and therefore, in this case, the first content information displayed on the mobile device is set to have a better priority, so as to enable the screen 100 to display the content displayed on the mobile device 200.
For another example, when the user wants to obtain the content displayed on the screen 100, he or she can exit the current application on the handheld mobile device 200, so as to easily lower the priority of the first content information on the mobile device 200, and then the mobile device 200 can obtain the content displayed on the screen. It is clearly more convenient to operate the mobile device 200 held in the user's hand relative to the operating screen 100.
C. And when the first content information or the second content information is empty, the priority is the lowest.
For example, the mobile device 200 (e.g., a smart phone) may generate a first cloud data file according to the current content of the application program thereon, and extract the first content information if the content is available, or leave the first cloud data file empty if the content is not available. The priority logic is: firstly, judging whether the first content information analyzed according to a first cloud data file is empty, if not, acquiring the current application program content corresponding to the mobile equipment 200 from a cloud according to the first content information, namely, preferentially processing a receiving task; if the current application program content is empty, the sending task is processed again, second content information corresponding to the current application program content at the touch position of the screen 100 is identified according to the touch position information, and a second cloud data file capable of acquiring the corresponding application program content by using a cloud is generated.
D. The priority of the first content information and the second content information for the application program content is higher than that for the data.
It should be noted that, the priority of the first content information and the priority of the second content information can be set or adjusted at any time, so as to be suitable for different scenes, and thus, the interactive service of sending or receiving information and data can be completed orderly and reasonably.
Preferably, the interactable screen 100 described herein may be adapted to: the application scenarios of the computer display, the vehicle-mounted central control screen, the show window advertisement screen, the public place information screen, etc. are not limited, and all scenarios applicable to interaction with the mobile device 200 are covered in the protection scope of the present application. The mobile device 200 includes: intelligent wearing equipment or removal end equipment such as smart mobile phone, PAD, intelligent wrist-watch, smart glasses.
For example, the interactive screen 100 described herein can implement the following usage scenarios:
1) the interactive screen 100 is fabricated as a computer monitor, such as the scene diagram shown in fig. 3.
A user can touch a file on a desktop by using a mobile phone to directly acquire the file by using the mobile phone;
the user can directly open the website in the mobile phone by touching a certain webpage in the computer browser by using the mobile phone;
the user can use the mobile phone to touch different software icons in the computer browser to acquire different contents, for example, touch a player in the mobile phone to play a movie on a computer, and touch music software in the mobile phone to play corresponding music;
the user can also touch the blank of the computer to establish a certain connection state, and directly slide files, information, texts and the like in the mobile phone to the desktop of the computer.
2) When the interactive screen 100 is manufactured as an on-vehicle central control screen of a vehicle:
after the user can navigate the corresponding place on the mobile phone, the user can touch the blank position of the large central control screen, and the vehicle can automatically navigate to the corresponding position.
3) When the interactive screen 100 is made as a public showcase:
the interactive screen 100 can display different advertisement show windows in public places, for example, video advertisements can be played, different positions in the same picture correspond to different commodities, such as clothes, ornaments, bags and the like on a model, or tables, chairs, household appliances, decorative pictures and the like in a home scene, a user can touch corresponding commodities in the interactive screen 100 by using a mobile phone, the mobile phone can judge the corresponding position of each commodity in the current picture at the current moment, and automatically pops up a payment interface of a cloud applet of the corresponding commodity to complete a purchasing action.
Fig. 4 is a schematic flow chart of the interaction method according to an embodiment of the present application. The method is applied to an interactive screen based on a stack-type perceptual interaction module as described in fig. 1 or 2, and as shown, the method includes;
step 401: the method comprises the steps of inducing a magnetic field signal broadcasted by the mobile equipment in real time to determine the relative position between the mobile equipment and the magnetic field signal, acquiring equipment state information of the mobile equipment after triggering touch response, and extracting touch position information on a corresponding screen;
step S402: analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable the stacked perception interaction module to broadcast a second cloud data file capable of acquiring the second content from the cloud so as to enable the mobile device to acquire and display the second content.
It should be noted that the content of each step of the method is based on the same concept as the embodiment in the interactive screen described in the present application, and the technical effect brought by the content is the same as the embodiment in the interactive screen described in the present application, so that the details are not repeated herein.
In summary, the present application provides an interactive screen based on a stacked sensing interaction module, and a method and a system thereof, wherein the screen includes: the stacked perception interaction module is used for sensing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the stacked perception interaction module, acquiring equipment state information of the mobile equipment after triggering touch response, and extracting touch position information on a corresponding screen; analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable the stacked perception interaction module to broadcast a second cloud data file capable of acquiring the second content from the cloud so as to enable the mobile device to acquire and display the second content.
The application effectively overcomes various defects in the prior art and has high industrial utilization value.
The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the invention. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present application.

Claims (10)

1. An interactable screen based on a stacked awareness interaction module for interacting with a mobile device having an NFC module, the screen comprising:
the stacked sensing interaction module comprises a plurality of NFC sensing antenna units which are arranged in a stacked mode in a transverse and longitudinal staggered mode and used for sensing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the stacked sensing interaction module, acquiring equipment state information of the mobile equipment after triggering touch response and extracting touch position information on a corresponding screen;
the control module is used for analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information;
and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable the stacked perception interaction module to broadcast a second cloud data file capable of acquiring the second content from the cloud so as to enable the mobile device to acquire and display the second content.
2. The interactable screen of claim 1 wherein said stacked sensory interactable module comprises: the NFC induction antenna units are transversely and longitudinally staggered and stacked; the system comprises a screen, a plurality of first NFC induction antennas, a plurality of second NFC induction antennas and a plurality of first NFC induction antennas, wherein the first NFC induction antennas are transversely arranged and the second NFC induction antennas are longitudinally arranged;
the NFC sensing antenna unit is used for determining the horizontal and vertical coordinate position of the strongest signal strength when the touch response is triggered according to the signal strength superposed by the horizontal signal strength sensed by the first NFC sensing antenna and the longitudinal signal strength sensed by the second NFC sensing antenna and the corresponding signal strength gradient, and the horizontal and vertical coordinate position is used as touch coordinate information;
the control module is further configured to modulate a second cloud data file, which enables the second content to be acquired by the cloud, on the NFC sensing antenna unit, and enable the NFC sensing antenna unit to broadcast the second content to the outside, so that the mobile device can acquire and display the second content.
3. The interactive screen of claim 2, wherein the stacked sensing interaction module adjusts the sensing accuracy by adjusting the overlapping density of the first NFC sensing antenna arranged in the horizontal direction and the second NFC sensing antenna arranged in the vertical direction.
4. The interactable screen of claim 1 wherein said device status information further comprises: any one or more of the combination of a device serial number, a device model, a device Identity (ID), a device name, a Bluetooth device name, a timestamp and an interaction flow ID.
5. The interactive screen of claim 1, wherein the first cloud data file and the second cloud data file are a structure of structured boot data, comprising: jump path information of the first content or the second content and first content information or second content information containing key information of the first content or the second content can be acquired from the cloud link.
6. The interactable screen of claim 1 or 5 wherein said first and second content comprise: application content or data; wherein the data comprises: any one of images, audio, video, and files;
the first content information and the second content information include: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
7. The interactive screen of claim 1, wherein when the first content has a higher priority, the first content currently displayed by the corresponding mobile device is obtained from the cloud according to the jump path information corresponding to the first content obtained by parsing the first cloud data file, and the first content is displayed on the screen;
or when the second content has higher priority, generating a second cloud data file capable of acquiring the second content by the cloud according to the second content information; and broadcasting the second cloud data file through the stacked sensing interaction module, so that the mobile device receives the second content and analyzes the second cloud data file to obtain the second content currently displayed on the corresponding screen touch position from the cloud.
8. The interactive screen of claim 1, wherein the determining the priority of the first content information and the second content information based on the touch position comprises any one or more of the following combinations:
the priority of the second content information corresponding to the default setting screen is the highest, so that the mobile equipment can only acquire and display the second content; or, the priority of the first content information corresponding to the mobile device may be set to be the highest by default, so that only screen acquisition is realized and the first content is displayed;
when the first content information and the second content information are both application program content or are both data, the priority of the first content information is higher;
when the first content information or the second content information is empty, the priority is the lowest;
the priority of the first content information and the second content information for the application program content is higher than that for the data.
9. An interaction method is applied to an interactive screen based on a stacked perception interaction module, and comprises the following steps of;
the method comprises the steps of inducing a magnetic field signal broadcasted by the mobile equipment in real time to determine the relative position between the mobile equipment and the magnetic field signal, acquiring equipment state information of the mobile equipment after triggering touch response, and extracting touch position information on a corresponding screen;
analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the priority of the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable a stacked perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
10. An interactive system, characterized in that the interactive system comprises: an interactable screen, and mobile device, as claimed in any one of claims 1-8; wherein the mobile device is provided with an NFC module.
CN202110950435.2A 2021-08-18 2021-08-18 Interactive screen based on stacked perception interactive module, and method and system thereof Pending CN113687760A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110950435.2A CN113687760A (en) 2021-08-18 2021-08-18 Interactive screen based on stacked perception interactive module, and method and system thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110950435.2A CN113687760A (en) 2021-08-18 2021-08-18 Interactive screen based on stacked perception interactive module, and method and system thereof

Publications (1)

Publication Number Publication Date
CN113687760A true CN113687760A (en) 2021-11-23

Family

ID=78580461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110950435.2A Pending CN113687760A (en) 2021-08-18 2021-08-18 Interactive screen based on stacked perception interactive module, and method and system thereof

Country Status (1)

Country Link
CN (1) CN113687760A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546768A (en) * 2011-12-23 2012-07-04 深圳市同洲电子股份有限公司 Content sharing method, device and system
CN102638611A (en) * 2011-02-15 2012-08-15 Lg电子株式会社 Method of transmitting and receiving data and display device using the same
US20140051354A1 (en) * 2012-08-20 2014-02-20 Lg Electronics Inc. Mobile terminal, display device and method for controlling the mobile terminal
CN103607380A (en) * 2013-11-07 2014-02-26 深圳创维数字技术股份有限公司 Multi-screen interaction method, device thereof and system thereof
US20160087692A1 (en) * 2014-09-24 2016-03-24 Nintendo Co., Ltd. Information reading system, information reading apparatus, storage medium having stored therein information reading program, and information reading method
CN105573492A (en) * 2015-11-25 2016-05-11 小米科技有限责任公司 Interactive type screen control method and apparatus
CN105808042A (en) * 2014-12-30 2016-07-27 联想(北京)有限公司 Information processing method and electronic device
US20200019297A1 (en) * 2018-07-10 2020-01-16 Seiko Epson Corporation Display apparatus and image processing method
CN112307405A (en) * 2020-11-16 2021-02-02 Oppo广东移动通信有限公司 Cross-device application relay method, device, equipment, system and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638611A (en) * 2011-02-15 2012-08-15 Lg电子株式会社 Method of transmitting and receiving data and display device using the same
CN102546768A (en) * 2011-12-23 2012-07-04 深圳市同洲电子股份有限公司 Content sharing method, device and system
US20140051354A1 (en) * 2012-08-20 2014-02-20 Lg Electronics Inc. Mobile terminal, display device and method for controlling the mobile terminal
CN103607380A (en) * 2013-11-07 2014-02-26 深圳创维数字技术股份有限公司 Multi-screen interaction method, device thereof and system thereof
US20160087692A1 (en) * 2014-09-24 2016-03-24 Nintendo Co., Ltd. Information reading system, information reading apparatus, storage medium having stored therein information reading program, and information reading method
CN105808042A (en) * 2014-12-30 2016-07-27 联想(北京)有限公司 Information processing method and electronic device
CN105573492A (en) * 2015-11-25 2016-05-11 小米科技有限责任公司 Interactive type screen control method and apparatus
US20200019297A1 (en) * 2018-07-10 2020-01-16 Seiko Epson Corporation Display apparatus and image processing method
CN112307405A (en) * 2020-11-16 2021-02-02 Oppo广东移动通信有限公司 Cross-device application relay method, device, equipment, system and storage medium

Similar Documents

Publication Publication Date Title
CN103581433B (en) Mobile terminal and control method thereof
CN103314344B (en) Touch sensitive haptic display
US9560475B2 (en) Mobile terminal and control method thereof
KR102019967B1 (en) User terminal apparatus, display apparatus, server and control method thereof
KR101228478B1 (en) Method and system of providing application, and mobile terminal thereof
CN102739852B (en) Mobile terminal and reward voucher management method thereof
US20040125136A1 (en) Provision of services through a display system
CN109753326A (en) Processing method, device, equipment and machine readable media
KR20160144665A (en) User equipment for recognizing object and displaying database matching result, control method thereof and computer readable medium having computer program recorded therefor
US20180020252A1 (en) Information display method, channel management platform, and terminal
CN103955313B (en) Device identification method and apparatus, and device information provision method and apparatus
US20100318420A1 (en) Apparatus and method for providing media advertisement service using human body communication
CN106469183A (en) Page rendering method and device, page data processing method and client
CN109753196A (en) Processing method, device, equipment and machine readable media
US20170024736A1 (en) Mobile terminal and method for controlling the same
CN103679475A (en) E-commerce shopping guide platform
CN101763345A (en) Information providing system and method
WO2019168780A9 (en) System and method for providing augmented reality experience to objects using wireless tags
CN106445956A (en) Shopping data management method and apparatus
CN106575409A (en) Object recognition-based retargeting advertisement product recommendation server, control method therefor, and recording medium having computer program recorded thereon
US20140101561A1 (en) User terminal apparatus and ui providing method thereof, and server and control method thereof
CN110189123A (en) Pay preferential measure and mobile terminal
CN103179207A (en) Data transmission method and system as well as device
KR20170066065A (en) Method and apparatus for providing personalized information
CN109753214A (en) Processing method, device, equipment and machine readable media

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination