CN106569726B - Intelligent terminal response device and method - Google Patents

Intelligent terminal response device and method Download PDF

Info

Publication number
CN106569726B
CN106569726B CN201610998260.1A CN201610998260A CN106569726B CN 106569726 B CN106569726 B CN 106569726B CN 201610998260 A CN201610998260 A CN 201610998260A CN 106569726 B CN106569726 B CN 106569726B
Authority
CN
China
Prior art keywords
dot matrix
braille
information
magnetic suspension
intelligent terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201610998260.1A
Other languages
Chinese (zh)
Other versions
CN106569726A (en
Inventor
程亚琪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Baixia High Tech Industrial Park Investment Development Co Ltd
Original Assignee
Nanjing Baixia High Tech Industrial Park Investment Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Baixia High Tech Industrial Park Investment Development Co Ltd filed Critical Nanjing Baixia High Tech Industrial Park Investment Development Co Ltd
Priority to CN201610998260.1A priority Critical patent/CN106569726B/en
Publication of CN106569726A publication Critical patent/CN106569726A/en
Application granted granted Critical
Publication of CN106569726B publication Critical patent/CN106569726B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The invention discloses an intelligent terminal response device and a method, wherein the intelligent terminal comprises a magnetic suspension dot matrix screen, and the intelligent terminal response device comprises: the first acquisition module is used for acquiring induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen when the pressing operation on the magnetic suspension dot matrix screen is detected, and taking the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen as first information; the second acquisition module is used for acquiring the corresponding braille information according to the first information and taking the braille information corresponding to the first information as the first braille information; and the first display module is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read. The invention solves the technical problem that the intelligent terminal and the visually impaired people cannot carry out various interactive operations.

Description

Intelligent terminal response device and method
Technical Field
The invention relates to the technical field of communication, in particular to an intelligent terminal response device and method.
Background
Along with the development and the progress of communication technology, the life experience that science and technology brought can also be enjoyed to the visual impairment crowd, especially blind person, the convenience that intelligent terminal brought especially, intelligent terminal includes terminals such as terminal, flat board, however present intelligent terminal and visual impairment crowd can not realize like carrying out various effectual interactive operation with ordinary user, and just single in the terminal information processing back, show and read for the visual impairment personnel to cause the poor technical problem of visual impairment user experience.
Disclosure of Invention
The invention mainly aims to provide an intelligent terminal response device and method, and aims to solve the technical problem that various interactions between an intelligent terminal and a visually impaired user cannot be realized in the prior art.
In order to achieve the above object, an embodiment of the present invention provides an intelligent terminal response apparatus, where the intelligent terminal response apparatus includes:
the magnetic suspension dot matrix screen comprises a structural layer and an induction layer, wherein the structural layer is used as the outer surface of the intelligent terminal, the induction layer is arranged on one side, facing the inside of the intelligent terminal, of the structural layer, the structural layer comprises a plurality of arranged magnetic pieces, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic pieces and an induction device for inducing touch operation, induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is obtained, and the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is used as first information;
the second acquisition module is used for acquiring the corresponding braille information according to the first information and taking the braille information corresponding to the first information as the first braille information;
and the first display module is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read.
Optionally, the intelligent terminal comprises a whole machine frame, the intelligent terminal comprises braille entity touch keys arranged on the whole machine frame or on the magnetic suspension dot matrix screen,
the intelligent terminal response device further comprises:
the third acquisition module is used for acquiring the induction information corresponding to the physical touch key operation when the pressing operation on the Braille physical touch key is detected, and taking the induction information corresponding to the pressing operation on the physical touch key operation as second information;
the fourth acquiring module is used for acquiring the corresponding braille information according to the second information and taking the braille information corresponding to the second information as the second braille information;
and the second display module is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read.
Optionally, the Braille entity touch key comprises an intelligent terminal homepage entity touch key, the intelligent terminal homepage displays various applications,
the second display module includes:
the detection unit is used for detecting the type of the entity touch key corresponding to the second braille information;
the first obtaining unit is used for obtaining distribution blocks of each application of the homepage when the type of the entity touch key corresponding to the second braille information is the homepage entity touch key;
the generating unit is used for generating the separating bar of each block according to the distribution block of each application of the homepage;
the second acquisition unit is used for acquiring corresponding braille information according to the separating bars of the blocks, and taking the braille information corresponding to the separating bars of the blocks as third braille information;
and the display unit is used for displaying the Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information so as to be read by the visually impaired user.
Optionally, the intelligent terminal comprises a Braille entity touch key arranged on the whole machine frame or the magnetic suspension dot matrix screen,
the intelligent terminal response device further comprises:
and the fifth acquisition module is used for acquiring the induction information corresponding to the touch operation when the touch operation is detected on the magnetic suspension dot matrix screen or the Braille entity touch key, and playing the corresponding audio file according to the induction information.
Optionally, the intelligent terminal includes each picture, and the intelligent terminal response device further includes:
the judging module is used for acquiring induction information corresponding to the touch operation when the touch operation is detected on the magnetic suspension dot matrix screen and judging whether the induction information corresponding to the touch operation is a picture or not;
the generating module is used for acquiring a three-dimensional image correspondingly generated by a picture when the sensing information corresponding to the touch operation is detected to be the display picture;
and the third display module is used for controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read.
In order to achieve the above object, the present invention further provides an intelligent terminal response method, where the intelligent terminal response method includes:
when the pressing operation on the magnetic suspension dot matrix screen is detected, the magnetic suspension dot matrix screen comprises a structural layer serving as the outer surface of the intelligent terminal and an induction layer arranged on one side of the structural layer, which faces the inside of the intelligent terminal, the structural layer comprises a plurality of magnetic pieces arranged in parallel, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic pieces and an induction device for inducing touch operation, induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is obtained, and the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is used as first information;
acquiring corresponding braille information according to the first information, and taking the braille information corresponding to the first information as first braille information;
and controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen for reading by a vision-impaired user.
Optionally, the intelligent terminal comprises a whole machine frame, the intelligent terminal comprises braille entity touch keys arranged on the whole machine frame or a magnetic suspension dot matrix screen,
the intelligent terminal response method further comprises the following steps:
when the pressing operation on the Braille entity touch key is detected, acquiring sensing information corresponding to the entity touch key operation, and taking the sensing information corresponding to the pressing operation on the entity touch key operation as second information;
acquiring corresponding braille information according to the second information, and taking the braille information corresponding to the second information as second braille information;
and controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for reading by a vision-impaired user.
Optionally, the braille physical touch keys include an intelligent terminal homepage physical touch key, the intelligent terminal homepage displays various applications,
the step of controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read comprises the following steps:
detecting the type of an entity touch key corresponding to the second Braille information;
when the type of the entity touch key corresponding to the second Braille information is a homepage entity touch key, acquiring a distribution block of each application of the homepage;
generating a division bar of each block according to the distribution block of each application of the homepage;
acquiring corresponding braille information according to the separating bars of the blocks, and taking the braille information corresponding to the separating bars of the blocks as third braille information;
and displaying a Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information for a vision-impaired user to read.
Optionally, the intelligent terminal comprises a Braille entity touch key arranged on the whole machine frame or the magnetic suspension dot matrix screen,
the intelligent terminal response method further comprises the following steps:
and when the touch operation is detected on the magnetic suspension dot matrix screen or the Braille entity touch key, acquiring induction information corresponding to the touch operation, and playing a corresponding audio file according to the induction information.
Optionally, the intelligent terminal includes each picture, and the intelligent terminal response method further includes:
when touch operation is detected on the magnetic suspension dot matrix screen, acquiring induction information corresponding to the touch operation, and judging whether the induction information corresponding to the touch operation is a picture or not;
when sensing information corresponding to touch operation is detected to be a display picture, acquiring a three-dimensional image correspondingly generated by the picture;
and controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read.
The magnetic suspension dot matrix screen comprises a structural layer used as the outer surface of the intelligent terminal and an induction layer arranged on one side of the structural layer facing the inside of the intelligent terminal when the pressing operation on the magnetic suspension dot matrix screen is detected, wherein the structural layer comprises a plurality of arranged magnetic pieces, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic pieces and an induction device for inducing touch operation, induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is obtained, and the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is used as first information; the second acquisition module is used for acquiring the corresponding braille information according to the first information and taking the braille information corresponding to the first information as the first braille information; and the first display module is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read. Because this intelligent terminal magnetic suspension dot matrix screen can acquire the operation information of looking the barrier user to according to this operation feedback display corresponding braille dot matrix interface, thereby realized that intelligent terminal and looking the barrier crowd carry out various interactive operation, and not only the single information processing back in the terminal, show and read for looking the barrier personnel, promoted the experience that looks the barrier user.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of an alternative mobile terminal for implementing various embodiments of the present invention;
FIG. 2 is a diagram of a wireless communication device of the mobile terminal of FIG. 1;
FIG. 3 is a block diagram of a first embodiment of the intelligent terminal response device of the present invention;
FIG. 4 is a functional block diagram of a second embodiment of an intelligent terminal response apparatus according to the present invention;
FIG. 5 is a functional block diagram of a second display module of a third embodiment of an intelligent terminal response apparatus according to the present invention;
FIG. 6 is a flowchart illustrating a first embodiment of a response method of an intelligent terminal according to the present invention;
fig. 7 is a schematic view of a detailed flow before steps of acquiring sensing information corresponding to each pressing operation on a magnetic suspension dot matrix screen and using the sensing information corresponding to each pressing operation on the magnetic suspension dot matrix screen as first information when the pressing operation on the magnetic suspension dot matrix screen is detected in the second embodiment of the intelligent terminal response method according to the present invention;
fig. 8 is a detailed flowchart of the step of controlling the concave-convex amount of the magnetic member on the magnetic suspension dot matrix screen according to the second braille information to display the braille dot matrix interface corresponding to the second braille information on the magnetic suspension dot matrix screen for the visually impaired user to read in the intelligent terminal response method according to the third embodiment of the present invention;
fig. 9 is a schematic overall appearance diagram of a magnetic suspension dot matrix screen and a braille alphabet physical touch key in the intelligent terminal response apparatus and method according to the present invention;
FIG. 10 is a schematic diagram illustrating the cross-sectional effect of a magnetic suspension dot matrix screen in the intelligent terminal response apparatus and method according to the present invention;
FIG. 11 is a schematic diagram of Braille solid touch keys in the intelligent terminal response device and method according to the present invention;
FIG. 12 is a schematic diagram illustrating an image relief display effect in the intelligent terminal response apparatus and method according to the present invention;
fig. 13 is a schematic view showing home page applications in the intelligent terminal response apparatus and method according to the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, a first acquisition module 40, a second acquisition module 50, and a first display module 60. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication device or network. For example, the wireless communication unit may include a location information module 115.
The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning device). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.
The a/V input unit 120 is used to receive an audio or video signal.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal.
The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or jerky movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device.
The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100.
In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner.
The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.
The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure value as well as a touch input position and a touch input area.
The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to an audio call, data communication, a video call, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication means such as wired and wireless communication means and satellite-based communication means that transmit data via frames or packets.
A communication apparatus in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.
Such communication devices may use different air interfaces and/or physical layers. For example, the air interface used by the communication device includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and universal mobile telecommunications device (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and so forth. The following description relates to a CDMA communication device, as a non-limiting example, but such teachings are equally applicable to other types of devices.
Referring to fig. 2, the CDMA wireless communication apparatus may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that an apparatus as shown in fig. 2 may include a plurality of BSCs 2750.
Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).
The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a base transceiver sub-assembly (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.
As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the apparatus. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several global positioning device (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.
In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. As a typical operation of the wireless communication apparatus, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.
Based on the hardware structure and the communication device structure of the mobile terminal, the intelligent terminal response device is a part of the mobile terminal.
Referring to fig. 3, the present invention provides an intelligent terminal response device, in a first embodiment of the intelligent terminal response device, the intelligent terminal response device includes:
the first obtaining module 40 is configured to, when a pressing operation on the magnetic suspension dot matrix screen is detected, obtain, as first information, sensing information corresponding to each pressing operation on the magnetic suspension dot matrix screen, where the magnetic suspension dot matrix screen includes a structural layer serving as an outer surface of the intelligent terminal and a sensing layer disposed on one side of the structural layer facing an inside of the intelligent terminal, where the structural layer includes a plurality of magnetic members, and the sensing layer includes a magnetic field device for controlling a concave-convex amount of the magnetic members and a sensing device for sensing a touch operation;
the intelligent terminal comprises various terminals such as a mobile phone and a tablet personal computer which are provided for visual impairment personnel to use, the intelligent terminal comprises a magnetic suspension dot matrix screen, the magnetic suspension dot matrix screen comprises a structural layer as the outer surface of the intelligent terminal and an induction layer arranged on one side of the structural layer facing the inside of the intelligent terminal, the structural layer comprises a plurality of magnetic parts arranged in parallel, the magnetic suspension dot matrix screen comprises a magnetic vertical rod, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic parts and an induction device for inducing touch operation, as shown in figure 9 and figure 10, when the intelligent terminal is opened, the magnetic suspension dot matrix screen can be horizontal, namely, the magnetic parts are at the same height without concave-convex phenomenon, when the magnetic suspension dot matrix screen is horizontal, the magnetic parts can move upwards through triggering control to enable the screen to be in a concave-convex state, when the, acquiring induction information corresponding to each pressing operation on a magnetic suspension dot matrix screen, wherein the pressing operation refers to acquiring the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen when the pressing pressure reaches a preset pressure, taking the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen as first information, namely, when a user presses the magnetic suspension dot matrix screen, a pressing induction layer at the bottom end of the magnetic suspension dot matrix screen induces pressing and triggers the induction information corresponding to the pressing action, namely, if the pressing is the operation of acquiring chat software, each item of data of the chat software is acquired, if the pressing is the starting of a browser, each item of data of the browser is acquired, or when the user uses the browser, the browser takes the induction information as the first information according to each item of data returned by the user operation and the like, and when a visually impaired person presses the magnetic suspension dot matrix screen correspondingly, the sensing information can be obtained in time.
The second acquiring module 50 is used for acquiring the corresponding braille information according to the first information, and taking the braille information corresponding to the first information as the first braille information;
acquiring corresponding braille information according to the first information, using the braille information corresponding to the first information as first braille information, namely, the sensing information corresponding to each pressing operation generates corresponding Braille information, the obtaining of the corresponding Braille information according to the first information comprises generating data which can be read by a regular person, and then the data which can be read by the normal person is displayed in a form which can be identified by the visually impaired, such as the concave-convex amount display of the magnetic piece, if the intelligent terminal needs to display the WeChat two-character, the WeChat two-character which can be read by the common user can be fed back and generated, then the WeChat two-character is displayed on the magnetic suspension dot matrix screen by the concave-convex dot matrix which can be felt and identified by the visually impaired, or the character which can be read by the ordinary user is not generated, the Braille is directly and correspondingly generated, and the corresponding Braille uses the concave-convex dot matrix data as the first Braille information according to the Braille information corresponding to the first information.
And the first display module 60 is configured to control the concave-convex amount of the magnetic member on the magnetic suspension dot matrix screen according to the first braille information, so as to display a braille dot matrix interface corresponding to the first braille information on the magnetic suspension dot matrix screen for a visually impaired user to read.
After the corresponding first Braille information is obtained, the intelligent terminal controls the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the corresponding first Braille information and displays the corresponding concave-convex dot matrix interface for the vision-impaired user to read, the concave-convex dot matrix interface is correspondingly generated according to the magnetic suspension principle, the convex dot matrix is generated because the magnetic vertical rod on the corresponding dot matrix on the magnetic suspension dot matrix screen is repelled by the magnetic field, so that the acting force is generated to enable the magnetic vertical rod on the corresponding dot matrix position to be far away from the horizontal plane of the magnetic suspension dot matrix screen, the CPU of the terminal controls the corresponding dot matrix needing to generate the magnetic field according to the first Braille information, so that the magnetic vertical rod on the corresponding dot matrix can correspondingly move to form the concave-convex interface of the magnetic suspension dot matrix screen, and the Braille interface correspondingly generated by the magnetic suspension dot matrix screen according to, and displaying, and the vision-impaired user obtains the information displayed by the concave-convex dot matrix interface according to the concave-convex dot matrix interface displayed on the magnetic suspension dot matrix screen.
In this embodiment, the first obtaining module is configured to, when a pressing operation on the magnetic suspension dot matrix screen is detected, enable the magnetic suspension dot matrix screen to include a structural layer serving as an outer surface of the intelligent terminal and an induction layer disposed on one side of the structural layer facing an inside of the intelligent terminal, where the structural layer includes a plurality of magnetic members, the induction layer includes a magnetic field device for controlling a concave-convex amount of the magnetic members and an induction device for inducing a touch operation, obtain induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen, and enable the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen to serve as first information; the second acquisition module is used for acquiring the corresponding braille information according to the first information and taking the braille information corresponding to the first information as the first braille information; and the first display module is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read. Because the intelligent terminal magnetic suspension dot matrix screen can acquire the operation of the visually impaired user, namely the visually impaired user can press the magnetically suspended dot matrix screen to send out the operation, and the corresponding Braille dot matrix interface is displayed according to the operation feedback, and the fed Braille dot matrix interface can be identified and read by the visually impaired user. Thereby realized intelligent terminal and the mutual between the visual barrier crowd, solved the visual barrier personnel can only be single with the information processing back in the terminal, show and read for the visual barrier personnel, and the visual barrier personnel can not read the content that self is interested according to the demand to correspondingly promoted the experience of looking the visual barrier user, let the blind person also can enjoy the life experience that science and technology brought, also can experience current smart mobile phone more and bring the facility for the ordinary people.
Further, on the basis of the first embodiment of the intelligent terminal response device of the present invention, a second embodiment of the intelligent terminal response device is provided, as shown in fig. 4, in the second embodiment, the intelligent terminal includes a complete machine frame, the intelligent terminal includes braille entity touch keys arranged on the complete machine frame or on the magnetic suspension dot matrix screen,
the intelligent terminal response method further comprises the following steps:
the third obtaining module 10 is configured to, when a touch operation on a braille physical touch key is detected, obtain sensing information corresponding to a physical touch key instruction, and use the sensing information corresponding to the touch operation on the physical touch key instruction as second information;
the Braille entity touch keys are positioned at the lower end or the periphery of the magnetic suspension dot matrix screen, the Braille entity touch keys comprise a menu key, a main page key, a return key and the like, which are the most commonly used keys for users, and a corresponding rugged mark is arranged above each key, and comprises dot matrix Braille and the like, as shown in figure 11. And acquiring induction information corresponding to the operation of the entity touch key by touching and pressing the keys, and taking the induction information corresponding to the operation of the entity touch key as second information.
The fourth acquiring module 20 is configured to acquire corresponding braille information according to the second information, and use the braille information corresponding to the second information as the second braille information;
and acquiring corresponding braille information according to the second information, taking the braille information corresponding to the second information as the second braille information, acquiring the braille information correspondingly displayed by the homepage key when the visually impaired user presses the entity homepage key, and correspondingly generating corresponding braille by the characters which can be identified by common users such as a telephone, a short message, music, a radio, a camera, a browser and the like if the homepage key is provided with the telephone, the short message, the music, the radio, the camera, the browser and the like so as to be displayed on a magnetic suspension dot matrix screen.
And the second display module 30 is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second braille information so as to display the braille dot matrix interface corresponding to the second braille information on the magnetic suspension dot matrix screen for the vision-impaired user to read.
And displaying the Braille dot matrix interface correspondingly generated by the magnetic suspension dot matrix screen according to the second Braille information for the visually impaired user to read, acquiring the dot matrix required to be protruded on the magnetic suspension dot matrix screen according to the second Braille information, and forming a magnetic field at the corresponding dot matrix to control the protrusion of the magnetic vertical rod so as to form the dot matrix interface for the visually impaired user to touch and read.
In this embodiment, the third obtaining module 10 is configured to, when a touch operation on a braille physical touch key is detected, obtain sensing information corresponding to a physical touch key instruction, and use the sensing information corresponding to the touch operation on the physical touch key instruction as second information; the fourth acquiring module 20 is configured to acquire corresponding braille information according to the second information, and use the braille information corresponding to the second information as the second braille information; and the second display module 30 is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second braille information so as to display the braille dot matrix interface corresponding to the second braille information on the magnetic suspension dot matrix screen for the vision-impaired user to read. Because the pressing entity touch keys are arranged around the magnetic suspension dot matrix screen and are most frequently used by users, when the vision-impaired users press the entity touch keys, the functions of commonly used homepages, returning, menus and the like can be found immediately, so that the interaction between the vision-impaired users and the intelligent terminal is enhanced, and the user experience is improved.
Further, on the basis of the first embodiment of the intelligent terminal response device of the present invention, a third embodiment of the intelligent terminal response device is proposed, as shown in fig. 5, in the third embodiment, the braille entity touch key includes an intelligent terminal homepage entity touch key, the terminal homepage displays each application, and the second display module 30 includes:
the detection unit 31 is used for detecting the type of the entity touch key corresponding to the second braille information;
the first obtaining unit 32 is configured to obtain a distribution block of each application of the homepage when the type of the entity touch key corresponding to the second braille information is the homepage entity touch key;
when detecting that the touch key operation of the homepage entity is pressed, the terminal displays the corresponding homepage, and the homepage terminal has various applications, and the various applications are displayed in different areas, as shown in fig. 13, a division bar of each block can be generated between different areas to facilitate the distinction.
A generating unit 33, configured to generate a division bar for each block according to a distribution block of each application of the homepage;
the second acquiring unit 34 is configured to acquire corresponding braille information according to the division bars of each block, and use the braille information corresponding to the division bars of each block as third braille information;
and the display unit 35 is used for displaying a braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third braille information so as to be read by a visually impaired user.
Acquiring corresponding braille information according to the separating bars used for each block, and taking the braille information corresponding to the separating bars of each block as third braille information; and generating a corresponding concave-convex dot matrix of the magnetic suspension dot matrix screen according to the corresponding third Braille information, and displaying a Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information for a vision-impaired user to read.
In the embodiment, the detecting unit 31 is used for detecting the type of the physical touch key corresponding to the second braille information; the first obtaining unit 32 is configured to obtain a distribution block of each application of the homepage when the type of the entity touch key corresponding to the second braille information is the homepage entity touch key; a generating unit 33, configured to generate a division bar for each block according to a distribution block of each application of the homepage; the second acquiring unit 34 is configured to acquire corresponding braille information according to the division bars of each block, and use the braille information corresponding to the division bars of each block as third braille information; and the display unit 35 is used for displaying a braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third braille information so as to be read by a visually impaired user. The Braille information corresponding to the separation bars of each block is used as third Braille information; and generating a corresponding concave-convex dot matrix of the magnetic suspension dot matrix screen according to the corresponding third Braille information, so that the visually impaired user can clearly distinguish each application on the main page of the terminal, and the customer experience is improved.
Further, on the basis of the first embodiment of the intelligent terminal response device of the present invention, a fourth embodiment of the intelligent terminal response device is proposed, and in the fourth embodiment, the intelligent terminal response device further includes:
and the fifth acquisition module is used for acquiring the induction information corresponding to the touch operation when the touch operation is detected on the magnetic suspension dot matrix screen or the Braille entity touch key, and playing the corresponding audio file according to the induction information.
When the touch operation is detected, the induction information corresponding to the touch operation is acquired, and the corresponding audio file is played according to the induction information, namely when the touch operation is detected, the audio file corresponding to the touch operation is played according to the touch operation, so that the audio file can be sounded and read during touch reading on the magnetic suspension array screen, or the entity touch key is played when the user touches the entity touch key, so that the visually impaired user and the intelligent terminal can realize more accurate interaction, and the user experience of the visually impaired user is improved.
In this embodiment, the fifth obtaining module is configured to, when a touch operation is detected, obtain sensing information corresponding to the touch operation when the touch operation is detected on the magnetic suspension dot matrix screen or the braille solid touch key, and play the corresponding audio file according to the sensing information. Because the audio interaction is also carried out when the visually impaired user is in touch interaction with the intelligent terminal device, the more accurate interaction between the visually impaired user and the intelligent terminal is realized, and the user experience of the visually impaired user is improved.
Further, on the basis of the first embodiment of the intelligent terminal response device of the present invention, a fifth embodiment of the intelligent terminal response device is provided, in the fifth embodiment, the intelligent terminal includes each picture, and the intelligent terminal response device includes:
the judging module is used for acquiring induction information corresponding to the touch operation when the touch operation is detected on the magnetic suspension dot matrix screen and judging whether the induction information corresponding to the touch operation is a picture or not;
the generating module is used for acquiring a three-dimensional image correspondingly generated by a picture when the sensing information corresponding to the touch operation is detected to be the picture;
when the operation of touching the picture is detected, the picture comprises a photo taken by using a photographing function, a picture in a browsed webpage, pictures of various applications and the like, after the three-dimensional technology processing of a mobile phone CPU, a three-dimensional image generated corresponding to the touch picture is obtained, and corresponding braille information is generated according to the three-dimensional image, namely a corresponding concave-convex dot matrix is generated.
And the third display module is used for controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read.
And controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image, displaying a concave-convex dot matrix interface correspondingly generated by the three-dimensional image on the magnetic suspension dot matrix screen, and displaying a relief effect, as shown in fig. 12, so that the blind user can conveniently touch the magnetic suspension dot matrix screen with hands.
In this embodiment, the determining module is configured to, when a touch operation is detected on the magnetic suspension dot matrix screen, obtain sensing information corresponding to the touch operation, and determine whether the sensing information corresponding to the touch operation is a picture; the generating module is used for acquiring a three-dimensional image correspondingly generated by a picture when the sensing information corresponding to the touch operation is detected to be the picture; and the third display module is used for controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read. When the operation of touching the picture is detected, the concave-convex dot matrix interface which can be touched and identified by the visually impaired people is generated according to the picture correspondence, so that the camera head equipped by the smart phone plays a role, the blind user can know the effect of taking the picture, the interaction between the visually impaired people and the smart phone is enhanced, and the user experience is improved.
The invention also provides an intelligent terminal response method, in a first embodiment of the intelligent terminal response method, referring to fig. 6, the intelligent terminal response method includes:
step S40, when the pressing operation on the magnetic suspension dot matrix screen is detected, the magnetic suspension dot matrix screen comprises a structural layer used as the outer surface of the intelligent terminal and an induction layer arranged on one side of the structural layer facing the inside of the intelligent terminal, the structural layer comprises a plurality of arranged magnetic pieces, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic pieces and an induction device for inducing touch operation, induction information corresponding to each touch operation on the magnetic suspension dot matrix screen is obtained, and the induction information corresponding to each touch operation on the magnetic suspension dot matrix screen is used as first information;
the intelligent terminal comprises various terminals such as a mobile phone and a tablet personal computer which are provided for visual impairment personnel to use, the intelligent terminal comprises a magnetic suspension dot matrix screen, the magnetic suspension dot matrix screen comprises a structural layer as the outer surface of the intelligent terminal and an induction layer arranged on one side of the structural layer facing the inside of the intelligent terminal, the structural layer comprises a plurality of magnetic parts arranged in parallel, the magnetic suspension dot matrix screen comprises a magnetic vertical rod, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic parts and an induction device for inducing touch operation, as shown in figure 9 and figure 10, when the intelligent terminal is opened, the magnetic suspension dot matrix screen can be horizontal, namely, the magnetic parts are at the same height without concave-convex phenomenon, when the magnetic suspension dot matrix screen is horizontal, the magnetic parts can move upwards through triggering control to enable the screen to be in a concave-convex state, when the, acquiring induction information corresponding to each pressing operation on a magnetic suspension dot matrix screen, wherein the pressing operation refers to acquiring the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen when the pressing pressure reaches a preset pressure, taking the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen as first information, namely, when a user presses the magnetic suspension dot matrix screen, a pressing induction layer at the bottom end of the magnetic suspension dot matrix screen induces pressing and triggers the induction information corresponding to the pressing action, namely, if the pressing is the operation of acquiring chat software, each item of data of the chat software is acquired, if the pressing is the starting of a browser, each item of data of the browser is acquired, or when the user uses the browser, the browser takes the induction information as the first information according to each item of data returned by the user operation and the like, and when a visually impaired person presses the magnetic suspension dot matrix screen correspondingly, the sensing information can be obtained in time.
Step S50, acquiring corresponding Braille information according to the first information, and taking the Braille information corresponding to the first information as the first Braille information;
acquiring corresponding braille information according to the first information, using the braille information corresponding to the first information as first braille information, namely, the sensing information corresponding to each pressing operation generates corresponding Braille information, the obtaining of the corresponding Braille information according to the first information comprises generating data which can be read by a regular person, and then the data which can be read by the normal person is displayed in a form which can be identified by the visually impaired, such as the concave-convex amount display of the magnetic piece, if the intelligent terminal needs to display the WeChat two-character, the WeChat two-character which can be read by the common user can be fed back and generated, then the WeChat two-character is displayed on the magnetic suspension dot matrix screen by the concave-convex dot matrix which can be felt and identified by the visually impaired, or the character which can be read by the ordinary user is not generated, the Braille is directly and correspondingly generated, and the corresponding Braille uses the concave-convex dot matrix data as the first Braille information according to the Braille information corresponding to the first information.
And step S60, controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read.
After the corresponding first Braille information is obtained, the intelligent terminal controls the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the corresponding first Braille information and displays the corresponding concave-convex dot matrix interface for the vision-impaired user to read, the concave-convex dot matrix interface is correspondingly generated according to the magnetic suspension principle, the convex dot matrix is generated because the magnetic vertical rod on the corresponding dot matrix on the magnetic suspension dot matrix screen is repelled by the magnetic field, so that the acting force is generated to enable the magnetic vertical rod on the corresponding dot matrix position to be far away from the horizontal plane of the magnetic suspension dot matrix screen, the CPU of the terminal controls the corresponding dot matrix needing to generate the magnetic field according to the first Braille information, so that the magnetic vertical rod on the corresponding dot matrix can correspondingly move to form the concave-convex interface of the magnetic suspension dot matrix screen, and the Braille interface correspondingly generated by the magnetic suspension dot matrix screen according to, and displaying, and the vision-impaired user obtains the information displayed by the concave-convex dot matrix interface according to the concave-convex dot matrix interface displayed on the magnetic suspension dot matrix screen.
In this embodiment, when a pressing operation on the magnetic suspension dot matrix screen is detected, the magnetic suspension dot matrix screen includes a structural layer as an outer surface of the intelligent terminal and an induction layer disposed on one side of the structural layer facing the inside of the intelligent terminal, the structural layer includes a plurality of magnetic members, the induction layer includes a magnetic field device for controlling the concave-convex amount of the magnetic members and an induction device for inducing a touch operation, induction information corresponding to each touch operation on the magnetic suspension dot matrix screen is obtained, and the induction information corresponding to each touch operation on the magnetic suspension dot matrix screen is used as first information; acquiring corresponding braille information according to the first information, and taking the braille information corresponding to the first information as first braille information; and controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen for reading by a vision-impaired user. Because the intelligent terminal magnetic suspension dot matrix screen can acquire the operation of the visually impaired user, namely the visually impaired user can press the magnetically suspended dot matrix screen to send out the operation, and the corresponding Braille dot matrix interface is displayed according to the operation feedback, and the fed Braille dot matrix interface can be identified and read by the visually impaired user. Thereby realized intelligent terminal and the mutual between the visual barrier crowd, solved the visual barrier personnel can only be single with the information processing back in the terminal, show and read for the visual barrier personnel, and the visual barrier personnel can not read the content that self is interested according to the demand to correspondingly promoted the experience of looking the visual barrier user, let the blind person also can enjoy the life experience that science and technology brought, also can experience current smart mobile phone more and bring the facility for the ordinary people.
Further, on the basis of the first embodiment of the intelligent terminal response method of the present invention, a second embodiment of the intelligent terminal response method is proposed, as shown in fig. 7, in the second embodiment, the intelligent terminal includes a whole machine frame, the intelligent terminal includes braille entity touch keys arranged on the whole machine frame or on the magnetic suspension dot matrix screen,
the intelligent terminal response method further comprises the following steps:
step S10, when the touch operation on the Braille entity touch key is detected, acquiring the induction information corresponding to the entity touch key instruction, and taking the induction information corresponding to the touch operation on the entity touch key instruction as second information;
the Braille entity touch keys are positioned at the lower end or the periphery of the magnetic suspension dot matrix screen, the Braille entity touch keys comprise a menu key, a main page key, a return key and the like, which are the most commonly used keys for users, and a corresponding rugged mark is arranged above each key, and comprises dot matrix Braille and the like, as shown in figure 11. And acquiring induction information corresponding to the operation of the entity touch key by touching and pressing the keys, and taking the induction information corresponding to the operation of the entity touch key as second information.
Step S20, acquiring corresponding Braille information according to the second information, and taking the Braille information corresponding to the second information as second Braille information;
and acquiring corresponding braille information according to the second information, taking the braille information corresponding to the second information as the second braille information, acquiring the braille information correspondingly displayed by the homepage key when the visually impaired user presses the entity homepage key, and correspondingly generating corresponding braille by the characters which can be identified by common users such as a telephone, a short message, music, a radio, a camera, a browser and the like if the homepage key is provided with the telephone, the short message, the music, the radio, the camera, the browser and the like so as to be displayed on a magnetic suspension dot matrix screen.
And step S30, controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read.
And displaying the Braille dot matrix interface correspondingly generated by the magnetic suspension dot matrix screen according to the second Braille information for the visually impaired user to read, acquiring the dot matrix required to be protruded on the magnetic suspension dot matrix screen according to the second Braille information, and forming a magnetic field at the corresponding dot matrix to control the protrusion of the magnetic vertical rod so as to form the dot matrix interface for the visually impaired user to touch and read.
In the embodiment, when the touch operation on the Braille entity touch key is detected, the sensing information corresponding to the entity touch key instruction is acquired, and the sensing information corresponding to the touch operation on the entity touch key instruction is taken as the second information; acquiring corresponding braille information according to the second information, and taking the braille information corresponding to the second information as second braille information; and controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for reading by a vision-impaired user. Because the pressing entity touch keys are arranged around the magnetic suspension dot matrix screen and are most frequently used by users, when the vision-impaired users press the entity touch keys, the functions of commonly used homepages, returning, menus and the like can be found immediately, so that the interaction between the vision-impaired users and the intelligent terminal is enhanced, and the user experience is improved.
Further, on the basis of the first embodiment of the intelligent terminal response method of the present invention, a third embodiment of the intelligent terminal response method is provided, as shown in fig. 8, in the third embodiment, the braille entity touch key includes an intelligent terminal homepage entity touch key, the terminal homepage displays each application, the amount of unevenness of the magnetic member on the magnetic suspension dot matrix screen is controlled according to the second braille information, so as to display a braille dot matrix interface corresponding to the second braille information on the magnetic suspension dot matrix screen, so that the visually impaired user can read the braille dot matrix interface, including:
detecting the type of an entity touch key corresponding to the second Braille information;
the distribution block is used for acquiring the distribution blocks of each application of the homepage when the type of the entity touch key corresponding to the second braille information is the homepage entity touch key;
when detecting that the touch key operation of the homepage entity is pressed, the terminal displays the corresponding homepage, and the homepage terminal has various applications, and the various applications are displayed in different areas, as shown in fig. 13, a division bar of each block can be generated between different areas to facilitate the distinction.
Generating a division bar of each block according to the distribution block of each application of the homepage;
acquiring corresponding braille information according to the separating bars of the blocks, and taking the braille information corresponding to the separating bars of the blocks as third braille information;
and displaying a Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information for a vision-impaired user to read.
Acquiring corresponding braille information according to the separating bars used for each block, and taking the braille information corresponding to the separating bars of each block as third braille information; and generating a corresponding concave-convex dot matrix of the magnetic suspension dot matrix screen according to the corresponding third Braille information, and displaying a Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information for a vision-impaired user to read.
In the embodiment, the type of the entity touch key corresponding to the second braille information is detected; when the type of the entity touch key corresponding to the second Braille information is a homepage entity touch key, acquiring a distribution block of each application of the homepage; generating a division bar of each block according to the distribution block of each application of the homepage; acquiring corresponding braille information according to the separating bars of the blocks, and taking the braille information corresponding to the separating bars of the blocks as third braille information; and displaying a Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information for a vision-impaired user to read. The Braille information corresponding to the separation bars of each block is used as third Braille information; and generating a corresponding concave-convex dot matrix of the magnetic suspension dot matrix screen according to the corresponding third Braille information, so that the visually impaired user can clearly distinguish each application on the main page of the terminal, and the customer experience is improved.
Further, on the basis of the first embodiment of the intelligent terminal response method of the present invention, a fourth embodiment of the intelligent terminal response method is proposed, and in the fourth embodiment, the intelligent terminal response method further includes:
and when the touch operation is detected on the magnetic suspension dot matrix screen or the Braille entity touch key, acquiring induction information corresponding to the touch operation, and playing a corresponding audio file according to the induction information.
When the touch operation is detected, the induction information corresponding to the touch operation is acquired, and the corresponding audio file is played according to the induction information, namely when the touch operation is detected, the audio file corresponding to the touch operation is played according to the touch operation, so that the audio file can be sounded and read during touch reading on the magnetic suspension array screen, or the entity touch key is played when the user touches the entity touch key, so that the visually impaired user and the intelligent terminal can realize more accurate interaction, and the user experience of the visually impaired user is improved.
In this embodiment, when the touch operation is detected, and when the touch operation is detected on the magnetic suspension dot matrix screen or the braille solid touch key, the sensing information corresponding to the touch operation is acquired, and the corresponding audio file is played according to the sensing information. Because the audio interaction is also carried out when the visually impaired user is in touch interaction with the intelligent terminal device, the more accurate interaction between the visually impaired user and the intelligent terminal is realized, and the user experience of the visually impaired user is improved.
Further, on the basis of the first embodiment of the intelligent terminal response method of the present invention, a fifth embodiment of an intelligent terminal response method is provided, in the fifth embodiment, the intelligent terminal includes each picture, and the intelligent terminal response method includes:
when touch operation is detected on the magnetic suspension dot matrix screen, acquiring induction information corresponding to the touch operation, and judging whether the induction information corresponding to the touch operation is a picture or not;
when sensing information corresponding to the touch operation is detected to be a picture, acquiring a three-dimensional image correspondingly generated by the picture;
when the operation of touching the picture is detected, the picture comprises a photo taken by using a photographing function, a picture in a browsed webpage, pictures of various applications and the like, after the three-dimensional technology processing of a mobile phone CPU, a three-dimensional image generated corresponding to the touch picture is obtained, and corresponding braille information is generated according to the three-dimensional image, namely a corresponding concave-convex dot matrix is generated.
And controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read.
And controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image, displaying a concave-convex dot matrix interface correspondingly generated by the three-dimensional image on the magnetic suspension dot matrix screen, and displaying a relief effect, as shown in fig. 12, so that the blind user can conveniently touch the magnetic suspension dot matrix screen with hands.
In this embodiment, when a touch operation is detected on the magnetic suspension dot matrix screen, sensing information corresponding to the touch operation is acquired, and whether the sensing information corresponding to the touch operation is a picture is judged; when sensing information corresponding to the touch operation is detected to be a picture, acquiring a three-dimensional image correspondingly generated by the picture; and controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read. When the operation of touching the picture is detected, the concave-convex dot matrix interface which can be touched and identified by the visually impaired people is generated according to the picture correspondence, so that the camera head equipped by the smart phone plays a role, the blind user can know the effect of taking the picture, the interaction between the visually impaired people and the smart phone is enhanced, and the user experience is improved.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. An intelligent terminal response device, characterized in that the intelligent terminal response device comprises:
the magnetic suspension dot matrix screen comprises a structural layer and an induction layer, wherein the structural layer is used as the outer surface of the intelligent terminal, the induction layer is arranged on one side, facing the inside of the intelligent terminal, of the structural layer, the structural layer comprises a plurality of arranged magnetic pieces, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic pieces and an induction device for inducing touch operation, induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is obtained, and the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is used as first information;
the second acquisition module is used for acquiring the corresponding braille information according to the first information and taking the braille information corresponding to the first information as the first braille information;
the first display module is used for controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen, wherein the concave-convex dot matrix interface is correspondingly generated according to the magnetic suspension principle, and the convex dot matrix is formed by the repulsion action of a magnetic field on a magnetic vertical rod on a corresponding dot matrix on the magnetic suspension dot matrix screen, so that the magnetic vertical rod on the corresponding dot matrix position is kept away from the horizontal plane of the magnetic suspension dot matrix screen by an acting force to be read by a visually impaired user.
2. The intelligent terminal response device according to claim 1, wherein the intelligent terminal comprises a whole machine frame, the intelligent terminal comprises Braille solid touch keys arranged on the whole machine frame or a magnetic suspension dot matrix screen,
the intelligent terminal response device further comprises:
the third acquisition module is used for acquiring the induction information corresponding to the physical touch key operation when the pressing operation on the Braille physical touch key is detected, and taking the induction information corresponding to the pressing operation on the physical touch key operation as second information;
the fourth acquiring module is used for acquiring the corresponding braille information according to the second information and taking the braille information corresponding to the second information as the second braille information;
and the second display module is used for controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read.
3. The intelligent terminal response device of claim 2, wherein the Braille physical touch key comprises an intelligent terminal home page physical touch key, the intelligent terminal home page displaying respective applications,
the second display module includes:
the detection unit is used for detecting the type of the entity touch key corresponding to the second braille information;
the first obtaining unit is used for obtaining distribution blocks of each application of the homepage when the type of the entity touch key corresponding to the second braille information is the homepage entity touch key;
the generating unit is used for generating the separating bar of each block according to the distribution block of each application of the homepage;
the second acquisition unit is used for acquiring corresponding braille information according to the separating bars of the blocks, and taking the braille information corresponding to the separating bars of the blocks as third braille information;
and the display unit is used for displaying the Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information so as to be read by the visually impaired user.
4. The intelligent terminal response device according to claim 1, wherein the intelligent terminal comprises Braille solid touch keys arranged on the whole machine frame or the magnetic suspension dot matrix screen,
the intelligent terminal response device further comprises:
and the fifth acquisition module is used for acquiring the induction information corresponding to the touch operation when the touch operation is detected on the magnetic suspension dot matrix screen or the Braille entity touch key, and playing the corresponding audio file according to the induction information.
5. The intelligent terminal response device according to claim 1, wherein the intelligent terminal contains each picture, the intelligent terminal response device further comprising:
the judging module is used for acquiring induction information corresponding to the touch operation when the touch operation is detected on the magnetic suspension dot matrix screen and judging whether the induction information corresponding to the touch operation is a picture or not;
the generating module is used for acquiring a three-dimensional image correspondingly generated by a picture when the sensing information corresponding to the touch operation is detected to be the display picture;
and the third display module is used for controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read.
6. An intelligent terminal response method is characterized by comprising the following steps:
when the pressing operation on the magnetic suspension dot matrix screen is detected, the magnetic suspension dot matrix screen comprises a structural layer serving as the outer surface of the intelligent terminal and an induction layer arranged on one side of the structural layer, facing the inside of the intelligent terminal, the structural layer comprises a plurality of arranged magnetic pieces, the induction layer comprises a magnetic field device for controlling the concave-convex amount of the magnetic pieces and an induction device for inducing touch operation, induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is obtained, and the induction information corresponding to each pressing operation on the magnetic suspension dot matrix screen is used as first information;
acquiring corresponding braille information according to the first information, and taking the braille information corresponding to the first information as first braille information;
the concave-convex amount of the magnetic pieces on the magnetic suspension dot matrix screen is controlled according to the first Braille information so as to display a Braille dot matrix interface corresponding to the first Braille information on the magnetic suspension dot matrix screen, wherein the concave-convex dot matrix interface is correspondingly generated according to a magnetic suspension principle, and the convex dot matrix is generated because the magnetic vertical rods on the corresponding dot matrix on the magnetic suspension dot matrix screen are repelled by a magnetic field, so that acting force is generated to enable the magnetic vertical rods on the corresponding dot matrix position to be far away from the horizontal plane of the magnetic suspension dot matrix screen so as to be read by a visually impaired user.
7. The intelligent terminal response method according to claim 6, wherein the intelligent terminal comprises a whole machine frame, the intelligent terminal comprises Braille entity touch keys arranged on the whole machine frame or a magnetic suspension dot matrix screen,
the intelligent terminal response method further comprises the following steps:
when the pressing operation on the Braille entity touch key is detected, acquiring sensing information corresponding to the entity touch key operation, and taking the sensing information corresponding to the pressing operation on the entity touch key operation as second information;
acquiring corresponding braille information according to the second information, and taking the braille information corresponding to the second information as second braille information;
and controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for reading by a vision-impaired user.
8. The smart terminal response method of claim 7, wherein the Braille physical touch key comprises a smart terminal home page physical touch key, the smart terminal home page displaying respective applications,
the step of controlling the concave-convex amount of the magnetic piece on the magnetic suspension dot matrix screen according to the second Braille information so as to display a Braille dot matrix interface corresponding to the second Braille information on the magnetic suspension dot matrix screen for a vision-impaired user to read comprises the following steps:
detecting the type of an entity touch key corresponding to the second Braille information;
when the type of the entity touch key corresponding to the second Braille information is a homepage entity touch key, acquiring a distribution block of each application of the homepage;
generating a division bar of each block according to the distribution block of each application of the homepage;
acquiring corresponding braille information according to the separating bars of the blocks, and taking the braille information corresponding to the separating bars of the blocks as third braille information;
and displaying a Braille dot matrix interface generated by the magnetic suspension dot matrix screen according to the third Braille information for a vision-impaired user to read.
9. The intelligent terminal response method according to claim 6, wherein the intelligent terminal comprises Braille solid touch keys arranged on the whole machine frame or the magnetic suspension dot matrix screen,
the intelligent terminal response method further comprises the following steps:
and when the touch operation is detected on the magnetic suspension dot matrix screen or the Braille entity touch key, acquiring induction information corresponding to the touch operation, and playing a corresponding audio file according to the induction information.
10. The intelligent terminal response method according to claim 6, wherein the intelligent terminal contains each picture, and the intelligent terminal response method further comprises:
when touch operation is detected on the magnetic suspension dot matrix screen, acquiring induction information corresponding to the touch operation, and judging whether the induction information corresponding to the touch operation is a picture or not;
when sensing information corresponding to touch operation is detected to be a display picture, acquiring a three-dimensional image correspondingly generated by the picture;
and controlling the concave-convex amount of the magnetic part on the magnetic suspension dot matrix screen according to the correspondingly generated three-dimensional image so as to display the three-dimensional image on the magnetic suspension dot matrix screen for the vision-impaired user to read.
CN201610998260.1A 2016-11-11 2016-11-11 Intelligent terminal response device and method Expired - Fee Related CN106569726B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610998260.1A CN106569726B (en) 2016-11-11 2016-11-11 Intelligent terminal response device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610998260.1A CN106569726B (en) 2016-11-11 2016-11-11 Intelligent terminal response device and method

Publications (2)

Publication Number Publication Date
CN106569726A CN106569726A (en) 2017-04-19
CN106569726B true CN106569726B (en) 2020-06-09

Family

ID=58542717

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610998260.1A Expired - Fee Related CN106569726B (en) 2016-11-11 2016-11-11 Intelligent terminal response device and method

Country Status (1)

Country Link
CN (1) CN106569726B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108196806A (en) * 2018-01-02 2018-06-22 努比亚技术有限公司 Double-sided screen content displaying method, double-sided screen mobile terminal and computer-readable medium
CN110109584B (en) * 2019-05-05 2021-08-20 武汉网明无障碍科技有限公司 Data processing method and device for calling menu
CN110850972B (en) * 2019-10-29 2024-02-13 深圳市证通电子股份有限公司 Braille input method, braille input device and computer readable storage medium
CN111078048A (en) * 2019-12-17 2020-04-28 中国建设银行股份有限公司 Touch display device and touch method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101150616A (en) * 2006-09-19 2008-03-26 北京三星通信技术研究有限公司 Braille character display device and communication terminal with this device
CN104461346A (en) * 2014-10-20 2015-03-25 天闻数媒科技(北京)有限公司 Method and device for visually impaired people to touch screen and intelligent touch screen mobile terminal
CN104506733A (en) * 2014-12-31 2015-04-08 北京百纳威尔科技有限公司 External connected equipment and braille displaying method using external connected equipment
CN104869204A (en) * 2015-06-14 2015-08-26 吉林大学 Blind person tactile representation intelligent touch screen terminal and dialing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101150616A (en) * 2006-09-19 2008-03-26 北京三星通信技术研究有限公司 Braille character display device and communication terminal with this device
CN104461346A (en) * 2014-10-20 2015-03-25 天闻数媒科技(北京)有限公司 Method and device for visually impaired people to touch screen and intelligent touch screen mobile terminal
CN104506733A (en) * 2014-12-31 2015-04-08 北京百纳威尔科技有限公司 External connected equipment and braille displaying method using external connected equipment
CN104869204A (en) * 2015-06-14 2015-08-26 吉林大学 Blind person tactile representation intelligent touch screen terminal and dialing method

Also Published As

Publication number Publication date
CN106569726A (en) 2017-04-19

Similar Documents

Publication Publication Date Title
US9569088B2 (en) Scrolling method of mobile terminal
EP2799972B1 (en) Mobile terminal capable of dividing a screen and a method of controlling the mobile terminal
KR101824007B1 (en) Mobile terminal and multitasking method thereof
CN106569726B (en) Intelligent terminal response device and method
EP2851791A2 (en) Mobile terminal
EP2423796B1 (en) Mobile terminal and displaying method thereof
CN101893985B (en) Method for controlling menu in mobile terminal and mobile terminal using the same
US20120038668A1 (en) Method for display information and mobile terminal using the same
KR102088909B1 (en) Mobile terminal and modified keypad using method thereof
US9569894B2 (en) Glass type portable device and information projecting side searching method thereof
CN102171639A (en) Live preview of open windows
CN106791198B (en) Intelligent terminal and fingerprint identification and positioning method
KR20160139320A (en) Deformable display device and operating method thereof
CN105843508B (en) Mobile terminal and its screenshotss method
CN106547446A (en) Using switching device and method
CN106412339A (en) Notification message processing method and apparatus
CN106603829A (en) Screen capture method and mobile terminal
CN106850941A (en) Method, photo taking and device
KR20180043019A (en) Mobile terminal
CN105100463B (en) Terminal SIM switching device and method
CN106657670A (en) Mobile terminal and application triggering method based on mobile terminal
CN106406621A (en) Mobile terminal and method of processing touch control operation for mobile terminal
CN106569682B (en) Touch screen display content selection apparatus and method
US10491742B2 (en) Mobile terminal and control method thereof
KR20150056356A (en) Mobile terminal and method of controlling the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20200518

Address after: No. 56, Shiyang Road, Qinhuai District, Nanjing City, Jiangsu Province

Applicant after: NANJING BAIXIA HIGH-TECHNOLOGY INDUSTRY PARK INVESTMENT DEVELOPMENT Co.,Ltd.

Address before: 518057 Guangdong Province, Shenzhen high tech Zone of Nanshan District City, No. 9018 North Central Avenue's innovation building A, 6-8 layer, 10-11 layer, B layer, C District 6-10 District 6 floor

Applicant before: NUBIA TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200609

Termination date: 20201111

CF01 Termination of patent right due to non-payment of annual fee