CN111913770A

CN111913770A - Display method, display device, electronic apparatus, and medium

Info

Publication number: CN111913770A
Application number: CN202010650306.7A
Authority: CN
Inventors: 邵迪
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-07-08
Filing date: 2020-07-08
Publication date: 2020-11-10

Abstract

The application discloses a display method, a display device, electronic equipment and a medium, and belongs to the technical field of communication. The method is applied to an electronic device which comprises a first display area and a second display area, and comprises the following steps: displaying first content in a first display area; acquiring target content meeting preset conditions according to the first content; converting the target content into braille to obtain target braille; and displaying the target braille in the second display area. Through converting the content that satisfies preset condition in the first display area into the braille and showing in the second display area, can solve privacy nature poor under the visually impaired person's user mode, the problem of information acquisition inefficiency.

Description

Display method, display device, electronic apparatus, and medium

Technical Field

The present application belongs to the field of communications technologies, and in particular, to a display method, an apparatus, an electronic device, and a medium.

Background

Along with the development of electronic equipment, people live more and more conveniently, and the acquisition of information is also more and more convenient. In order to allow more visually impaired people to obtain information equally, it is necessary to provide a method for allowing the visually impaired people to obtain information via an electronic device, for example, to allow the visually impaired people to read characters in the electronic device.

In the current electronic device, aiming at the information output mode adopted by the visually impaired user, each element displayed in the electronic device is mainly converted into voice for broadcasting, or the user is enabled to operate through the voice.

In the process of implementing the present application, the inventor finds that at least the following problems exist in the prior art:

in the existing mode, some private information of a user may not be expected to be broadcasted by voice, so that the existing mode has poor privacy. In addition, for some users who have slow response, the voice broadcasting mode easily causes situations such as information omission or information overload, and the efficiency of obtaining information by the users is low.

Disclosure of Invention

The embodiment of the application aims to provide a display method, a display device, electronic equipment and a display medium, which can solve the problems of poor privacy and low information acquisition efficiency of a visually impaired in a use mode.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a display method, which is applied to an electronic device, where the electronic device includes a first display area and a second display area, and the method includes:

displaying first content in the first display area;

acquiring target content meeting preset conditions according to the first content;

converting the target content into braille to obtain target braille;

and displaying the target braille in the second display area.

In a second aspect, an embodiment of the present application provides a display apparatus applied to an electronic device, where the electronic device includes a first display area and a second display area, and the apparatus includes:

the first display module is used for displaying first content in the first display area;

the acquisition module is used for acquiring target content meeting preset conditions according to the first content;

the conversion module is used for converting the target content into braille to obtain target braille;

and the second display module is used for displaying the target braille in the second display area.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a display, a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the display includes a first display area and a second display area, and the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect.

In a fourth aspect, the present invention provides a readable storage medium, which is applied to an electronic device, the electronic device includes a first display area and a second display area, and the readable storage medium stores a program or instructions, and the program or instructions, when executed by a processor, implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip applied to an electronic device, where the electronic device includes a first display area and a second display area, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, the electronic equipment comprising the first display area and the second display area is utilized to convert the target content meeting the preset condition in the first display area into the target Braille and display the target Braille in the second display area. In the mode, the character information is displayed through the braille, and compared with a voice broadcasting mode, the method has better privacy. In addition, the information can be repeatedly acquired by the user through the display of the braille, the information omission and the information overload in a short time are avoided as much as possible, and the efficiency of the visually impaired user in acquiring the information is improved.

Drawings

Fig. 1 is a schematic flowchart of a display method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of an icon and Braille correspondence provided by an embodiment of the application;

FIG. 3 is a schematic illustration of a full scale display provided by an embodiment of the present application;

fig. 4 is a schematic diagram illustrating a gesture correspondence relationship provided in an embodiment of the present application;

FIG. 5 is a schematic diagram of a workflow of a preset algorithm model according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a blind key provided by an embodiment of the present application;

fig. 7 is a schematic diagram of a display device according to an embodiment of the present application;

fig. 8 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

As described in the background art, the current methods adopted by users with visual impairment are mainly to convert each element displayed in the display screen into voice for reading, or to operate through voice, or to customize some braille keyboards and customized screens for the blind, but these methods have some defects: such as:

1. some private information may not be desired to be broadcasted by voice, and the privacy is poor.

2. Excessive voice description can cause information omission or information overload, and influence a user to acquire information.

3. Some hardware improvements increase the complexity of manufacturing and difficulty of using electronic devices.

In order to solve the above problem, the following describes in detail a display method provided by an embodiment of the present application through a specific embodiment and an application scenario thereof with reference to the accompanying drawings.

Referring to fig. 1, fig. 1 shows a schematic flow chart of a display method provided in an embodiment of the present application. The method is applied to electronic equipment, and the electronic equipment comprises a first display area and a second display area, namely the execution main body of the embodiment of the application is the electronic equipment comprising two screens, such as a double-sided screen mobile phone. The method comprises the following steps:

and S110, displaying the first content in the first display area.

In this embodiment, the first display area is used for displaying information, and a user may perform a sliding operation or the like on the first display area, that is, the first display area has the same function as a display screen of a common single-screen electronic device.

And S120, acquiring target content meeting preset conditions according to the first content.

In this embodiment, the first content is not necessarily converted into braille, but needs to be selected and extracted from the first content, and the target content may be a part of the first content or may also be content obtained by performing summary analysis on the first content.

How to extract the target content will be described in detail later.

And S130, converting the target content into braille to obtain the target braille.

The braille conversion mode can be realized by utilizing a braille conversion program arranged in the electronic equipment, and the type of the braille conversion program and the specific algorithm used are not limited in the application.

And S140, displaying the target braille in the second display area.

The second display area is mainly used for displaying the information of the first display area in braille. Optionally, the second display area supports display of braille convex points, and a user can receive braille through body sensation of limbs in the second display area. The specific way of displaying the braille convex points can include any one of the following: 1. the second display area adopts an electrical stimulation technology to convert different braille convex points into electrical stimulation signals to stimulate the touch sense of human fingers and form different touch sense; 2. the second display area adopts a physical touch pad to convert the Braille signals into Braille grids of the touch pad, so that a user can feel Braille information; 3. the second display area generates different ultrasonic vibrations to different braille convex points through an ultrasonic technology, so that the fingers of a user can feel different touch feelings. Alternatively, the above purpose of making the user feel braille can be achieved in other manners, which is not limited in the present application.

In some embodiments of the present application, the S120 may include at least one of:

when the first content is an image, first content information included in the first content is identified by an image identification method, and the first content information is used as target content. Referring to fig. 2, fig. 2 is a schematic diagram of an icon and braille correspondence according to an embodiment of the present application.

When the first content is a video, second content information included in the first content is recognized by an image recognition method and/or a voice recognition method, and the second content information is used as a target content.

In the embodiment, the information in the images and the videos can be identified through image identification, voice identification and the like, and the text description is displayed, so that the visually impaired user can browse the images and the videos, the way for the visually impaired user to acquire the information is increased, and the use of the electronic equipment by the visually impaired user is facilitated. For example, if the first content is a photo of star a, information such as the name, hair style, clothing, background, etc. of star a can be recognized by an image recognition method, and then the information can be displayed by braille, so that the user can know the content of the currently displayed photo. The specific image recognition mode can be the mode of firstly adopting a deep learning network to carry out image recognition and then combining a target detection and main body extraction model to carry out image content recognition, or other image recognition modes can be adopted, and the specific contents of the image recognition mode and the voice recognition mode are not limited in the application.

In other embodiments of the present application, the S120 may include:

and performing semantic processing on the first content to obtain an abstract of the first content, and taking the abstract as target content.

In this embodiment, the natural language processing technology is used to perform relevant semantic summarization and summarization on the first content, and the semantic summarization may adopt methods such as a topic model and an abstract extraction model. For example, for the whole reading content (such as news text, novel, etc.), the content is screened and summarized and displayed by using the abstract summary technology of machine learning. In this way, when the first content comprises a large amount of text information, the braille displaying the summary information can be used for enabling the user to quickly know the first content, and the time of the user is saved.

In addition, in another embodiment of the present application, in S120, after obtaining the summary of the first content, the summary and the first content may be simultaneously used as the target content. The following S140 may include:

a selection input by a user within the second display area is received. Optionally, the selection input may be a trigger input to a specific control in the second display area, for example, two selection buttons may be disposed in the second display area, and respectively correspond to the summary presentation and the full-size presentation. Or the selection input may be a specific type of input operation such as a long press input or the like. The present embodiment does not limit the specific contents of the selection input.

And responding to the selection input, and displaying the target braille corresponding to the first content or the target braille corresponding to the abstract in the second display area.

In the implementation, the selection of displaying the braille abstract or displaying the braille of the first content in a full scale can be selected according to the selection input of the user, so that the selection range of the user is enlarged, and the user can select the braille display mode according to the requirement of the user. In addition, optionally, the user can also select the target braille corresponding to the displayed abstract firstly to learn preliminarily, and then select the target braille corresponding to the displayed first content to read integrally. For example, the braille display of the abstract can be selected when the first content has a large number of characters, and when the number of characters of the first content exceeds 200 characters or more. The full-scale display refers to braille translation display of the first content one-to-one, and is suitable for displaying module content, news titles and the like in the APP, as shown in fig. 3, fig. 3 is a schematic diagram of full-scale display provided by the embodiment of the application.

In some further embodiments of the present application, the S120 may specifically include:

recording a snapshot of first content; the snapshot here can be understood as a real-time screen capture of the first display area.

And identifying the target content meeting the preset condition in the snapshot in an image identification mode.

In this embodiment, the snapshot is directly utilized to obtain the content information in the first display area, and under the condition that the content in the first display area is constantly changed, the integrity of obtaining the first content can be ensured.

In some embodiments, all the contents in the first display area may also be taken as the first contents, and the following S120 may include:

and receiving a fourth input of the user in the first display area, and determining the target content in the first content according to the fourth input.

That is, in the present embodiment, the satisfaction of the preset condition means belonging to the selection range of the fourth input. In this way, the user can select the target content by himself, and the autonomy of the user is stronger.

In other embodiments, the method may further comprise: the first content is converted into the first braille in its entirety.

Accordingly, S140 may include:

the first Braille corresponding to the first content is displayed in a Braille convex point mode, and the protruding degree of the target Braille in the first Braille is larger than the protruding degree of other Braille parts in the first Braille.

That is, in this embodiment, the degree of protrusion of the target content part sensed by the user is greater than the degree of protrusion of the other content parts, so that the user can clearly know which parts of the first content are the target content, and the user has a better recognition effect.

In still other embodiments of the present application, the S140 may include:

and when the first link is associated with the target content, associating the target braille with the first link.

And displaying the target braille and first prompt information associated with the first link in the second display area, wherein the first prompt information is used for prompting the user of the target braille operation mode and/or the target operation mode of the first link.

The target operation mode herein may include what operations the user may perform on the target braille and the effect of each operation, for example, gesture 1 is open, gesture 2 is delete, gesture 3 is close, and the like.

In the embodiment, by associating the target braille with the first link, the user is enabled to perform relevant operations on the target braille displayed on the second display area, and the specific operation contents depend on the first link with which the target contents are associated, such as opening, closing, moving, deleting, and the like. The mode increases the operable range of the user in the second display area, so that the visually impaired user can operate according to the Braille, and the use of the electronic equipment by the visually impaired user is facilitated. For example, if the target content is an icon of a desktop, the names of the APPs are displayed in the second display area through braille, and the user is supported to operate the names of the APPs. For example, the click operation: show APP introduction, double click operation: the APP can be opened, and the dragging operation is performed for a long time: the APP can be moved, and clicking operation is performed after long-time pressing: the APP will be deleted. Of course, the above are only some specific examples, and the operation content corresponding to each operation may be configured by the user in a personalized manner.

In addition, optionally, a corresponding relationship between the operation manner in the first display area and the operation manner in the second display area may be preset in the electronic device, for example, a function of a single-click operation in the first display area is realized by a double-click operation in the second display area. Referring to fig. 4, fig. 4 is a schematic diagram of a gesture correspondence relationship provided in the embodiment of the present application. The corresponding relation can be set by user self-definition.

In other embodiments, prior to S110, the method may further include:

and triggering and starting the Braille conversion function.

Namely, after the electronic equipment starts the Braille conversion function, the electronic equipment can convert the display content into Braille, thereby being convenient for the visually impaired to service.

Specifically, the function of triggering and starting the braille conversion can be realized by at least one of the following modes:

and receiving a second input of the user, and starting the Braille conversion function in response to the second input. Namely, the user can autonomously decide whether to start the Braille conversion function, so that the autonomy of the user is stronger. For example, a braille button can be arranged on the side surface of the electronic equipment, and the second input is input of the braille button by the user; or a voice instruction may be preset, the second input is a voice input, etc.

And starting the Braille conversion function under the condition that the preset input operation of the user on the first preset keyword or the preset application program is detected. In this implementation, the user may set some keywords, for example, account numbers, passwords, and other words related to the privacy information, or may set some applications, for example, applications related to the privacy information of the user such as a pay bank, a spring rain doctor, and the like, and when the user hits a first preset keyword or a preset application in the process of using the electronic device, the braille conversion function may be turned on, and subsequent information corresponding to the first preset keyword or the preset application is converted into braille to be displayed, thereby improving the security and the confidentiality of the privacy information of the user.

In the voice broadcasting process, the Braille conversion function is started under the condition that the next broadcasting word is detected to be the second preset keyword. Optionally, the second preset keyword includes information related to user privacy. Because the voice broadcast in-process, voice broadcast's content is heard by people around easily, and secret nature is relatively poor, consequently detect next report word and predetermine the keyword for the second, for example when information such as user name, account number, password, convert the braille display promptly, can improve user information's security, avoid the privacy that voice broadcast caused to reveal.

Scene recognition is carried out through a pre-trained preset algorithm model and the currently acquired electronic equipment use information, and the Braille conversion function is started under the condition that the recognized scene belongs to a first preset scene. The preset algorithm model is arranged on the electronic equipment or the cloud. In this implementation, an automatic auxiliary judgment mode may be set, after the mode is opened, the electronic device may collect the usage trace of the user after the user opens the trace collection function, the usage trace may include a usage period, specific content of browsing information, sensitivity of browsing information, and the like, and combine usage habits of the user, keywords set by the user, environmental information where the electronic device is located (for example, whether the electronic device is in a noisy environment, whether the electronic device is in a quiet environment such as a court, a hospital, and the like), application information, content information displayed, and the like, and under the condition that the user allows, combine an algorithm processing module of the electronic device and an own big data processing algorithm of the cloud to judge whether to trigger the braille display in real time. Referring to fig. 5, fig. 5 is a schematic workflow diagram of a preset algorithm model according to an embodiment of the present application. A preset algorithm model, such as a logistic regression model, a support vector machine model, etc., may be implanted in the algorithm processing module of the electronic device; or, a more complex preset algorithm model, such as a large-scale deep neural network model, can be deployed on the cloud server, so that the relevant scene recognition of the braille conversion function can be rapidly and effectively performed. In addition, under the condition of utilizing the cloud to perform scene recognition, under the condition of user authorization, the use information of the electronic equipment can be encrypted and then uploaded to the cloud. And the preset algorithm model can be optimized through the use information of the electronic equipment acquired each time, so that more accurate auxiliary judgment can be conveniently carried out subsequently.

In some embodiments, in the case that the next broadcast word is detected as the second preset keyword in the voice broadcast process, or in the case that the next broadcast word is detected as the third preset keyword in the voice broadcast process after the braille conversion function is turned on, the above S120 may include:

recording a first display position of the content read by voice broadcasting, and stopping the voice broadcasting;

and taking the content behind the first display position in the display content in the first display area as target content.

In this embodiment, if the braille conversion function is triggered to be turned on in the voice broadcast, it indicates that the privacy information of the user is detected in the voice broadcast process or the user actively triggers to enter the braille conversion function, so that the braille display needs to be started. If the Braille conversion function is started before but the Braille conversion function is still in the voice broadcast currently, the fact that the voice broadcast is allowed under the Braille conversion function is indicated, in this case, in order to protect the privacy of the user, the fact that the privacy information is detected is indicated under the condition that a third preset keyword is detected, and the voice broadcast is stopped to enter a Braille display stage. Because the contents displayed in the first display area usually comprise the contents which are subjected to voice broadcast, and users of the contents know the contents and do not need to read the contents, the subsequent contents are directly converted into braille according to the position read by the voice broadcast, so that the data volume which needs to be converted into the braille is reduced, the braille conversion efficiency is improved, the position read before the user needs not to be searched when the user subsequently reads the target braille, and the reading convenience of the user is improved.

Optionally, the first display position may be a first display area coordinate, corresponding screen coordinate systems are disposed in the first display area and the second display area, and different screen coordinates correspond to different screen positions.

In a further embodiment, after S130, before S140, the method may further include:

and outputting a voice prompt, wherein the voice prompt is used for prompting a user to display the braille after the preset time length.

The method prompts the user to enter the Braille display link after the preset time length, for example, the Braille display link enters after 3 seconds, so that the user can have certain buffer time, and if the user enters the Braille conversion function for false triggering, the user can select to exit the Braille conversion function in the time, and therefore the operation flow after the user enters the Braille conversion function for false triggering is simplified.

Based on the above embodiment, optionally, the above S140 may include:

and under the condition that the third input of the user in the first display area is not received within the preset time after the voice prompt is output, displaying the target braille in the second display area.

And under the condition that the third input of the user in the first display area is received within the preset time after the voice prompt is output, starting from the first display position, and continuing to perform voice broadcast.

The third input refers to an input operation of exiting the braille conversion function when the braille conversion is triggered in the voice broadcasting process, the third input can be used only under the condition that the braille conversion function is triggered in the voice broadcasting process, other input operations can be adopted when the braille conversion function exits under other conditions, and certainly, the third input can be the same as the input operation adopted when the braille conversion function exits under other conditions, and the method is not limited by the application. Alternatively, the third input may include any click operation on the first display region, or include a trigger operation on a button for controlling entry into the braille conversion function, and the like, and the specific content of the third input is not limited in the present application.

In this embodiment, if the third input is received within the preset time after the voice prompt is output, it indicates that the user does not want to perform braille conversion, and therefore broadcasting continues through voice. And if the third input is not received within the preset time, indicating that the user wants to carry out Braille conversion. The mode gives the time selected by the user, so that the user can select whether to convert the Braille into Braille display or not after the Braille conversion is triggered in the voice broadcasting process, and the autonomy of the user is stronger.

In other embodiments, optionally, after S140, the method may further include:

and recording the touch position of the user to the target braille.

And under the condition that the Braille conversion function is triggered to be closed, voice broadcasting is carried out from the display content corresponding to the Braille at the touch position in the first display area.

In this embodiment, after entering the second display area for displaying the braille, the coordinates of the second display area at the touch position are subjected to coordinate mapping according to the touch position (or input position) of the user to the target braille, and are mapped into the coordinate system of the first display area, so that the corresponding position of the touch position in the first display area is determined, and then after the braille conversion function is turned off, the voice broadcast can be continuously performed backwards according to the content of the user at the touch position of the second display area. By the method, the user can continuously obtain subsequent contents after the Braille conversion function is closed, repeated contents which are read before exist in the voice broadcast contents are avoided, and the use experience of the user is improved.

Optionally, the triggering to close the braille conversion function may include: triggering a preset exit key, wherein the preset exit key can be an exit key arranged at the bottom of a screen of the electronic equipment; or the input is through a preset exit gesture, such as three-finger sliding input operation; or when the touch position of the user to the target braille is the tail position of the article, the braille conversion function is automatically triggered to be closed, namely, the braille conversion function is automatically quitted when the reading is finished. In addition, the braille conversion function can be turned off in other manners, which is not limited in the application.

In other embodiments, prior to S110, the method may further include:

a first input of a user in the first display area is received, and first content is determined according to the first input.

In this embodiment, the first content is selected by a first input of the user in the first display area. In this case, the user has strong initiative and can select the content which the user wants to read according to the self requirement. The first input here may be a slide input, and content within a range of slide selection of the first input may be taken as the first content, or content through which a slide track of the first input passes may be taken as the first content, or content above the slide track of the first input may also be taken as the first content.

In other embodiments, in the case of triggering the activation of the braille conversion function, before S110, the method may further include:

receiving a screen setting input of a user;

in response to a screen setting input, a first display area and a second display area in an electronic device are determined.

In this embodiment, after the braille conversion function is turned on each time, the user is first required to select the screen serving as the first display region (or select the screen serving as the second display region) from the two screens of the electronic device, and since the screen mainly used by the user may change frequently, the user selects the first display region by himself/herself after the braille conversion function is turned on each time, which can facilitate subsequent use of the user.

In some embodiments, fixed display blind keys may be provided on both the first display area and the second display area, where the blind keys may include a return key for returning to a previous page of display content, a home key for entering a desktop or home interface, and a function key for performing a function menu, etc. Referring to fig. 6, fig. 6 is a schematic view of a blind key provided in an embodiment of the present application. The fixedly arranged keys can facilitate basic operation of the electronic equipment by a visually impaired user and assist the user in using the electronic equipment. In addition, the blind key can be provided with other keys, and the application does not limit the specific number and functions of the blind key.

It should be noted that, in the display method provided in the embodiment of the present application, the execution main body may be a display device, or a control module in the display device for executing a method of loading display. In the embodiment of the present application, a display device executing a loading display method is taken as an example to describe the display method provided in the embodiment of the present application.

The application provides a display device, which is applied to an electronic device, wherein the electronic device comprises a first display area and a second display area, and fig. 7 is a schematic diagram of the display device provided by the embodiment of the application. The device includes:

a first display module 210 for displaying first content in a first display area;

an obtaining module 220, configured to obtain, according to the first content, a target content meeting a preset condition;

the conversion module 230 is used for converting the target content into braille to obtain target braille;

and a second display module 240 for displaying the target braille in the second display region.

In some embodiments of the present application, the obtaining module 220 may include:

a first identification unit, configured to identify, in a case where the first content is an image, first content information included in the first content by an image identification method, the first content information being a target content;

and the second identification unit is used for identifying second content information included in the first content by an image identification mode and/or a voice identification mode when the first content is a video, and taking the second content information as a target content.

In the embodiment, the information in the images and the videos can be identified through image identification, voice identification and the like, and the text description is displayed, so that the visually impaired user can browse the images and the videos, the way for the visually impaired user to acquire the information is increased, and the use of the electronic equipment by the visually impaired user is facilitated.

In other embodiments of the present application, the obtaining module 220 is specifically configured to:

In this embodiment, the natural language processing technology is used to summarize and summarize the first content in a relevant semantic way, so that when the first content includes a large amount of text information, the braille of the summary information can be displayed to enable the user to quickly know the first content, thereby saving the time of the user.

recording a snapshot of first content; and identifying the target content meeting the preset condition in the snapshot in an image identification mode.

In still other embodiments of the present application, the apparatus further comprises:

the association module is used for associating the target braille with the first link under the condition that the target content is associated with the first link;

the second display module 240 is specifically configured to: and displaying the target braille and first prompt information associated with the first link in the second display area, wherein the first prompt information is used for prompting the user of the target braille operation mode and/or the target operation mode of the first link.

In the embodiment, by associating the target braille with the first link, the user is enabled to perform relevant operations on the target braille displayed on the second display area, and the specific operation contents depend on the first link with which the target contents are associated, such as opening, closing, moving, deleting, and the like. The mode increases the operable range of the user in the second display area, so that the visually impaired user can operate according to the Braille, and the use of the electronic equipment by the visually impaired user is facilitated.

In some embodiments, the apparatus further comprises:

and the triggering module is used for triggering and starting the Braille conversion function.

The trigger module comprises at least one of the following units:

and the first trigger unit is used for receiving a second input of the user and responding to the second input to start the Braille conversion function. Namely, the user can autonomously decide whether to start the Braille conversion function, so that the autonomy of the user is stronger.

And the second trigger unit is used for starting the Braille conversion function under the condition that the preset input operation of the user on the first preset keyword or the preset application program is detected. In this implementation, the user may set some keywords, for example, account numbers, passwords, and other words related to the privacy information, or may set some applications, for example, applications related to the privacy information of the user such as a pay bank, a spring rain doctor, and the like, and when the user hits a first preset keyword or a preset application in the process of using the electronic device, the braille conversion function may be turned on, and subsequent information corresponding to the first preset keyword or the preset application is converted into braille to be displayed, thereby improving the security and the confidentiality of the privacy information of the user.

And the third trigger unit is used for starting the Braille conversion function when detecting that the next broadcast word is the second preset keyword in the voice broadcast process. Optionally, the second preset keyword includes information related to user privacy. Because the voice broadcast in-process, voice broadcast's content is heard by people around easily, and secret nature is relatively poor, consequently detect next report word and predetermine the keyword for the second, for example when information such as user name, account number, password, convert the braille display promptly, can improve user information's security, avoid the privacy that voice broadcast caused to reveal.

The fourth trigger unit is used for carrying out scene recognition through a pre-trained preset algorithm model and the currently acquired electronic equipment use information, and starting a Braille conversion function under the condition that the recognized scene belongs to a first preset scene; the preset algorithm model is arranged on the electronic equipment or the cloud.

In this implementation, an automatic auxiliary judgment mode may be set, after the mode is opened, the electronic device may collect the usage trace of the user after the user opens the trace collection function, the usage trace may include a usage time period, specific content of browsing information, sensitivity of browsing information, and the like, and combine usage habits of the user, keywords set by the user, environmental information where the electronic device is located (for example, whether the electronic device is in a noisy environment, whether the electronic device is in a quiet environment such as a court, a hospital, and the like), application information, content information displayed, and the like. A preset algorithm model, such as a logistic regression model, a support vector machine model, etc., may be implanted in the algorithm processing module of the electronic device; or, a more complex preset algorithm model, such as a large-scale deep neural network model, can be deployed on the cloud server, so that the relevant scene recognition of the braille conversion function can be rapidly and effectively performed. In addition, under the condition of utilizing the cloud to perform scene recognition, under the condition of user authorization, the use information of the electronic equipment can be encrypted and then uploaded to the cloud. And the preset algorithm model can be optimized through the use information of the electronic equipment acquired each time, so that more accurate auxiliary judgment can be conveniently carried out subsequently.

In some embodiments, the obtaining module 220 is specifically configured to:

recording a first display position of the content read by voice broadcast and stopping the voice broadcast under the condition that a next broadcast word is detected as a second preset keyword in the voice broadcast process or under the condition that the next broadcast word is detected as a third preset keyword in the voice broadcast process after the Braille conversion function is started; and taking the content behind the first display position in the display content in the first display area as target content.

In the embodiment, the subsequent contents are converted into the braille directly according to the read position of the voice broadcast, so that the data volume needing to be converted into the braille is reduced, the braille conversion efficiency is improved, the position read before the user does not need to be searched when the user subsequently reads the target braille, and the convenience of reading the braille by the user is improved.

In a further embodiment, the apparatus further comprises:

and the output module is used for outputting voice prompt which is used for prompting a user to display the braille after the preset time length.

The voice broadcasting module is used for carrying out voice broadcasting; under the condition that the third input of the user in the first display area is received within the preset time after the voice prompt is output, the voice broadcast module is triggered to start from the first display position, and voice broadcast is continuously carried out.

The second display module 240 is specifically configured to:

In other embodiments, the apparatus further comprises:

the recording module is used for recording the touch position of the user on the target braille;

the voice broadcast module is also used for: and under the condition that the Braille conversion function is triggered to be closed, voice broadcasting is carried out from the display content corresponding to the Braille at the touch position in the first display area.

By the method, the user can continuously obtain subsequent contents after the Braille conversion function is closed, repeated contents which are read before exist in the voice broadcast contents are avoided, and the use experience of the user is improved.

In some embodiments of the present application, the apparatus further comprises:

the first receiving module is used for receiving a first input of a user in the first display area;

a determination module to determine a first content based on a first input.

the setting receiving module is used for receiving screen setting input of a user;

the screen setting module is used for responding to screen setting input and determining a first display area and a second display area in the electronic equipment.

The display device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The display device provided in the embodiment of the present application can implement each process implemented by the display device in the method embodiment of fig. 1, and is not described here again to avoid repetition.

Optionally, an embodiment of the present application further provides an electronic device, which includes a display, a processor, a memory, and a program or an instruction stored in the memory and executable on the processor, where the display includes a first display area and a second display area, and when the program or the instruction is executed by the processor, the process of the display method embodiment is implemented, and the same technical effect can be achieved, and in order to avoid repetition, details are not repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

The electronic device 300 includes, but is not limited to: radio frequency unit 301, network module 302, audio output unit 303, input unit 304, sensor 305, display unit 306, user input unit 307, interface unit 308, memory 309, and processor 310.

Those skilled in the art will appreciate that the electronic device 300 may further include a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 310 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The processor 310 is configured to obtain, according to the first content, a target content meeting a preset condition; converting the target content into braille to obtain target braille;

a display unit 306 for displaying first content in the first display region; and displaying the target braille in the second display area.

In some embodiments of the present application, the processor 310 is specifically configured to:

under the condition that the first content is an image, identifying first content information included in the first content in an image identification mode, and taking the first content information as target content; when the first content is a video, second content information included in the first content is recognized by an image recognition method and/or a voice recognition method, and the second content information is used as a target content.

In other embodiments of the present application, the processor 310 is specifically configured to:

In the embodiment, when the first content comprises a large amount of text information, the user can quickly know the first content through the braille for displaying the abstract information, and the time of the user is saved.

Optionally, the processor 310 is further configured to: under the condition that the target content is associated with the first link, associating the target braille with the first link;

the display unit 306 is specifically configured to: and displaying the target braille and first prompt information associated with the first link in the second display area, wherein the first prompt information is used for prompting the user of the target braille operation mode and/or the target operation mode of the first link.

In the embodiment, the target braille is associated with the first link, so that the user can perform relevant operation on the target braille displayed on the second display area, wherein the specific operation content depends on the first link associated with the target content. The mode increases the operable range of the user in the second display area, so that the visually impaired user can operate according to the Braille, and the use of the electronic equipment by the visually impaired user is facilitated.

Optionally, the processor 310 is further configured to perform at least one of the following steps:

and receiving a second input of the user, and starting the Braille conversion function in response to the second input. Whether the Braille conversion function is started or not is autonomously determined by a user, so that the user autonomy is stronger.

And starting the Braille conversion function under the condition that the preset input operation of the user on the first preset keyword or the preset application program is detected. Can improve the safety and the privacy of the private information of the user

In the voice broadcasting process, the Braille conversion function is started under the condition that the next broadcasting word is detected to be the second preset keyword. The safety of user information can be improved, and privacy leakage caused by voice broadcasting is avoided.

Scene recognition is carried out through a pre-trained preset algorithm model and the currently acquired electronic equipment use information, and a Braille conversion function is started under the condition that the recognized scene belongs to a first preset scene; the preset algorithm model is arranged on the electronic equipment or the cloud. And the current scene is identified by using the algorithm model for autonomous judgment, so that the accuracy is higher.

Optionally, under the condition that detects next broadcast word for the second preset keyword in the voice broadcast process, or after the braille conversion function opens and under the condition that detects next broadcast word for the third preset keyword in the voice broadcast process, processor 310 is also used for:

Optionally, the audio output unit 303 is configured to output a voice prompt, where the voice prompt is used to prompt a user to perform braille display after a preset duration; carrying out voice broadcasting; and under the condition that the third input of the user in the first display area is received within the preset time after the voice prompt is output, starting from the first display position, and continuing to perform voice broadcast.

The display unit 306 is specifically configured to: and under the condition that the third input of the user in the first display area is not received within the preset time after the voice prompt is output, displaying the target braille in the second display area.

In the embodiment, the time selected by the user is given, so that the user can select whether to convert the Braille into Braille display or not after the Braille conversion is triggered in the voice broadcasting process, and the autonomy of the user is stronger.

Optionally, the processor 310 is further configured to: recording the touch position of a user on the target braille;

and an audio output unit 303 for performing voice broadcast from the first display region after the display content corresponding to the braille at the touched position in the case where the braille conversion function is triggered to be turned off.

In the embodiment, after the Braille conversion function is closed, the user can continuously obtain subsequent contents, repeated contents which are read before exist in the voice broadcast contents are avoided, and the use experience of the user is improved.

Optionally, the user input unit 307 is further configured to:

In this embodiment, the first content is selected by the first input of the user in the first display area, and in this case, the user has strong initiative and can select the content that the user wants to read according to the user's own needs.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device in the above embodiment. Readable storage media, including computer-readable storage media, such as Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, etc.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the display method embodiment, and the same technical effect can be achieved.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A display method is applied to electronic equipment, and is characterized in that the electronic equipment comprises a first display area and a second display area, and the method comprises the following steps:

displaying first content in the first display area;

converting the target content into braille to obtain target braille;

and displaying the target braille in the second display area.

2. The method of claim 1, wherein prior to displaying the first content in the first display region, further comprising:

receiving a first input of a user in the first display area, and determining the first content according to the first input.

3. The method according to claim 1 or 2, wherein the obtaining, according to the first content, target content meeting a preset condition comprises at least one of:

when the first content is an image, identifying first content information included in the first content in an image identification mode, and taking the first content information as the target content;

and when the first content is a video, identifying second content information included in the first content by an image identification mode and/or a voice identification mode, and taking the second content information as the target content.

4. The method according to claim 1 or 2, wherein the obtaining, according to the first content, target content meeting a preset condition comprises:

and performing semantic processing on the first content to obtain an abstract of the first content, and taking the abstract as the target content.

5. The method according to claim 1, wherein before obtaining the target content satisfying a preset condition according to the first content, the method further comprises at least one of:

receiving a second input of a user, and responding to the second input to start the Braille conversion function;

the method comprises the steps that under the condition that a first preset keyword or preset input operation of a preset application program by a user is detected, the Braille conversion function is started;

in the voice broadcasting process, the Braille conversion function is started under the condition that the next broadcasting word is detected to be a second preset keyword;

scene recognition is carried out through a pre-trained preset algorithm model and the currently acquired electronic equipment use information, and the Braille conversion function is started under the condition that the recognized scene belongs to a first preset scene.

6. The method according to claim 5, wherein when a next broadcast word is detected as the second preset keyword in the voice broadcast process, or when a next broadcast word is detected as a third preset keyword in the voice broadcast process after the braille conversion function is turned on, acquiring target content meeting a preset condition according to the first content, includes:

recording a first display position of the content read by the voice broadcast, and stopping the voice broadcast;

and taking the content behind the first display position in the display content in the first display area as the target content.

7. The method of claim 6, wherein after the obtaining the target Braille and before displaying the target Braille in the second display region, further comprising:

outputting a voice prompt which is used for prompting a user to display braille after preset time;

the displaying the target braille in the second display area includes:

and under the condition that a third input of the user in the first display area is not received within the preset time after the voice prompt is output, displaying the target braille in the second display area.

8. The method of claim 6, further comprising, after displaying the target braille in the second display region:

recording the touch position of the user on the target braille;

and under the condition that the Braille conversion function is triggered to be closed, the voice broadcast is carried out from the display content corresponding to the Braille at the touch position in the first display area.

9. The method of claim 1, wherein said displaying the target braille in the second display region includes:

associating the target braille with a first link when the target content is associated with the first link;

and displaying the target Braille and first prompt information associated with the first link in the second display area, wherein the first prompt information is used for prompting a user about the target Braille operation mode and/or the target operation mode of the first link.

10. A display device applied to electronic equipment, wherein the electronic equipment comprises a first display area and a second display area, the device comprises:

11. The apparatus of claim 10, wherein the obtaining module is specifically configured to: and performing semantic processing on the first content to obtain an abstract of the first content, and taking the abstract as the target content.

12. The apparatus of claim 10, wherein the obtaining module is configured to:

recording a first display position of the content read by the voice broadcast and stopping the voice broadcast under the condition that a next broadcast word is detected as the second preset keyword in the voice broadcast process or under the condition that the next broadcast word is detected as a third preset keyword in the voice broadcast process after the braille conversion function is started; and taking the content behind the first display position in the display content in the first display area as the target content.

13. The apparatus of claim 10, further comprising:

the association module is used for associating the target braille with a first link under the condition that the target content is associated with the first link;

the second display module is specifically configured to: and displaying the target Braille and first prompt information associated with the first link in the second display area, wherein the first prompt information is used for prompting a user about the target Braille operation mode and/or the target operation mode of the first link.

14. An electronic device comprising a display, a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the display comprising a first display area and a second display area, the program or instructions when executed by the processor implementing the steps of the display method according to any one of claims 1-9.

15. A readable storage medium applied to an electronic device, wherein the electronic device comprises a first display area and a second display area, the readable storage medium storing thereon a program or instructions which, when executed by a processor, implement the steps of the display method according to any one of claims 1 to 9.