WO2022111047A1 - Voice broadcasting method, computing device and computer storage medium - Google Patents

Voice broadcasting method, computing device and computer storage medium Download PDF

Info

Publication number
WO2022111047A1
WO2022111047A1 PCT/CN2021/121810 CN2021121810W WO2022111047A1 WO 2022111047 A1 WO2022111047 A1 WO 2022111047A1 CN 2021121810 W CN2021121810 W CN 2021121810W WO 2022111047 A1 WO2022111047 A1 WO 2022111047A1
Authority
WO
WIPO (PCT)
Prior art keywords
control
controls
voice
user
book
Prior art date
Application number
PCT/CN2021/121810
Other languages
French (fr)
Chinese (zh)
Inventor
杨树彬
Original Assignee
掌阅科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 掌阅科技股份有限公司 filed Critical 掌阅科技股份有限公司
Publication of WO2022111047A1 publication Critical patent/WO2022111047A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44521Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
    • G06F9/44526Plug-ins; Add-ons

Definitions

  • the present disclosure relates to the field of computer technology, and in particular, to a voice broadcast method, a computing device, and a computer storage medium.
  • the operation control method adopted is to generate program effects through touch and display them on the screen.
  • the display effect is then controlled and operated.
  • the smart terminal usually has a voice broadcast function, and the user can know which controls are clicked through the voice broadcast method.
  • the existing voice broadcast method is that the user triggers a control once, and responds Due to the user's trigger operation, a voice broadcast is performed on the control focus content of the control. Due to the many controls in the application, the user frequently triggers different controls when clicking on the screen, resulting in frequent broadcasts, so that the user cannot quickly find the desired operation.
  • the controls are cumbersome to operate, and also affect the user experience.
  • the present disclosure is proposed to provide a voice broadcast method, computing device and computer storage medium that overcome the above problems or at least partially solve the above problems.
  • a voice broadcasting method comprising:
  • At least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
  • a computing device including: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface communicate with each other through the communication bus;
  • the memory is used to store at least one executable instruction, and the executable instruction causes the processor to perform the following operations:
  • At least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
  • a non-volatile computer-readable storage medium where at least one executable instruction is stored in the non-volatile computer-readable storage medium, and the executable instruction causes a processor to execute the above-mentioned The operation corresponding to the voice broadcast method.
  • a computer program product comprising a computing program stored on the above-mentioned non-volatile computer-readable storage medium.
  • the trigger operation is to determine at least one control that is associated with the control, and sequentially voice broadcast the control focus content of at least two associated controls, so as to realize the effect of broadcasting the focus content of multiple associated controls by one trigger operation, which simplifies the
  • the user operation enables the user to quickly find the desired control without frequently triggering the control, avoiding frequent switching between the triggering operation and the voice broadcast, thereby improving the user experience.
  • FIG. 1 shows a schematic flowchart of a voice broadcast method according to an embodiment of the present disclosure
  • FIG. 2A shows a schematic flowchart of a voice broadcast method according to another embodiment of the present disclosure
  • Fig. 2B is the schematic diagram of the corresponding operation area of the control
  • 2C is a schematic diagram of a merge operation area
  • Fig. 2D is the schematic diagram of activation control
  • FIG. 3 shows a schematic structural diagram of a computing device according to an embodiment of the present disclosure.
  • FIG. 1 shows a schematic flowchart of a voice broadcast method according to an embodiment of the present disclosure. As shown in Figure 1, the method includes the following steps:
  • Step S101 with respect to at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition; if so, go to step S102 .
  • the application page contains many controls, and these controls are distributed throughout the application page.
  • the application page is divided into multiple areas, each area contains multiple controls, and the size of each area can be flexibly set For example, the sizes of the multiple regions may be the same or different, which are not specifically limited here.
  • the association condition is a condition that should be satisfied for establishing an association between the at least two controls. If at least two controls satisfy the association condition, step S102 is executed; if the association condition is not met, the method ends.
  • step S102 at least two controls are associated with each other.
  • the at least two controls may be associated with processing, for example, the association relationship between the at least two controls may be recorded, or the at least two controls may be associated in other ways, for example, Merge the operation areas corresponding to at least two controls.
  • This embodiment does not specifically limit the method used for associating at least two controls, and other methods capable of associating at least two controls also belong to the protection scope of the present disclosure.
  • By associating at least two controls an association is established between the at least two controls, thereby providing an implementation basis for subsequently broadcasting the control focus content of multiple controls through one trigger operation voice.
  • Step S103 in response to the user's triggering operation on any control in the application page, determine at least one control associated with the control, and sequentially voice broadcast the control focus content of the at least two associated controls.
  • At least one control that is associated with the control can be determined by querying.
  • the control focus content of at least two associated controls is broadcast in sequence, where the control focus content is used to describe what control a control is, for example, it can be the name of the control, etc., through a trigger operation , realizes the effect of voice broadcast of the focus content of multiple controls, simplifies user operations, makes users do not need to trigger controls frequently, thereby improving user experience.
  • the method provided by the above-mentioned embodiments of the present disclosure provides a basis for subsequently broadcasting the control focus content of multiple controls through one trigger operation voice by associating at least two controls that satisfy the association conditions;
  • the triggering operation of a control determines at least one control that is associated with the control, and sequentially voice broadcasts the control focus content of at least two associated controls, thereby realizing the effect of broadcasting the focus content of multiple associated controls by one triggering operation.
  • the user operation is simplified, so that the user can quickly find the desired control without frequently triggering the control, avoiding frequent switching between the triggering operation and the voice broadcast, thereby improving the user experience.
  • FIG. 2A shows a schematic flowchart of a voice broadcast method according to another embodiment of the present disclosure. As shown in Figure 2A, the method includes the following steps:
  • the application page contains many controls, and these controls are distributed throughout the application page.
  • the application page is divided into multiple areas, each area contains multiple controls, and the size of each area can be flexibly set
  • the sizes of the multiple regions may be the same or different, which are not specifically limited here.
  • the controls in the application page include: no-click event control and click-event control.
  • the no-click event control means that there is no follow-up response after the user clicks the control.
  • this type of control does not have a corresponding jump address;
  • the click-event control refers to the control. After the user clicks the control, it will respond to the click behavior.
  • there is a click event control corresponding to the jump address and the page jump can be realized according to the jump address.
  • Any control in the application page corresponds to an operation area, and a trigger operation at any position of the operation area is considered as a trigger operation of the control.
  • the voice broadcast method provided in this embodiment can be applied to a visually impaired scenario, that is, when a blind person or a visually impaired person uses an intelligent terminal, the screen may not be seen or seen clearly. Assist the corresponding personnel to know what the control triggered by them is. Of course, it is not limited to visually impaired scenarios, and other scenarios that require voice broadcast are applicable.
  • Step S201 if at least two controls in the preset area in the application page are no-click event controls, determine whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance, and if so, go to step S205.
  • judging whether the at least two controls can be associated is specifically by judging whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance.
  • the set distance can be flexibly set according to actual needs.
  • the preset distance is a critical value. When the distance between the operation areas corresponding to at least two controls is less than the preset distance, it means that at least two controls are very close, and at least two controls meet the requirements. Associative conditions, that is, jump to step S205.
  • the distance between the operation areas corresponding to the at least two controls is greater than or equal to the preset distance, it indicates that the at least two controls are a little far apart, and the at least two controls do not satisfy the association condition, and the method ends.
  • the positional relationship of at least two controls belongs to an up-down relationship or a left-right relationship
  • the corresponding operation area is also an up-down relationship or a left-right relationship
  • the distance between the operation areas here refers to the up-down distance or the left-right distance.
  • Step S202 if at least two controls in the preset area in the application page include a no-click event control and a click-event control, then determine whether there is a control focus content of the no-click event control and the control focus content of the click-event control. Relevance, if yes, execute step S203.
  • No click event control means that there is no follow-up response after the user clicks the control, usually this type of control does not have a corresponding jump address; click event control means that after the user clicks the control, it will respond to the click behavior, usually there is a click event control Corresponding to the jump address, the page jump can be realized according to the jump address.
  • the no-click event control does not correspond to the jump address. Therefore, if at least two controls in the preset area of the application page contain both the no-click event control and the click event control, the at least two controls cannot be determined based on the jump address. Whether the two controls can be associated.
  • step S205 can be skipped to execute; The method ends when there is no association between the focus content of the control.
  • Step S203 judging whether the distance between the operation areas corresponding to the at least two controls is smaller than the preset distance; if yes, then performing step S205.
  • the preset distance can be flexibly set according to actual needs.
  • the preset distance is a critical value. When the distance between the operation areas corresponding to at least two controls is smaller than the preset distance, it means that at least two controls are very close, and at least two controls are very close.
  • the association condition is satisfied, that is, step S205 is jumped to.
  • the distance between the operation areas corresponding to the at least two controls is greater than or equal to the preset distance, it indicates that the at least two controls are a little far apart, and the at least two controls do not satisfy the association condition, and the method ends.
  • Step S204 if at least two controls in the preset area in the application page are controls with click events, determine whether the jump addresses corresponding to the at least two controls are the same, and if so, go to step S205.
  • Each of the click event controls corresponds to a jump address. Therefore, whether to associate at least two controls can be determined based on the jump address.
  • the following method can be used to determine whether at least two controls satisfy the association condition: judging whether the jump addresses corresponding to at least two controls are the same jump address, if it is the same jump address, it means that after clicking at least two controls respectively. , the responses made are the same, that is, jumping to the same page, then it can be determined that at least two controls meet the associated conditions, that is, jumping to perform step S205; After the two controls, jump to different pages, it is determined that at least two controls do not satisfy the association condition, and the method ends.
  • Step S205 it is determined that at least two controls satisfy the association condition.
  • the at least two controls satisfy the association condition, so that the at least two controls can be The two controls are associated with each other.
  • Step S206 merge the operation areas corresponding to the at least two controls to obtain the merge operation area.
  • the association of the at least two controls can be realized by merging the operation areas corresponding to the at least two controls.
  • the user operable area can be expanded, so that The user does not need to look at the position of the control every time to click effectively, which can effectively solve the problem that the operation area corresponding to the control is too small, which is inconvenient for the user to click. For the visually impaired, the user experience is improved.
  • the operation area corresponding to each control is fixed. Therefore, the operation area corresponding to at least two controls can be merged by using the principle of minimum rectangular coverage. Specifically, determine The smallest rectangular area containing the operation areas corresponding to at least two controls, and the smallest rectangular area is determined as the merge operation area. After the merge operation area is determined, the area coordinates corresponding to the merge operation area can also be determined, so as to facilitate the subsequent determination of the merge operation area Override controls. Or, record the association relationship between the merge operation area and at least two controls.
  • Fig. 2B is a schematic diagram of the corresponding operation area of the controls. As shown in Fig. 2B, the avatar control, the level control and the nickname control all have corresponding operation areas, and the three controls correspond to the same operation area. Therefore, the operation areas corresponding to the three controls can be merged, and the merge operation area obtained after the merge processing is shown in FIG. 2C .
  • Step S207 in response to a user triggering any merge operation area in the application page, determine at least two controls covered by the merge operation area, and sequentially voice broadcast the control focus content of the at least two controls covered by the merge operation area.
  • the position coordinate matching method can be used to determine which merge operation the user is for The trigger operation of the area, in response to the user's trigger operation on any merge operation area in the application page, it is necessary to determine at least two controls covered by the merge operation area.
  • Each control corresponds to its own operation area and corresponds to the position coordinates. Therefore, it is possible to determine at least two controls covered by the merge operation area by determining the position coordinates of which controls fall within the range of the position coordinates of the merge operation area, or to determine the existence of the merge operation area with the query method.
  • the associated at least two controls after determining the at least two controls covered by the merge operation area, sequentially voice broadcast the control focus content of the at least two controls covered by the merge operation area, and realize the voice broadcast of multiple control focuses through one trigger operation
  • the effect of the content simplifies the user operation, so that the user does not need to trigger the control frequently, thereby improving the user experience.
  • Step S208 in response to the user's triggering operation on any merge operation area in the application page again, perform page jump processing according to the jump address corresponding to the control covered by the merge operation area.
  • the at least two controls covered by the merge operation area correspond to a certain jump address
  • a trigger operation can be performed on the merge operation area again.
  • the page is executed according to the jump address corresponding to the control covered by the merge operation area. Jump processing, jump to the page corresponding to the jump address.
  • the merge operation area covers the "avatar” control, the "nickname” control and the "level” control.
  • the three controls correspond to the same jump address, and the jump address corresponds to the setting page. Trigger the operation to realize page jump, and the page after jump is the setting page.
  • an activation control is also included in the application page, and the activation control is usually represented by a "more" button or button means that by clicking the "More" button or The button can call out the focus content of the control, usually in the form of a drop-down list, as shown in Figure 2D, in order to enable the user to know which control focus content is included in the activated control, in response to the user's response to any activated control in the application page.
  • the following control focus content corresponds to: importing local books, wireless book transfer, cloud bookshelf, organizing bookshelves, book sorting, scanning, backup and synchronization.
  • This trigger operation in turn, voice broadcast of importing local books, wireless book transmission, cloud bookshelf, sorting bookshelf, book sorting, scanning, backup and synchronization, instead of only broadcasting the focus content of the first control (importing local books),
  • the focus content of other controls in the drop-down list will no longer be broadcast.
  • Focus content instead of just voice broadcast of the focus content of the first control, can enrich the use functions of the visually impaired.
  • the method further includes: in response to a triggering operation of the editing control by the user, voice broadcast of the control focus content corresponding to the editing control, and switching the input mode from the keyboard input mode to the voice input mode.
  • the editing control in this optional embodiment refers to a control that provides text input operations, for example, a search control or a comment control, etc.
  • the editing control can be triggered, for example, clicking on the editing control, responding to The user's trigger operation on the editing control will broadcast the focus content of the control corresponding to the editing control to the user through voice broadcast, so as to inform the user what control is triggered.
  • the voice input mode is adopted, that is, the input mode is switched from the keyboard input mode to the voice input mode, so that the user does not need to manually input text, but achieves the corresponding editing purpose through the voice input method.
  • the focus content of the control corresponding to the "Search Input Box” control is broadcast by voice, for example, the voice broadcast "Search Input Box” , and switch the input mode from the keyboard input mode to the voice input mode.
  • voice for example, the voice broadcast "Search Input Box”
  • the user can describe the "search input box” by voice to realize the search, and after obtaining the search results, they can also voice broadcast the search results in sequence.
  • This optional implementation manner may also be applied to other scenarios, for example, scenarios such as writing an idea or a book review for an e-book, or replying to comments from others, which will not be described in detail here.
  • the method further includes: in response to a triggering operation of the specified electronic book control by the user, voice broadcast of the electronic book identifier corresponding to the specified electronic book control;
  • the user when the user wants to read an e-book, the user can trigger the designated e-book control, and in response to the user's triggering operation on the designated e-book control, the electronic book corresponding to the designated e-book control
  • the book identification performs voice broadcast, so that the user can determine whether it is the e-book he wants to read through the voice broadcast method. If it is an e-book that the user wants to read, the user can trigger the designated e-book control again, and in response to the user's triggering operation on the designated e-book control again, it is determined whether there is an e-book identifier stored in the database that matches the designated e-book control.
  • the method provided by the above-mentioned embodiments of the present disclosure provides an implementation basis for subsequently broadcasting the control focus content of multiple controls through one trigger operation by associating at least two controls that satisfy the association condition;
  • the operation area corresponding to each control is merged, which expands the user's operable area, so that the user does not need to look at the location of the control every time before clicking effectively, which can effectively solve the problem that the operation area corresponding to the control is too small, which is inconvenient for the user to click.
  • the user experience is improved; in response to the user's triggering operation on the merge operation area, at least two controls covered by the merge operation area are determined, and the at least two controls covered by the merge operation area are sequentially voice broadcast.
  • the focus content of the control realizes the effect of broadcasting the focus content of multiple associated controls by one trigger operation, which simplifies the user operation, so that the user can quickly find the desired control without triggering the control frequently, avoiding the trigger operation. Frequent switching between voice broadcast and voice broadcast, thus improving the user experience.
  • An embodiment of the present disclosure further provides a non-volatile computer-readable storage medium, where the non-volatile computer-readable storage medium stores at least one executable instruction, and the computer-executable instruction can execute any of the foregoing method embodiments. voice broadcast method.
  • Executable instructions can specifically be used to cause the processor to perform the following operations:
  • At least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
  • any control corresponds to an operation area
  • the executable instructions further cause the processor to:
  • At least two controls are no-click event controls, determine whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance;
  • any control corresponds to an operation area
  • the executable instructions further cause the processor to:
  • At least two controls include a control without a click event and a control with a click event, determine whether there is a correlation between the focus content of the control without a click event and the focus content of the control with a click event;
  • executable instructions further cause the processor to:
  • At least two controls are controls with click events, determine whether the jump addresses corresponding to at least two controls are the same;
  • any control corresponds to an operation area
  • the executable instructions further cause the processor to:
  • the operation areas corresponding to at least two controls are merged to obtain a merged operation area
  • At least two controls covered by the merge operation area are determined, and the control focus content of the at least two controls covered by the merge operation area is sequentially voice broadcast.
  • executable instructions further cause the processor to:
  • executable instructions also cause the processor to:
  • page jump processing is performed according to the jump address corresponding to the control covered by the merge operation area.
  • executable instructions also cause the processor to:
  • control focus content corresponding to the activated control is sequentially voice broadcast.
  • executable instructions also cause the processor to:
  • the focus content of the control corresponding to the editing control is announced by voice, and the input mode is switched from the keyboard input mode to the voice input mode.
  • executable instructions also cause the processor to:
  • FIG. 3 shows a schematic structural diagram of a computing device according to an embodiment of the present disclosure.
  • the specific embodiment of the present disclosure does not limit the specific implementation of the computing device.
  • the computing device may include: a processor (processor) 302 , a communication interface (Communications Interface) 304 , a memory (memory) 306 , and a communication bus 308 .
  • processor processor
  • Communication interface Communication Interface
  • memory memory
  • communication bus 308 a communication bus
  • the processor 302 , the communication interface 304 , and the memory 306 communicate with each other through the communication bus 308 .
  • the communication interface 304 is used for communicating with network elements of other devices such as clients or other servers.
  • the processor 302 is configured to execute the program 310, and specifically may execute the relevant steps in the above-mentioned embodiments of the voice broadcasting method.
  • the program 310 may include program code including computer operation instructions.
  • the processor 302 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present disclosure.
  • the one or more processors included in the computing device may be the same type of processors, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.
  • the memory 306 is used to store the program 310 .
  • Memory 306 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.
  • the program 310 can specifically be used to cause the processor 302 to perform the following operations:
  • At least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
  • any control corresponds to an operation area
  • Routine 310 further causes processor 302 to perform the following operations:
  • At least two controls are no-click event controls, determine whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance;
  • any control corresponds to an operation area
  • Routine 310 further causes processor 302 to perform the following operations:
  • At least two controls include a control without a click event and a control with a click event, determine whether there is a correlation between the focus content of the control without a click event and the focus content of the control with a click event;
  • program 310 further causes processor 302 to perform the following operations:
  • At least two controls are controls with click events, determine whether the jump addresses corresponding to at least two controls are the same;
  • any control corresponds to an operation area
  • Routine 310 further causes processor 302 to perform the following operations:
  • the operation areas corresponding to at least two controls are merged to obtain a merged operation area
  • At least two controls covered by the merge operation area are determined, and the control focus content of the at least two controls covered by the merge operation area is sequentially voice broadcast.
  • program 310 further causes processor 302 to perform the following operations:
  • program 310 also causes processor 302 to perform the following operations:
  • page jump processing is performed according to the jump address corresponding to the control covered by the merge operation area.
  • program 310 also causes processor 302 to perform the following operations:
  • control focus content corresponding to the activated control is sequentially voice broadcast.
  • program 310 also causes processor 302 to perform the following operations:
  • the focus content of the control corresponding to the editing control is announced by voice, and the input mode is switched from the keyboard input mode to the voice input mode.
  • program 310 also causes processor 302 to perform the following operations:
  • modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment.
  • the modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined.
  • Each feature disclosed in this specification may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
  • Various component embodiments of the present disclosure may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof.
  • a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components according to embodiments of the present disclosure.
  • DSP digital signal processor
  • the present disclosure can also be implemented as apparatus or apparatus programs (eg, computer programs and computer program products) for performing some or all of the methods described herein.
  • Such a program implementing the present disclosure may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A voice broadcasting method, a computing device and a computer storage medium. The method comprises: determining whether at least two controls in a preset region in an application page satisfy an association condition or not (S101); if yes, performing association processing on the at least two controls (S102); and in response to a trigger operation of a user on any control in the application page, determining at least one control associated with the control, and sequentially broadcasting the control focus contents of the at least two associated controls by voice (S103).

Description

语音播报方法、计算设备及计算机存储介质Voice broadcast method, computing device and computer storage medium
相关申请的交叉参考CROSS-REFERENCE TO RELATED APPLICATIONS
本申请要求于2020年11月27日提交中国专利局、申请号为202011364189.4、名称为“语音播报方法、计算设备及计算机存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202011364189.4 and the title of "Voice Broadcasting Method, Computing Device and Computer Storage Medium", which was filed with the China Patent Office on November 27, 2020, the entire contents of which are incorporated herein by reference Applying.
技术领域technical field
本公开涉及计算机技术领域,具体涉及一种语音播报方法、计算设备及计算机存储介质。The present disclosure relates to the field of computer technology, and in particular, to a voice broadcast method, a computing device, and a computer storage medium.
背景技术Background technique
随着科技的发展,产生了很多现代化的智能终端,例如,智能手机、平板电脑,它们几乎都使用触摸屏,采用的操作控制办法是通过触摸产生程序影响,并在屏幕上进行显示,用户看到显示效果再进行控制和操作。但是对于盲人或者视力不好的用户而言,由于无法看到或看清屏幕显示,因此,对智能终端进行触摸操作存在困难。为了使这些人员能够比较方便地使用智能终端,通常智能终端有语音播报功能,用户可以通过语音播报方式来获知点击到的是哪些控件,然而,现有的语音播报方式是用户触发一次控件,响应于该用户的触发操作,对该控件的控件焦点内容进行一次语音播报,由于应用的控件很多,造成用户在屏幕点击时频繁地触发不同的控件,导致频繁播报,从而用户无法快速找到想要操作的控件,操作繁琐,而且还影响用户使用体验。With the development of science and technology, many modern smart terminals have been produced, such as smart phones and tablet computers, which almost all use touch screens. The operation control method adopted is to generate program effects through touch and display them on the screen. The display effect is then controlled and operated. However, for blind or visually impaired users, it is difficult to perform touch operations on the smart terminal because they cannot see or clearly see the screen display. In order to enable these personnel to use the smart terminal more conveniently, the smart terminal usually has a voice broadcast function, and the user can know which controls are clicked through the voice broadcast method. However, the existing voice broadcast method is that the user triggers a control once, and responds Due to the user's trigger operation, a voice broadcast is performed on the control focus content of the control. Due to the many controls in the application, the user frequently triggers different controls when clicking on the screen, resulting in frequent broadcasts, so that the user cannot quickly find the desired operation. The controls are cumbersome to operate, and also affect the user experience.
公开内容public content
鉴于上述问题,提出了本公开以便提供一种克服上述问题或者至少部分地解决上述问题的语音播报方法、计算设备及计算机存储介质。In view of the above problems, the present disclosure is proposed to provide a voice broadcast method, computing device and computer storage medium that overcome the above problems or at least partially solve the above problems.
根据本公开的一个方面,提供了一种语音播报方法,包括:According to one aspect of the present disclosure, there is provided a voice broadcasting method, comprising:
针对应用页面内预设区域中的至少两个控件,判断至少两个控件是否满足关联条件;For at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition;
若是,则将至少两个控件进行关联处理;If so, associate at least two controls;
响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容。In response to a user's triggering operation on any control in the application page, at least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
根据本公开的另一方面,提供了一种计算设备,包括:处理器、存储器、通信接口和通信总线,处理器、存储器和通信接口通过通信总线完成相互间的通信;According to another aspect of the present disclosure, a computing device is provided, including: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface communicate with each other through the communication bus;
存储器用于存放至少一可执行指令,可执行指令使处理器执行以下操作:The memory is used to store at least one executable instruction, and the executable instruction causes the processor to perform the following operations:
针对应用页面内预设区域中的至少两个控件,判断至少两个控件是否满足关联条件;For at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition;
若是,则将至少两个控件进行关联处理;If so, associate at least two controls;
响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容。In response to a user's triggering operation on any control in the application page, at least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
根据本公开的又一方面,提供了一种非易失性计算机可读存储介质,该非易失性计算机可读存储介质中存储有至少一可执行指令,可执行指令使处理器执行如上述语音播报方法对应的操作。According to yet another aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, where at least one executable instruction is stored in the non-volatile computer-readable storage medium, and the executable instruction causes a processor to execute the above-mentioned The operation corresponding to the voice broadcast method.
根据本公开的再又一方面,还提供了一种计算机程序产品,该计算机程序产品包括存储在上述非易失性计算机可读存储介质上的计算程序。According to yet another aspect of the present disclosure, there is also provided a computer program product, the computer program product comprising a computing program stored on the above-mentioned non-volatile computer-readable storage medium.
根据本公开提供的方案,通过将满足关联条件的至少两个控件进行关联,为后续通过一次触发操作语音播报多个控件的控件焦点内容提供了实现基础;响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容,实现了通过一次触发操作来语音播报多个关联控件焦点内容的效果,简化了用户操作,使得用户无需频繁地触发控件,就能够快速找到想要操作的控件,避免了触发操作与语音播报之间频繁切换,从而提升了用户使用体验。According to the solution provided by the present disclosure, by associating at least two controls that satisfy the association conditions, it provides an implementation basis for subsequently broadcasting the control focus content of multiple controls through one trigger operation voice; The trigger operation is to determine at least one control that is associated with the control, and sequentially voice broadcast the control focus content of at least two associated controls, so as to realize the effect of broadcasting the focus content of multiple associated controls by one trigger operation, which simplifies the The user operation enables the user to quickly find the desired control without frequently triggering the control, avoiding frequent switching between the triggering operation and the voice broadcast, thereby improving the user experience.
上述说明仅是本公开技术方案的概述,为了能够更清楚了解本公开的技术手段,而可依照说明书的内容予以实施,并且为了让本公开的上述和其它目的、特征和优点能够更明显易懂,以下特举本公开的具体实施方式。The above description is only an overview of the technical solutions of the present disclosure. In order to understand the technical means of the present disclosure more clearly, it can be implemented according to the contents of the description, and in order to make the above-mentioned and other purposes, features and advantages of the present disclosure more obvious and easy to understand , the following specific embodiments of the present disclosure are given.
附图概述BRIEF DESCRIPTION OF THE DRAWINGS
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本公开的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for purposes of illustrating preferred embodiments only and are not to be considered limiting of the present disclosure. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:
图1示出了根据本公开一个实施例的语音播报方法的流程示意图;1 shows a schematic flowchart of a voice broadcast method according to an embodiment of the present disclosure;
图2A示出了根据本公开另一个实施例的语音播报方法的流程示意图;2A shows a schematic flowchart of a voice broadcast method according to another embodiment of the present disclosure;
图2B为控件对应操作区域的示意图;Fig. 2B is the schematic diagram of the corresponding operation area of the control;
图2C为合并操作区域的示意图;2C is a schematic diagram of a merge operation area;
图2D为激活控件的示意图;Fig. 2D is the schematic diagram of activation control;
图3示出了根据本公开一个实施例的计算设备的结构示意图。FIG. 3 shows a schematic structural diagram of a computing device according to an embodiment of the present disclosure.
本公开的较佳实施方式Preferred Embodiments of the Disclosure
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.
图1示出了根据本公开一个实施例的语音播报方法的流程示意图。如图1所示,该方法包括以下步骤:FIG. 1 shows a schematic flowchart of a voice broadcast method according to an embodiment of the present disclosure. As shown in Figure 1, the method includes the following steps:
步骤S101,针对应用页面内预设区域中的至少两个控件,判断至少两个控件是否满足关联条件;若是,则执行步骤S102。Step S101 , with respect to at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition; if so, go to step S102 .
通常情况下,应用页面内包含有很多控件,这些控件分布于应用页面内的各处,将应用页面划分为多个区域,每个区域都包含有多个控件,每个区域的大小可以灵活设定,例如,多个区域的大小可以是相同的,也可以不同,这里不做具体限定。针对应用页面内预设区域中的至少两个控件,判断至少两个控件是否满足关联条件,关联条件是至少两个控件之间建立关联所应满足的条件。若至少两个控件满足关联条件,则执行步骤S102;若不满足关联条件,则方法结束。Usually, the application page contains many controls, and these controls are distributed throughout the application page. The application page is divided into multiple areas, each area contains multiple controls, and the size of each area can be flexibly set For example, the sizes of the multiple regions may be the same or different, which are not specifically limited here. For at least two controls in the preset area in the application page, it is determined whether the at least two controls satisfy an association condition, and the association condition is a condition that should be satisfied for establishing an association between the at least two controls. If at least two controls satisfy the association condition, step S102 is executed; if the association condition is not met, the method ends.
步骤S102,将至少两个控件进行关联处理。In step S102, at least two controls are associated with each other.
在判断出至少两个控件满足关联条件的情况下,可以将至少两个控件进行关联处理,例如,记录至少两个控件之间的关联关系,或者通过其他方式将至少两个控件关联,例如,合并至少两个控件对应的操作区域。本实施例并不具体限定关联至少两个控件所采用的方法,能够将至少两个控件进行关联的其它方法同样属于本公开的保护范围。通过将至少两个控件进行关联处理,使得至少两个控件之间建立了关联,从而为后续通过一次触发操作语音播报多个控件的控件焦点内容提供了实现基础。When it is determined that the at least two controls satisfy the association condition, the at least two controls may be associated with processing, for example, the association relationship between the at least two controls may be recorded, or the at least two controls may be associated in other ways, for example, Merge the operation areas corresponding to at least two controls. This embodiment does not specifically limit the method used for associating at least two controls, and other methods capable of associating at least two controls also belong to the protection scope of the present disclosure. By associating at least two controls, an association is established between the at least two controls, thereby providing an implementation basis for subsequently broadcasting the control focus content of multiple controls through one trigger operation voice.
步骤S103,响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容。Step S103 , in response to the user's triggering operation on any control in the application page, determine at least one control associated with the control, and sequentially voice broadcast the control focus content of the at least two associated controls.
当用户想要获知控件具体是什么控件时,可以点击应用页面内相应的控件,监测到用户对应用页面内任一控件的触发操作之后,需要对用户所执行的触发操作进行响应,具体地,响应于用户对应用页面内任一控件的触发操作,需要确定与该控件存在关联的至少一个控件,例如,可以通过查询方式来确定与该控件存在关联的至少一个控件,在确定与该控件存在关联的至少一个控件之后,依次语音播报存在关联的至少两个控件的控件焦点内容,其中,控件焦点内容用于说明某个控件具体是什么控件,例如,可以是控件名称等,通过一次触发操作,实现了语音播报多个控件焦点内容的效果,简化了用户操作,使得用户无需频繁地触发控件,从而提升了用户使用体验。When the user wants to know what the control is, he can click the corresponding control in the application page, and after monitoring the user's triggering operation on any control in the application page, he needs to respond to the triggering operation performed by the user. Specifically, In response to the user's triggering operation on any control in the application page, it is necessary to determine at least one control that is associated with the control. For example, at least one control that is associated with the control can be determined by querying. After at least one control is associated, the control focus content of at least two associated controls is broadcast in sequence, where the control focus content is used to describe what control a control is, for example, it can be the name of the control, etc., through a trigger operation , realizes the effect of voice broadcast of the focus content of multiple controls, simplifies user operations, makes users do not need to trigger controls frequently, thereby improving user experience.
本公开上述实施例提供的方法,通过将满足关联条件的至少两个控件进行关联,为后续通过一次触发操作语音播报多个控件的控件焦点内容提供了实现基础;响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容,实现了通过一次触发操作来语音播报多个关联控件焦点内容的效果,简化了用户操作,使得用户无需频繁地触发控件,就能够快速找到想要操作的控件,避免了触发操作与语音播报之间频繁切换,从而提升了用户使用体验。The method provided by the above-mentioned embodiments of the present disclosure provides a basis for subsequently broadcasting the control focus content of multiple controls through one trigger operation voice by associating at least two controls that satisfy the association conditions; The triggering operation of a control determines at least one control that is associated with the control, and sequentially voice broadcasts the control focus content of at least two associated controls, thereby realizing the effect of broadcasting the focus content of multiple associated controls by one triggering operation. The user operation is simplified, so that the user can quickly find the desired control without frequently triggering the control, avoiding frequent switching between the triggering operation and the voice broadcast, thereby improving the user experience.
图2A示出了根据本公开另一个实施例的语音播报方法的流程示意图。如图2A所示,该方法包括以下步骤:FIG. 2A shows a schematic flowchart of a voice broadcast method according to another embodiment of the present disclosure. As shown in Figure 2A, the method includes the following steps:
通常情况下,应用页面内包含有很多控件,这些控件分布于应用页面内 的各处,将应用页面划分为多个区域,每个区域都包含有多个控件,每个区域的大小可以灵活设定,例如,多个区域的大小可以是相同的,也可以不同,这里不做具体限定。Usually, the application page contains many controls, and these controls are distributed throughout the application page. The application page is divided into multiple areas, each area contains multiple controls, and the size of each area can be flexibly set For example, the sizes of the multiple regions may be the same or different, which are not specifically limited here.
应用页面内的控件包含:无点击事件控件和有点击事件控件,其中,无点击事件控件是指用户点击控件后没有后续响应,通常这类控件并没有对应跳转地址;有点击事件控件是指用户点击控件后,会对点击行为而做出响应,通常有点击事件控件对应着跳转地址,能够根据跳转地址实现页面跳转。应用页面内的任一控件都对应一操作区域,对该操作区域任意位置的触发操作都认为是对该控件的触发操作。The controls in the application page include: no-click event control and click-event control. Among them, the no-click event control means that there is no follow-up response after the user clicks the control. Usually, this type of control does not have a corresponding jump address; the click-event control refers to the control. After the user clicks the control, it will respond to the click behavior. Usually, there is a click event control corresponding to the jump address, and the page jump can be realized according to the jump address. Any control in the application page corresponds to an operation area, and a trigger operation at any position of the operation area is considered as a trigger operation of the control.
本实施例提供的语音播报方法可以应用于视障场景,即,盲人或者有视力障碍的人员使用智能终端时,会存在看不见或无法看清其屏幕的情况下,因此,通过语音播报方式来辅助相应人员获知其所触发的控件具体是什么。当然并不限于视障场景,其它需要进行语音播报的场景都适用。The voice broadcast method provided in this embodiment can be applied to a visually impaired scenario, that is, when a blind person or a visually impaired person uses an intelligent terminal, the screen may not be seen or seen clearly. Assist the corresponding personnel to know what the control triggered by them is. Of course, it is not limited to visually impaired scenarios, and other scenarios that require voice broadcast are applicable.
步骤S201,若应用页面内预设区域中的至少两个控件为无点击事件控件,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离,若是,则执行步骤S205。Step S201, if at least two controls in the preset area in the application page are no-click event controls, determine whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance, and if so, go to step S205.
若应用页面内预设区域中的至少两个控件为无点击事件控件,判断至少两个控件是否能够关联具体是通过判断至少两个控件对应的操作区域之间的距离是否小于预设距离,预设距离可以根据实际需要而灵活设定,预设距离是一个临界值,至少两个控件对应的操作区域之间的距离小于预设距离时,表明至少两个控件很近,至少两个控件满足关联条件,即,跳转执行步骤S205。至少两个控件对应的操作区域之间的距离大于或等于预设距离时,表明至少两个控件相隔有点远,至少两个控件不满足关联条件,则方法结束。通常情况下,至少两个控件的位置关系属于上下关系或者左右关系,则对应的操作区域也是上下关系或者左右关系,这里的操作区域之间的距离是指上下距离或左右距离。If at least two controls in the preset area in the application page are no-click event controls, judging whether the at least two controls can be associated is specifically by judging whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance. The set distance can be flexibly set according to actual needs. The preset distance is a critical value. When the distance between the operation areas corresponding to at least two controls is less than the preset distance, it means that at least two controls are very close, and at least two controls meet the requirements. Associative conditions, that is, jump to step S205. When the distance between the operation areas corresponding to the at least two controls is greater than or equal to the preset distance, it indicates that the at least two controls are a little far apart, and the at least two controls do not satisfy the association condition, and the method ends. Usually, if the positional relationship of at least two controls belongs to an up-down relationship or a left-right relationship, the corresponding operation area is also an up-down relationship or a left-right relationship, and the distance between the operation areas here refers to the up-down distance or the left-right distance.
步骤S202,若应用页面内预设区域中的至少两个控件包含无点击事件控件和有点击事件控件,则判断无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间是否存在关联性,若是,则执行步骤S203。Step S202, if at least two controls in the preset area in the application page include a no-click event control and a click-event control, then determine whether there is a control focus content of the no-click event control and the control focus content of the click-event control. Relevance, if yes, execute step S203.
无点击事件控件是指用户点击控件后没有后续响应,通常这类控件并没 有对应跳转地址;有点击事件控件是指用户点击控件后,会对点击行为而做出响应,通常有点击事件控件对应着跳转地址,能够根据跳转地址实现页面跳转。无点击事件控件并不对应跳转地址,因此,若应用页面内预设区域中的至少两个控件既包含了无点击事件控件又包含了有点击事件控件,则不能基于跳转地址来确定至少两个控件是否能够关联。No click event control means that there is no follow-up response after the user clicks the control, usually this type of control does not have a corresponding jump address; click event control means that after the user clicks the control, it will respond to the click behavior, usually there is a click event control Corresponding to the jump address, the page jump can be realized according to the jump address. The no-click event control does not correspond to the jump address. Therefore, if at least two controls in the preset area of the application page contain both the no-click event control and the click event control, the at least two controls cannot be determined based on the jump address. Whether the two controls can be associated.
通常情况下,为了保证语音播报的多个控件焦点内容的关联,若应用页面内预设区域中的至少两个控件包含无点击事件控件和有点击事件控件,还需要进行判断无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间是否存在关联性,例如,可以通过对控件焦点内容进行语义分析来确定无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间是否存在关联性,如果至少两个控件对应的控件焦点内容表示相同或相近的语义可以确定存在关联性;或者,若无点击事件控件的控件焦点内容用于解释说明有点击事件控件,可以确定至少两个控件对应的控件焦点内容存在关联性,举例说明,有点击事件控件对应的控件焦点内容为“阅饼”,无点击事件控件对应的控件焦点内容为“9242”,“9242”用于说明“阅饼”数量。在确定无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间存在关联性的情况下,可以跳转执行步骤S205;在确定无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间不存在关联性的情况下,方法结束。Usually, in order to ensure the association of the focus content of multiple controls in the voice broadcast, if at least two controls in the preset area of the application page include a no-click event control and a click-event control, it is also necessary to judge the no-click event control. Whether there is a correlation between the control focus content and the control focus content of a control with a click event, for example, you can determine the difference between the focus content of a control without a click event and the focus content of a control with a click event by performing semantic analysis on the focus content of the control. Whether there is a correlation between the two controls, if the focus content of the controls corresponding to at least two controls represents the same or similar semantics, it can be determined that there is correlation; or, if the focus content of a control without a click event control is used to explain that there is a click event control, it can be determined The control focus content corresponding to at least two controls is related. For example, the control focus content corresponding to a control with a click event is "Reading Pie", and the control focus content corresponding to a control without a click event is "9242", and "9242" is used for Indicate the number of "reading cakes". If it is determined that there is a correlation between the control focus content of the control without a click event and the control focus content of the control with a click event, step S205 can be skipped to execute; The method ends when there is no association between the focus content of the control.
步骤S203,判断至少两个控件对应的操作区域之间的距离是否小于预设距离;若是,则执行步骤S205。Step S203, judging whether the distance between the operation areas corresponding to the at least two controls is smaller than the preset distance; if yes, then performing step S205.
预设距离可以根据实际需要而灵活设定,预设距离是一个临界值,至少两个控件对应的操作区域之间的距离小于预设距离时,表明至少两个控件很近,至少两个控件满足关联条件,即,跳转执行步骤S205。至少两个控件对应的操作区域之间的距离大于或等于预设距离时,表明至少两个控件相隔有点远,至少两个控件不满足关联条件,则方法结束。The preset distance can be flexibly set according to actual needs. The preset distance is a critical value. When the distance between the operation areas corresponding to at least two controls is smaller than the preset distance, it means that at least two controls are very close, and at least two controls are very close. The association condition is satisfied, that is, step S205 is jumped to. When the distance between the operation areas corresponding to the at least two controls is greater than or equal to the preset distance, it indicates that the at least two controls are a little far apart, and the at least two controls do not satisfy the association condition, and the method ends.
步骤S204,若应用页面内预设区域中的至少两个控件为有点击事件控件,则判断至少两个控件对应的跳转地址是否相同,若是,则执行步骤S205。Step S204, if at least two controls in the preset area in the application page are controls with click events, determine whether the jump addresses corresponding to the at least two controls are the same, and if so, go to step S205.
有点击事件控件都对应着一个跳转地址,因此,可以基于跳转地址来确定是否对至少两个控件进行关联,具体地,针对应用页面内预设区域中的至 少两个有点击事件控件,可以通过如下方法来确定至少两个控件是否满足关联条件:判断至少两个控件所对应的跳转地址是否是同一个跳转地址,如果是同一个跳转地址,表明分别点击至少两个控件后,所做出的响应是相同的,即,跳转至同一个页面,那么可以确定至少两个控件满足关联条件,即,跳转执行步骤S205;如果不是同一个跳转地址,表明分别点击至少两个控件后,跳转至不同的页面,则确定至少两个控件不满足关联条件,方法结束。Each of the click event controls corresponds to a jump address. Therefore, whether to associate at least two controls can be determined based on the jump address. Specifically, for at least two click event controls in the preset area in the application page, The following method can be used to determine whether at least two controls satisfy the association condition: judging whether the jump addresses corresponding to at least two controls are the same jump address, if it is the same jump address, it means that after clicking at least two controls respectively. , the responses made are the same, that is, jumping to the same page, then it can be determined that at least two controls meet the associated conditions, that is, jumping to perform step S205; After the two controls, jump to different pages, it is determined that at least two controls do not satisfy the association condition, and the method ends.
步骤S205,确定至少两个控件满足关联条件。Step S205, it is determined that at least two controls satisfy the association condition.
若判断出至少两个控件对应的操作区域之间的距离小于预设距离,或者,判断出至少两个控件对应的跳转地址相同,则可以确定至少两个控件满足关联条件,从而可以将至少两个控件进行关联处理。If it is determined that the distance between the operation areas corresponding to the at least two controls is less than the preset distance, or that the jump addresses corresponding to the at least two controls are determined to be the same, it can be determined that the at least two controls satisfy the association condition, so that the at least two controls can be The two controls are associated with each other.
步骤S206,对至少两个控件对应的操作区域进行合并处理,得到合并操作区域。Step S206 , merge the operation areas corresponding to the at least two controls to obtain the merge operation area.
对于满足关联条件的至少两个控件,可以通过将至少两个控件对应的操作区域进行合并的方式来实现至少两个控件的关联,通过将至少两个操作进行合并可以扩大用户可操作区域,使得用户无需每次都看准控件所在位置后才能进行有效点击,从而能够有效解决控件对应的操作区域过小时,不便于用户进行点击的问题,对于视障人士而言,提升了用户使用体验。For at least two controls that satisfy the association condition, the association of the at least two controls can be realized by merging the operation areas corresponding to the at least two controls. By merging the at least two operations, the user operable area can be expanded, so that The user does not need to look at the position of the control every time to click effectively, which can effectively solve the problem that the operation area corresponding to the control is too small, which is inconvenient for the user to click. For the visually impaired, the user experience is improved.
在本公开一种可选实施方式中,每个控件所对应的操作区域是固定的,因此,可以利用最小矩形覆盖原理来实现对至少两个控件对应的操作区域进行合并处理,具体地,确定包含至少两个控件对应的操作区域的最小矩形区域,将最小矩形区域确定为合并操作区域,在确定合并操作区域后,还可以确定合并操作区域所对应的区域坐标,以便于后续确定合并操作区域覆盖的控件。或者,记录合并操作区域与至少两个控件的关联关系。In an optional embodiment of the present disclosure, the operation area corresponding to each control is fixed. Therefore, the operation area corresponding to at least two controls can be merged by using the principle of minimum rectangular coverage. Specifically, determine The smallest rectangular area containing the operation areas corresponding to at least two controls, and the smallest rectangular area is determined as the merge operation area. After the merge operation area is determined, the area coordinates corresponding to the merge operation area can also be determined, so as to facilitate the subsequent determination of the merge operation area Override controls. Or, record the association relationship between the merge operation area and at least two controls.
为了便于理解,下面结合具体图例进行说明,图2B为控件对应操作区域的示意图,如图2B所示,头像控件、等级控件、昵称控件都对应有相应的操作区域,三个控件对应着相同的跳转地址,因此,可以对三个控件对应的操作区域进行合并处理,合并处理后所得到的合并操作区域如图2C所示。For ease of understanding, the following description is given in conjunction with specific legends. Fig. 2B is a schematic diagram of the corresponding operation area of the controls. As shown in Fig. 2B, the avatar control, the level control and the nickname control all have corresponding operation areas, and the three controls correspond to the same operation area. Therefore, the operation areas corresponding to the three controls can be merged, and the merge operation area obtained after the merge processing is shown in FIG. 2C .
步骤S207,响应于用户对应用页面内任一合并操作区域的触发操作,确定合并操作区域覆盖的至少两个控件,依次语音播报合并操作区域覆盖的至少两个控件的控件焦点内容。Step S207, in response to a user triggering any merge operation area in the application page, determine at least two controls covered by the merge operation area, and sequentially voice broadcast the control focus content of the at least two controls covered by the merge operation area.
用户在应用页面内进行点击后,为了便于用户获知所点击的具体是什么,发生点击行为后,获取到用户点击位置的位置坐标,因此,可以通过位置坐标匹配方式来确定用户是对哪个合并操作区域的触发操作,响应于用户对应用页面内任一合并操作区域的触发操作,需要确定合并操作区域覆盖的至少两个控件,每个控件都对应有各自的操作区域,都对应有位置坐标,因此,可以通过确定哪些控件的位置坐标落入到合并操作区域的位置坐标范围内,来确定合并操作区域所覆盖的至少两个控件,或者,也可以通过查询方式来确定与该合并操作区域存在关联的至少两个控件,在确定合并操作区域覆盖的至少两个控件之后,依次语音播报合并操作区域覆盖的至少两个控件的控件焦点内容,通过一次触发操作,实现了语音播报多个控件焦点内容的效果,简化了用户操作,使得用户无需频繁地触发控件,从而提升了用户使用体验。After the user clicks on the application page, in order to facilitate the user to know what is clicked, after the click occurs, the position coordinates of the click position of the user are obtained. Therefore, the position coordinate matching method can be used to determine which merge operation the user is for The trigger operation of the area, in response to the user's trigger operation on any merge operation area in the application page, it is necessary to determine at least two controls covered by the merge operation area. Each control corresponds to its own operation area and corresponds to the position coordinates. Therefore, it is possible to determine at least two controls covered by the merge operation area by determining the position coordinates of which controls fall within the range of the position coordinates of the merge operation area, or to determine the existence of the merge operation area with the query method. The associated at least two controls, after determining the at least two controls covered by the merge operation area, sequentially voice broadcast the control focus content of the at least two controls covered by the merge operation area, and realize the voice broadcast of multiple control focuses through one trigger operation The effect of the content simplifies the user operation, so that the user does not need to trigger the control frequently, thereby improving the user experience.
步骤S208,响应于用户再次对应用页面内任一合并操作区域的触发操作,根据该合并操作区域所覆盖控件对应的跳转地址进行页面跳转处理。Step S208, in response to the user's triggering operation on any merge operation area in the application page again, perform page jump processing according to the jump address corresponding to the control covered by the merge operation area.
若合并操作区域所覆盖的至少两个控件对应着某个跳转地址,在语音播报完合并操作区域覆盖的至少两个控件的控件焦点内容后,若是用户想要继续了解更多内容或进入该控件对应的跳转页面,可以再次对该合并操作区执行触发操作,响应于用户再次对应用页面内任一合并操作区域的触发操作,根据该合并操作区域所覆盖控件对应的跳转地址进行页面跳转处理,跳转至该跳转地址所对应的页面。If the at least two controls covered by the merge operation area correspond to a certain jump address, after the voice broadcast of the control focus content of the at least two controls covered by the merge operation area, if the user wants to continue to know more content or enter the For the jump page corresponding to the control, a trigger operation can be performed on the merge operation area again. In response to the user's trigger operation on any merge operation area in the application page again, the page is executed according to the jump address corresponding to the control covered by the merge operation area. Jump processing, jump to the page corresponding to the jump address.
举例说明,合并操作区域覆盖了“头像”控件、“昵称”控件及“等级”控件,三个控件对应同一跳转地址,该跳转地址对应着设置页面,响应于用户再次对合并操作区域的触发操作,实现页面跳转,跳转后的页面为设置页面。For example, the merge operation area covers the "avatar" control, the "nickname" control and the "level" control. The three controls correspond to the same jump address, and the jump address corresponds to the setting page. Trigger the operation to realize page jump, and the page after jump is the setting page.
在本公开一种可选实施方式中,应用页面内还包含激活控件,激活控件通常以“更多”按钮或
Figure PCTCN2021121810-appb-000001
按钮表示,通过点击“更多”按钮或
Figure PCTCN2021121810-appb-000002
按钮可以调出控件焦点内容,通常是以下拉列表形式来表示,如图2D所示,为了使用户能够获知激活控件都包含有哪些控件焦点内容,响应于用户对应用页面内任一激活控件的触发操作,依次语音播报激活控件对应的控件焦点内容,即,激活后,对下拉列表里的控件焦点内容依次全部播报一遍,举例 说明,书架页面中的更多按钮即为激活控件,激活控件与以下控件焦点内容对应:导入本地书、无线传书、云书架、整理书架、书籍排序、扫一扫、备份与同步,在监测到用户对书架页面中的更多按钮的触发操作后,响应于该触发操作,依次语音播报导入本地书、无线传书、云书架、整理书架、书籍排序、扫一扫、备份与同步,而不是只对第一个控件焦点内容(导入本地书)进行播报,下拉列表里的其他控件焦点内容则不再进行语音播报。通过对激活控件对应的控件焦点内容依次进行语音播报,使得用户能够清楚地了解每个控件具体能够实现哪些功能,便于用户后续使用,对于视障人士而言,通过依次语音播报激活控件对应的控件焦点内容,而不再是只语音播报第一个控件焦点内容,能够丰富视障人士的使用功能。
In an optional implementation manner of the present disclosure, an activation control is also included in the application page, and the activation control is usually represented by a "more" button or
Figure PCTCN2021121810-appb-000001
button means that by clicking the "More" button or
Figure PCTCN2021121810-appb-000002
The button can call out the focus content of the control, usually in the form of a drop-down list, as shown in Figure 2D, in order to enable the user to know which control focus content is included in the activated control, in response to the user's response to any activated control in the application page. Trigger the operation, and sequentially voice broadcast the control focus content corresponding to the activated control, that is, after activation, broadcast all the control focus content in the drop-down list in turn. For example, the more buttons on the bookshelf page are the activation controls. The following control focus content corresponds to: importing local books, wireless book transfer, cloud bookshelf, organizing bookshelves, book sorting, scanning, backup and synchronization. This trigger operation, in turn, voice broadcast of importing local books, wireless book transmission, cloud bookshelf, sorting bookshelf, book sorting, scanning, backup and synchronization, instead of only broadcasting the focus content of the first control (importing local books), The focus content of other controls in the drop-down list will no longer be broadcast. By sequentially performing voice broadcasts on the focus content of the controls corresponding to the activated controls, users can clearly understand which functions each control can implement, which is convenient for users to use later. Focus content, instead of just voice broadcast of the focus content of the first control, can enrich the use functions of the visually impaired.
在本公开一种可选实施方式中,方法还包括:响应于用户对编辑控件的触发操作,语音播报编辑控件对应的控件焦点内容,并将输入模式由键盘输入模式切换为语音输入模式。In an optional embodiment of the present disclosure, the method further includes: in response to a triggering operation of the editing control by the user, voice broadcast of the control focus content corresponding to the editing control, and switching the input mode from the keyboard input mode to the voice input mode.
该可选实施方式中的编辑控件指提供文字输入操作的控件,例如,可以是搜索控件或者评论控件等,当用户想要输入具体文字时,可以触发编辑控件,例如,点击编辑控件,响应于用户对编辑控件的触发操作,会通过语音播报方式向用户语音播报编辑控件对应的控件焦点内容,告知用户所触发的是什么控件,而为了便于视障人士操作,在该可选实施方式中唤起了语音输入模式,也就是说,将输入模式由键盘输入模式切换为语音输入模式,使得用户无需手动输入文字,而是通过语音输入方式达到相应的编辑目的。The editing control in this optional embodiment refers to a control that provides text input operations, for example, a search control or a comment control, etc. When the user wants to input specific text, the editing control can be triggered, for example, clicking on the editing control, responding to The user's trigger operation on the editing control will broadcast the focus content of the control corresponding to the editing control to the user through voice broadcast, so as to inform the user what control is triggered. The voice input mode is adopted, that is, the input mode is switched from the keyboard input mode to the voice input mode, so that the user does not need to manually input text, but achieves the corresponding editing purpose through the voice input method.
举例说明,用户进入到搜索页面想要搜索本地或者书城中是否存在电子书“长安客”,通常情况下需要用户在搜索输入框中输入“长安客”,为了便于视障人士操作,在监测到用户对“搜索输入框”控件的触发操作后,响应于用户对“搜索输入框”控件的触发操作,语音播报“搜索输入框”控件对应的控件焦点内容,例如,语音播报“搜索输入框”,并将输入模式由键盘输入模式切换为语音输入模式,用户可以通过语音方式描述“搜索输入框”实现搜索,得到搜索结果后,还可以依次语音播报搜索结果。For example, when a user enters the search page and wants to search whether there is an e-book "Changanke" in the local or bookstore, usually the user needs to enter "Changanke" in the search input box. After the user triggers the "Search Input Box" control, in response to the user's trigger operation for the "Search Input Box" control, the focus content of the control corresponding to the "Search Input Box" control is broadcast by voice, for example, the voice broadcast "Search Input Box" , and switch the input mode from the keyboard input mode to the voice input mode. The user can describe the "search input box" by voice to realize the search, and after obtaining the search results, they can also voice broadcast the search results in sequence.
该可选实施方式还可以应用于其他场景,例如,针对某个电子书编写想法或者书评,或者回复他人的评论等场景,这里不再详细赘述。This optional implementation manner may also be applied to other scenarios, for example, scenarios such as writing an idea or a book review for an e-book, or replying to comments from others, which will not be described in detail here.
在本公开一种可选实施方式中,方法还包括:响应于用户对指定电子书 控件的触发操作,语音播报指定电子书控件对应的电子书标识;In an optional embodiment of the present disclosure, the method further includes: in response to a triggering operation of the specified electronic book control by the user, voice broadcast of the electronic book identifier corresponding to the specified electronic book control;
响应于用户再次对指定电子书控件的触发操作,判断数据库中是否存储有与指定电子书控件对应的电子书标识相匹配的有声书籍;In response to the user's triggering operation on the specified e-book control again, judging whether an audio book matching the e-book identifier corresponding to the specified e-book control is stored in the database;
若是,则语音播放有声书籍;If so, play audiobooks by voice;
若否,则下载语音朗读插件以利用语音朗读插件语音朗读指定电子书。If not, download the voice-reading plug-in to voice-read the specified e-book using the voice-reading plug-in.
具体地,对于应用页面是电子书页面的情况,当用户想要阅读电子书时,用户可以触发指定电子书控件,响应于用户对指定电子书控件的触发操作,对指定电子书控件对应的电子书标识进行语音播报,使用户通过语音播报方式来确定是否是其想要阅读的电子书。如果是用户想要阅读的电子书,用户可以再次触发指定电子书控件,响应于用户再次对指定电子书控件的触发操作,判断数据库中是否存储有与指定电子书控件对应的电子书标识相匹配的有声书籍,例如,可以根据指定电子书控件对应的电子书标识查询有声书籍对应的数据库,将指定电子书控件对应的电子书标识与有声书籍的标识进行匹配,若匹配上,可以确定存在相匹配的有声书籍,则控制语音播放有声书籍;若未匹配上,可以确定不存在相匹配的有声书籍,则下载并安装语音朗读插件,在安装完成后利用语音朗读插件来语音朗读指定电子书。Specifically, for the case where the application page is an e-book page, when the user wants to read an e-book, the user can trigger the designated e-book control, and in response to the user's triggering operation on the designated e-book control, the electronic book corresponding to the designated e-book control The book identification performs voice broadcast, so that the user can determine whether it is the e-book he wants to read through the voice broadcast method. If it is an e-book that the user wants to read, the user can trigger the designated e-book control again, and in response to the user's triggering operation on the designated e-book control again, it is determined whether there is an e-book identifier stored in the database that matches the designated e-book control. For example, you can query the database corresponding to the audio book according to the e-book ID corresponding to the specified e-book control, and match the e-book ID corresponding to the specified e-book control with the audio book ID. If there is a matching audiobook, control the voice to play the audiobook; if it does not match, it can be determined that there is no matching audiobook, download and install the voice reading plug-in, and use the voice reading plug-in to read the specified e-book by voice after the installation is complete.
本公开上述实施例提供的方法,通过将满足关联条件的至少两个控件进行关联,为后续通过一次触发操作语音播报多个控件的控件焦点内容提供了实现基础;通过将满足关联条件的至少两个控件对应的操作区域进行合并,扩大了用户可操作区域,使得用户无需每次都看准控件所在位置后才能进行有效点击,从而能够有效解决控件对应的操作区域过小时,不便于用户进行点击的问题,对于视障人士而言,提升了用户使用体验;响应于用户对合并操作区域的触发操作,确定合并操作区域覆盖的至少两个控件,依次语音播报合并操作区域覆盖的至少两个控件的控件焦点内容,实现了通过一次触发操作来语音播报多个关联控件焦点内容的效果,简化了用户操作,使得用户无需频繁地触发控件,就能够快速找到想要操作的控件,避免了触发操作与语音播报之间频繁切换,从而提升了用户使用体验。The method provided by the above-mentioned embodiments of the present disclosure provides an implementation basis for subsequently broadcasting the control focus content of multiple controls through one trigger operation by associating at least two controls that satisfy the association condition; The operation area corresponding to each control is merged, which expands the user's operable area, so that the user does not need to look at the location of the control every time before clicking effectively, which can effectively solve the problem that the operation area corresponding to the control is too small, which is inconvenient for the user to click. For the visually impaired, the user experience is improved; in response to the user's triggering operation on the merge operation area, at least two controls covered by the merge operation area are determined, and the at least two controls covered by the merge operation area are sequentially voice broadcast. The focus content of the control, realizes the effect of broadcasting the focus content of multiple associated controls by one trigger operation, which simplifies the user operation, so that the user can quickly find the desired control without triggering the control frequently, avoiding the trigger operation. Frequent switching between voice broadcast and voice broadcast, thus improving the user experience.
本公开实施例还提供了一种非易失性计算机可读存储介质,该非易失性计算机可读存储介质存储有至少一可执行指令,该计算机可执行指令可执行上述任意方法实施例中的语音播报方法。An embodiment of the present disclosure further provides a non-volatile computer-readable storage medium, where the non-volatile computer-readable storage medium stores at least one executable instruction, and the computer-executable instruction can execute any of the foregoing method embodiments. voice broadcast method.
可执行指令具体可以用于使得处理器执行以下操作:Executable instructions can specifically be used to cause the processor to perform the following operations:
针对应用页面内预设区域中的至少两个控件,判断至少两个控件是否满足关联条件;For at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition;
若是,则将至少两个控件进行关联处理;If so, associate at least two controls;
响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容。In response to a user's triggering operation on any control in the application page, at least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
在一种可选的方式中,任一控件对应一操作区域;In an optional manner, any control corresponds to an operation area;
可执行指令进一步使处理器执行以下操作:The executable instructions further cause the processor to:
若至少两个控件为无点击事件控件,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If the at least two controls are no-click event controls, determine whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance;
若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
在一种可选的方式中,任一控件对应一操作区域;In an optional manner, any control corresponds to an operation area;
可执行指令进一步使处理器执行以下操作:The executable instructions further cause the processor to:
若至少两个控件包含无点击事件控件和有点击事件控件,则判断无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间是否存在关联性;If at least two controls include a control without a click event and a control with a click event, determine whether there is a correlation between the focus content of the control without a click event and the focus content of the control with a click event;
若存在关联性,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If there is correlation, determine whether the distance between the operation areas corresponding to at least two controls is less than the preset distance;
若小于预设距离,则确定至少两个控件满足关联条件。If it is less than the preset distance, it is determined that at least two controls satisfy the association condition.
在一种可选的方式中,可执行指令进一步使处理器执行以下操作:In an optional manner, the executable instructions further cause the processor to:
若至少两个控件为有点击事件控件,则判断至少两个控件对应的跳转地址是否相同;If at least two controls are controls with click events, determine whether the jump addresses corresponding to at least two controls are the same;
若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
在一种可选的方式中,任一控件对应一操作区域;In an optional manner, any control corresponds to an operation area;
可执行指令进一步使处理器执行以下操作:The executable instructions further cause the processor to:
对至少两个控件对应的操作区域进行合并处理,得到合并操作区域;The operation areas corresponding to at least two controls are merged to obtain a merged operation area;
响应于用户对应用页面内任一合并操作区域的触发操作,确定合并操作区域覆盖的至少两个控件,依次语音播报合并操作区域覆盖的至少两个控件 的控件焦点内容。In response to a user triggering operation on any merge operation area in the application page, at least two controls covered by the merge operation area are determined, and the control focus content of the at least two controls covered by the merge operation area is sequentially voice broadcast.
在一种可选的方式中,可执行指令进一步使处理器执行以下操作:In an optional manner, the executable instructions further cause the processor to:
确定包含至少两个控件对应的操作区域的最小矩形区域,将最小矩形区域确定为合并操作区域。Determine the smallest rectangular area containing the operation areas corresponding to at least two controls, and determine the smallest rectangular area as the combined operation area.
在一种可选的方式中,可执行指令还使处理器执行以下操作:In an optional manner, the executable instructions also cause the processor to:
响应于用户再次对应用页面内任一合并操作区域的触发操作,根据该合并操作区域所覆盖控件对应的跳转地址进行页面跳转处理。In response to the user's triggering operation on any merge operation area in the application page again, page jump processing is performed according to the jump address corresponding to the control covered by the merge operation area.
在一种可选的方式中,可执行指令还使处理器执行以下操作:In an optional manner, the executable instructions also cause the processor to:
响应于用户对应用页面内任一激活控件的触发操作,依次语音播报激活控件对应的控件焦点内容。In response to the user's triggering operation on any activated control in the application page, the control focus content corresponding to the activated control is sequentially voice broadcast.
在一种可选的方式中,可执行指令还使处理器执行以下操作:In an optional manner, the executable instructions also cause the processor to:
响应于用户对编辑控件的触发操作,语音播报编辑控件对应的控件焦点内容,并将输入模式由键盘输入模式切换为语音输入模式。In response to the user's triggering operation on the editing control, the focus content of the control corresponding to the editing control is announced by voice, and the input mode is switched from the keyboard input mode to the voice input mode.
在一种可选的方式中,可执行指令还使处理器执行以下操作:In an optional manner, the executable instructions also cause the processor to:
响应于用户对指定电子书控件的触发操作,语音播报指定电子书控件对应的电子书标识;In response to the user's triggering operation on the designated e-book control, voice broadcast the e-book identifier corresponding to the designated e-book control;
响应于用户再次对指定电子书控件的触发操作,判断数据库中是否存储有与指定电子书控件对应的电子书标识相匹配的有声书籍;In response to the user's triggering operation on the specified e-book control again, judging whether an audio book matching the e-book identifier corresponding to the specified e-book control is stored in the database;
若是,则语音播放有声书籍;If so, play audiobooks by voice;
若否,则下载语音朗读插件以利用语音朗读插件语音朗读指定电子书。If not, download the voice-reading plug-in to voice-read the specified e-book using the voice-reading plug-in.
图3示出了根据本公开一个实施例的计算设备的结构示意图,本公开具体实施例并不对计算设备的具体实现做限定。FIG. 3 shows a schematic structural diagram of a computing device according to an embodiment of the present disclosure. The specific embodiment of the present disclosure does not limit the specific implementation of the computing device.
如图3所示,该计算设备可以包括:处理器(processor)302、通信接口(Communications Interface)304、存储器(memory)306、以及通信总线308。As shown in FIG. 3 , the computing device may include: a processor (processor) 302 , a communication interface (Communications Interface) 304 , a memory (memory) 306 , and a communication bus 308 .
其中:处理器302、通信接口304、以及存储器306通过通信总线308完成相互间的通信。The processor 302 , the communication interface 304 , and the memory 306 communicate with each other through the communication bus 308 .
通信接口304,用于与其它设备比如客户端或其它服务器等的网元通信。The communication interface 304 is used for communicating with network elements of other devices such as clients or other servers.
处理器302,用于执行程序310,具体可以执行上述语音播报方法实施 例中的相关步骤。The processor 302 is configured to execute the program 310, and specifically may execute the relevant steps in the above-mentioned embodiments of the voice broadcasting method.
具体地,程序310可以包括程序代码,该程序代码包括计算机操作指令。Specifically, the program 310 may include program code including computer operation instructions.
处理器302可能是中央处理器CPU,或者是特定集成电路ASIC(Application Specific Integrated Circuit),或者是被配置成实施本公开实施例的一个或多个集成电路。计算设备包括的一个或多个处理器,可以是同一类型的处理器,如一个或多个CPU;也可以是不同类型的处理器,如一个或多个CPU以及一个或多个ASIC。The processor 302 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present disclosure. The one or more processors included in the computing device may be the same type of processors, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.
存储器306,用于存放程序310。存储器306可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。The memory 306 is used to store the program 310 . Memory 306 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.
程序310具体可以用于使得处理器302执行以下操作:The program 310 can specifically be used to cause the processor 302 to perform the following operations:
针对应用页面内预设区域中的至少两个控件,判断至少两个控件是否满足关联条件;For at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition;
若是,则将至少两个控件进行关联处理;If so, associate at least two controls;
响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容。In response to a user's triggering operation on any control in the application page, at least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
在一种可选的方式中,任一控件对应一操作区域;In an optional manner, any control corresponds to an operation area;
程序310进一步使处理器302执行以下操作: Routine 310 further causes processor 302 to perform the following operations:
若至少两个控件为无点击事件控件,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If the at least two controls are no-click event controls, determine whether the distance between the operation areas corresponding to the at least two controls is less than the preset distance;
若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
在一种可选的方式中,任一控件对应一操作区域;In an optional manner, any control corresponds to an operation area;
程序310进一步使处理器302执行以下操作: Routine 310 further causes processor 302 to perform the following operations:
若至少两个控件包含无点击事件控件和有点击事件控件,则判断无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间是否存在关联性;If at least two controls include a control without a click event and a control with a click event, determine whether there is a correlation between the focus content of the control without a click event and the focus content of the control with a click event;
若存在关联性,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If there is correlation, determine whether the distance between the operation areas corresponding to at least two controls is less than the preset distance;
若小于预设距离,则确定至少两个控件满足关联条件。If it is less than the preset distance, it is determined that at least two controls satisfy the association condition.
在一种可选的方式中,程序310进一步使处理器302执行以下操作:In an optional manner, program 310 further causes processor 302 to perform the following operations:
若至少两个控件为有点击事件控件,则判断至少两个控件对应的跳转地址是否相同;If at least two controls are controls with click events, determine whether the jump addresses corresponding to at least two controls are the same;
若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
在一种可选的方式中,任一控件对应一操作区域;In an optional manner, any control corresponds to an operation area;
程序310进一步使处理器302执行以下操作: Routine 310 further causes processor 302 to perform the following operations:
对至少两个控件对应的操作区域进行合并处理,得到合并操作区域;The operation areas corresponding to at least two controls are merged to obtain a merged operation area;
响应于用户对应用页面内任一合并操作区域的触发操作,确定合并操作区域覆盖的至少两个控件,依次语音播报合并操作区域覆盖的至少两个控件的控件焦点内容。In response to a user triggering operation on any merge operation area in the application page, at least two controls covered by the merge operation area are determined, and the control focus content of the at least two controls covered by the merge operation area is sequentially voice broadcast.
在一种可选的方式中,程序310进一步使处理器302执行以下操作:In an optional manner, program 310 further causes processor 302 to perform the following operations:
确定包含至少两个控件对应的操作区域的最小矩形区域,将最小矩形区域确定为合并操作区域。Determine the smallest rectangular area containing the operation areas corresponding to at least two controls, and determine the smallest rectangular area as the combined operation area.
在一种可选的方式中,程序310还使处理器302执行以下操作:In an optional manner, program 310 also causes processor 302 to perform the following operations:
响应于用户再次对应用页面内任一合并操作区域的触发操作,根据该合并操作区域所覆盖控件对应的跳转地址进行页面跳转处理。In response to the user's triggering operation on any merge operation area in the application page again, page jump processing is performed according to the jump address corresponding to the control covered by the merge operation area.
在一种可选的方式中,程序310还使处理器302执行以下操作:In an optional manner, program 310 also causes processor 302 to perform the following operations:
响应于用户对应用页面内任一激活控件的触发操作,依次语音播报激活控件对应的控件焦点内容。In response to the user's triggering operation on any activated control in the application page, the control focus content corresponding to the activated control is sequentially voice broadcast.
在一种可选的方式中,程序310还使处理器302执行以下操作:In an optional manner, program 310 also causes processor 302 to perform the following operations:
响应于用户对编辑控件的触发操作,语音播报编辑控件对应的控件焦点内容,并将输入模式由键盘输入模式切换为语音输入模式。In response to the user's triggering operation on the editing control, the focus content of the control corresponding to the editing control is announced by voice, and the input mode is switched from the keyboard input mode to the voice input mode.
在一种可选的方式中,程序310还使处理器302执行以下操作:In an optional manner, program 310 also causes processor 302 to perform the following operations:
响应于用户对指定电子书控件的触发操作,语音播报指定电子书控件对应的电子书标识;In response to the user's triggering operation on the designated e-book control, voice broadcast the e-book identifier corresponding to the designated e-book control;
响应于用户再次对指定电子书控件的触发操作,判断数据库中是否存储有与指定电子书控件对应的电子书标识相匹配的有声书籍;In response to the user's triggering operation on the specified e-book control again, judging whether an audio book matching the e-book identifier corresponding to the specified e-book control is stored in the database;
若是,则语音播放有声书籍;If so, play audiobooks by voice;
若否,则下载语音朗读插件以利用语音朗读插件语音朗读指定电子书。If not, download the voice-reading plug-in to voice-read the specified e-book using the voice-reading plug-in.
在此提供的算法或显示不与任何特定计算机、虚拟系统或者其它设备固有相关。各种通用系统也可以与基于在此的示教一起使用。根据上面的描述,构造这类系统所要求的结构是显而易见的。此外,本公开实施例也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本公开的内容,并且上面对特定语言所做的描述是为了披露本公开的最佳实施方式。The algorithms or displays provided herein are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems can also be used with teaching based on this. The structure required to construct such a system is apparent from the above description. Furthermore, embodiments of the present disclosure are not directed to any particular programming language. It is to be understood that various programming languages can be used to implement the disclosures described herein and that the descriptions of specific languages above are intended to disclose the best mode of the disclosure.
在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本公开的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the present disclosure may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
类似地,应当理解,为了精简本公开并帮助理解各个公开方面中的一个或多个,在上面对本公开的示例性实施例的描述中,本公开实施例的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本公开要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,公开方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本公开的单独实施例。Similarly, it is to be understood that in the above description of exemplary embodiments of the present disclosure, various features of embodiments of the present disclosure are sometimes grouped together into a single implementation in order to simplify the present disclosure and to aid in the understanding of one or more of the various disclosed aspects. examples, figures, or descriptions thereof. However, this method of disclosure should not be interpreted as reflecting an intention that the claimed disclosure requires more features than are expressly recited in each claim. Rather, as the following claims reflect, disclosed aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of the present disclosure.
本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art will understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
此外,本领域的技术人员能够理解,尽管在此的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意 味着处于本公开的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, it will be understood by those skilled in the art that although some of the embodiments herein include certain features, but not others, included in other embodiments, that combinations of features of the different embodiments are intended to be within the scope of the present disclosure And form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
本公开的各个部件实施例可以以硬件实现,或者以在一个或者多个处理器上运行的软件模块实现,或者以它们的组合实现。本领域的技术人员应当理解,可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本公开实施例的一些或者全部部件的一些或者全部功能。本公开还可以实现为用于执行这里所描述的方法的一部分或者全部的设备或者装置程序(例如,计算机程序和计算机程序产品)。这样的实现本公开的程序可以存储在计算机可读介质上,或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到,或者在载体信号上提供,或者以任何其他形式提供。Various component embodiments of the present disclosure may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components according to embodiments of the present disclosure. The present disclosure can also be implemented as apparatus or apparatus programs (eg, computer programs and computer program products) for performing some or all of the methods described herein. Such a program implementing the present disclosure may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.
应该注意的是上述实施例对本公开进行说明而不是对本公开进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本公开可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。上述实施例中的步骤,除有特殊说明外,不应理解为对执行顺序的限定。It should be noted that the above-described embodiments illustrate rather than limit the disclosure, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present disclosure may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names. The steps in the above embodiments should not be construed as limitations on the execution order unless otherwise specified.

Claims (22)

  1. 一种语音播报方法,包括:A voice broadcast method, comprising:
    针对应用页面内预设区域中的至少两个控件,判断所述至少两个控件是否满足关联条件;For at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition;
    若是,则将所述至少两个控件进行关联处理;If yes, then associate the at least two controls;
    响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容。In response to a user's triggering operation on any control in the application page, at least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
  2. 根据权利要求1所述的方法,其中,任一控件对应一操作区域;The method according to claim 1, wherein any control corresponds to an operation area;
    判断所述至少两个控件是否满足关联条件进一步包括:Determining whether the at least two controls satisfy the association condition further includes:
    若所述至少两个控件为无点击事件控件,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If the at least two controls are no-click event controls, then determine whether the distance between the operation areas corresponding to the at least two controls is less than a preset distance;
    若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
  3. 根据权利要求1所述的方法,其中,任一控件对应一操作区域;The method according to claim 1, wherein any control corresponds to an operation area;
    判断所述至少两个控件是否满足关联条件进一步包括:Determining whether the at least two controls satisfy the association condition further includes:
    若所述至少两个控件包含无点击事件控件和有点击事件控件,则判断无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间是否存在关联性;If the at least two controls include a no-click event control and a click-event control, determine whether there is an association between the control focus content of the no-click event control and the control focus content of the click event control;
    若存在关联性,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If there is correlation, determine whether the distance between the operation areas corresponding to at least two controls is less than the preset distance;
    若小于预设距离,则确定至少两个控件满足关联条件。If it is less than the preset distance, it is determined that at least two controls satisfy the association condition.
  4. 根据权利要求1所述的方法,其中,判断所述至少两个控件是否满足关联条件进一步包括:The method according to claim 1, wherein judging whether the at least two controls satisfy an association condition further comprises:
    若所述至少两个控件为有点击事件控件,则判断至少两个控件对应的跳转地址是否相同;If the at least two controls are controls with a click event, then determine whether the jump addresses corresponding to the at least two controls are the same;
    若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
  5. 根据权利要求1-4中任一项所述的方法,其中,任一控件对应一操作区域;The method according to any one of claims 1-4, wherein any control corresponds to an operation area;
    将所述至少两个控件进行关联处理进一步包括:对所述至少两个控件对应的操作区域进行合并处理,得到合并操作区域;The associating processing of the at least two controls further includes: merging the operation areas corresponding to the at least two controls to obtain a merged operation area;
    响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联至少两个控件的控件焦点内容进一步包括:In response to the user's triggering operation on any control in the application page, determining at least one control associated with the control, and sequentially voice broadcasting the control focus content associated with at least two controls further includes:
    响应于用户对应用页面内任一合并操作区域的触发操作,确定所述合并操作区域覆盖的至少两个控件,依次语音播报合并操作区域覆盖的至少两个控件的控件焦点内容。In response to a user triggering operation on any merge operation area in the application page, at least two controls covered by the merge operation area are determined, and the control focus content of the at least two controls covered by the merge operation area is sequentially voice broadcast.
  6. 根据权利要求5所述的方法,其中,对所述至少两个控件对应的操作区域进行合并处理,得到合并操作区域进一步包括:The method according to claim 5, wherein, performing merging processing on the operation areas corresponding to the at least two controls to obtain the merged operation area further comprises:
    确定包含至少两个控件对应的操作区域的最小矩形区域,将所述最小矩形区域确定为合并操作区域。A minimum rectangular area including operation areas corresponding to at least two controls is determined, and the minimum rectangular area is determined as a combined operation area.
  7. 根据权利要求5或6所述的方法,其中,在依次语音播报合并操作区域覆盖的至少两个控件的控件焦点内容之后,所述方法还包括:响应于用户再次对应用页面内任一合并操作区域的触发操作,根据该合并操作区域所覆盖控件对应的跳转地址进行页面跳转处理。The method according to claim 5 or 6, wherein after the control focus content of the at least two controls covered by the merge operation area is announced by voice in sequence, the method further comprises: in response to the user performing any merge operation in the application page again For the trigger operation of the area, the page jump processing is performed according to the jump address corresponding to the control covered by the merge operation area.
  8. 根据权利要求1-7中任一项所述的方法,其中,所述方法还包括:The method of any one of claims 1-7, wherein the method further comprises:
    响应于用户对应用页面内任一激活控件的触发操作,依次语音播报所述激活控件对应的控件焦点内容。In response to the user's triggering operation on any activation control in the application page, the control focus content corresponding to the activation control is voice broadcast in sequence.
  9. 根据权利要求1-8中任一项所述的方法,其中,所述方法还包括:The method of any one of claims 1-8, wherein the method further comprises:
    响应于用户对编辑控件的触发操作,语音播报所述编辑控件对应的控件焦点内容,并将输入模式由键盘输入模式切换为语音输入模式。In response to the user's triggering operation on the editing control, voice broadcasts the control focus content corresponding to the editing control, and the input mode is switched from the keyboard input mode to the voice input mode.
  10. 根据权利要求1-9中任一项所述的方法,其中,所述方法还包括:The method of any one of claims 1-9, wherein the method further comprises:
    响应于用户对指定电子书控件的触发操作,语音播报指定电子书控件对应的电子书标识;In response to the user's triggering operation on the designated e-book control, voice broadcast the e-book identifier corresponding to the designated e-book control;
    响应于用户再次对指定电子书控件的触发操作,判断数据库中是否存储有与所述指定电子书控件对应的电子书标识相匹配的有声书籍;In response to the user's triggering operation on the designated e-book control again, judging whether an audio book matching the e-book identifier corresponding to the designated e-book control is stored in the database;
    若是,则语音播放有声书籍;If so, play audiobooks by voice;
    若否,则下载语音朗读插件以利用所述语音朗读插件语音朗读指定电子书。If not, download a voice-reading plug-in to voice-read the specified e-book using the voice-reading plug-in.
  11. 一种计算设备,包括:处理器、存储器、通信接口和通信总线,所述处理器、所述存储器和所述通信接口通过所述通信总线完成相互间的通信;A computing device, comprising: a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface communicate with each other through the communication bus;
    所述存储器用于存放至少一可执行指令,所述可执行指令使所述处理器执行以下操作:The memory is used to store at least one executable instruction, and the executable instruction causes the processor to perform the following operations:
    针对应用页面内预设区域中的至少两个控件,判断所述至少两个控件是否满足关联条件;For at least two controls in the preset area in the application page, determine whether the at least two controls satisfy the association condition;
    若是,则将所述至少两个控件进行关联处理;If yes, then associate the at least two controls;
    响应于用户对应用页面内任一控件的触发操作,确定与该控件存在关联的至少一个控件,依次语音播报存在关联的至少两个控件的控件焦点内容。In response to a user's triggering operation on any control in the application page, at least one control associated with the control is determined, and the control focus content of the at least two associated controls is sequentially voice broadcast.
  12. 根据权利要求11所述的计算设备,其中,任一控件对应一操作区域;The computing device according to claim 11, wherein any control corresponds to an operation area;
    所述可执行指令进一步使所述处理器执行以下操作:The executable instructions further cause the processor to:
    若所述至少两个控件为无点击事件控件,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If the at least two controls are no-click event controls, then determine whether the distance between the operation areas corresponding to the at least two controls is less than a preset distance;
    若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
  13. 根据权利要求11所述的计算设备,其中,任一控件对应一操作区域;The computing device according to claim 11, wherein any control corresponds to an operation area;
    所述可执行指令进一步使所述处理器执行以下操作:The executable instructions further cause the processor to:
    若所述至少两个控件包含无点击事件控件和有点击事件控件,则判断无点击事件控件的控件焦点内容与有点击事件控件的控件焦点内容之间是否存在关联性;If the at least two controls include a no-click event control and a click-event control, determine whether there is an association between the control focus content of the no-click event control and the control focus content of the click event control;
    若存在关联性,则判断至少两个控件对应的操作区域之间的距离是否小于预设距离;If there is correlation, determine whether the distance between the operation areas corresponding to at least two controls is less than the preset distance;
    若小于预设距离,则确定至少两个控件满足关联条件。If it is less than the preset distance, it is determined that at least two controls satisfy the association condition.
  14. 根据权利要求11所述的计算设备,其中,所述可执行指令进一步使 所述处理器执行以下操作:The computing device of claim 11, wherein the executable instructions further cause the processor to:
    若所述至少两个控件为有点击事件控件,则判断至少两个控件对应的跳转地址是否相同;If the at least two controls are controls with a click event, then determine whether the jump addresses corresponding to the at least two controls are the same;
    若是,则确定至少两个控件满足关联条件。If so, it is determined that at least two controls satisfy the association condition.
  15. 根据权利要求11-14中任一项所述的计算设备,其中,任一控件对应一操作区域;The computing device according to any one of claims 11-14, wherein any control corresponds to an operation area;
    所述可执行指令进一步使所述处理器执行以下操作:The executable instructions further cause the processor to:
    对所述至少两个控件对应的操作区域进行合并处理,得到合并操作区域;Merging the operation areas corresponding to the at least two controls to obtain a merged operation area;
    响应于用户对应用页面内任一合并操作区域的触发操作,确定所述合并操作区域覆盖的至少两个控件,依次语音播报合并操作区域覆盖的至少两个控件的控件焦点内容。In response to a user triggering operation on any merge operation area in the application page, at least two controls covered by the merge operation area are determined, and the control focus content of the at least two controls covered by the merge operation area is sequentially voice broadcast.
  16. 根据权利要求15所述的计算设备,其中,所述可执行指令进一步使所述处理器执行以下操作:16. The computing device of claim 15, wherein the executable instructions further cause the processor to:
    确定包含至少两个控件对应的操作区域的最小矩形区域,将所述最小矩形区域确定为合并操作区域。A minimum rectangular area including operation areas corresponding to at least two controls is determined, and the minimum rectangular area is determined as a combined operation area.
  17. 根据权利要求15或16所述的计算设备,其中,所述可执行指令还使所述处理器执行以下操作:16. The computing device of claim 15 or 16, wherein the executable instructions further cause the processor to:
    响应于用户再次对应用页面内任一合并操作区域的触发操作,根据该合并操作区域所覆盖控件对应的跳转地址进行页面跳转处理。In response to the user's triggering operation on any merge operation area in the application page again, page jump processing is performed according to the jump address corresponding to the control covered by the merge operation area.
  18. 根据权利要求11-17中任一项所述的计算设备,其中,所述可执行指令还使所述处理器执行以下操作:The computing device of any of claims 11-17, wherein the executable instructions further cause the processor to:
    响应于用户对应用页面内任一激活控件的触发操作,依次语音播报所述激活控件对应的控件焦点内容。In response to the user's triggering operation on any activation control in the application page, the control focus content corresponding to the activation control is voice broadcast in sequence.
  19. 根据权利要求11-18中任一项所述的计算设备,其中,所述可执行指令还使所述处理器执行以下操作:The computing device of any of claims 11-18, wherein the executable instructions further cause the processor to:
    响应于用户对编辑控件的触发操作,语音播报所述编辑控件对应的控件 焦点内容,并将输入模式由键盘输入模式切换为语音输入模式。In response to the user's triggering operation on the editing control, voice broadcasts the control focus content corresponding to the editing control, and the input mode is switched from the keyboard input mode to the voice input mode.
  20. 根据权利要求11-19中任一项所述的计算设备,其中,所述可执行指令还使所述处理器执行以下操作:19. The computing device of any of claims 11-19, wherein the executable instructions further cause the processor to:
    响应于用户对指定电子书控件的触发操作,语音播报指定电子书控件对应的电子书标识;In response to the user's triggering operation on the designated e-book control, voice broadcast the e-book identifier corresponding to the designated e-book control;
    响应于用户再次对指定电子书控件的触发操作,判断数据库中是否存储有与所述指定电子书控件对应的电子书标识相匹配的有声书籍;In response to the user triggering the designated e-book control again, judging whether an audio book matching the e-book identifier corresponding to the designated e-book control is stored in the database;
    若是,则语音播放有声书籍;If so, play audiobooks by voice;
    若否,则下载语音朗读插件以利用所述语音朗读插件语音朗读指定电子书。If not, download a voice-reading plug-in to voice-read the specified e-book using the voice-reading plug-in.
  21. 一种非易失性计算机可读存储介质,所述非易失行计算机可读存储介质中存储有至少一可执行指令,所述可执行指令使处理器执行如权利要求1-10中任一项所述的语音播报方法对应的操作。A non-volatile computer-readable storage medium, the non-volatile computer-readable storage medium stores at least one executable instruction, the executable instruction enables a processor to execute any one of claims 1-10 The operations corresponding to the voice broadcast method described in item 1.
  22. 一种计算机程序产品,该计算机程序产品包括存储在非易失性计算机可读存储介质上的计算程序,该计算机程序包括程序指令,当该程序指令被处理器执行时,使该处理器执行前述任一权利要求1-10所述的语音播报方法对应的操作。A computer program product comprising a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions that, when executed by a processor, cause the processor to perform the aforementioned Operations corresponding to the voice broadcast method according to any one of claims 1-10.
PCT/CN2021/121810 2020-11-27 2021-09-29 Voice broadcasting method, computing device and computer storage medium WO2022111047A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011364189.4 2020-11-27
CN202011364189.4A CN112486451B (en) 2020-11-27 2020-11-27 Voice broadcasting method, computing device and computer storage medium

Publications (1)

Publication Number Publication Date
WO2022111047A1 true WO2022111047A1 (en) 2022-06-02

Family

ID=74936730

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/121810 WO2022111047A1 (en) 2020-11-27 2021-09-29 Voice broadcasting method, computing device and computer storage medium

Country Status (2)

Country Link
CN (1) CN112486451B (en)
WO (1) WO2022111047A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117762942A (en) * 2023-12-26 2024-03-26 深圳航天信息有限公司 Form design and storage method, system and readable storage medium

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112486451B (en) * 2020-11-27 2022-03-11 掌阅科技股份有限公司 Voice broadcasting method, computing device and computer storage medium
CN113900618B (en) * 2021-05-07 2023-12-19 浙江口碑网络技术有限公司 Information playing method and device, electronic equipment and storage medium
CN112989243A (en) * 2021-05-07 2021-06-18 浙江口碑网络技术有限公司 Information playing method, information to be played obtaining method, device and electronic equipment
CN113034249A (en) * 2021-05-28 2021-06-25 浙江口碑网络技术有限公司 Information playing method and device and electronic equipment
CN113190697A (en) * 2021-06-02 2021-07-30 口碑(上海)信息技术有限公司 Image information playing method and device
CN113489833B (en) * 2021-06-29 2022-11-04 维沃移动通信有限公司 Information broadcasting method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140040742A1 (en) * 2012-08-03 2014-02-06 Lg Electronics Inc. Mobile terminal and controlling method thereof
CN104461346A (en) * 2014-10-20 2015-03-25 天闻数媒科技(北京)有限公司 Method and device for visually impaired people to touch screen and intelligent touch screen mobile terminal
CN108874356A (en) * 2018-05-31 2018-11-23 珠海格力电器股份有限公司 voice broadcast method, device, mobile terminal and storage medium
CN110618783A (en) * 2019-09-12 2019-12-27 北京小米移动软件有限公司 Text broadcasting method, device and medium
CN112486451A (en) * 2020-11-27 2021-03-12 掌阅科技股份有限公司 Voice broadcasting method, computing device and computer storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9405847B2 (en) * 2008-06-06 2016-08-02 Apple Inc. Contextual grouping of a page
KR101709510B1 (en) * 2011-06-03 2017-02-24 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN103853355A (en) * 2014-03-17 2014-06-11 吕玉柱 Operation method for electronic equipment and control device thereof
CN107644647B (en) * 2016-07-21 2020-10-30 平安科技(深圳)有限公司 Voice return visit method and device
CN107273342A (en) * 2016-11-25 2017-10-20 深圳市联谛信息无障碍有限责任公司 A kind of method that HTML content is recognized in ancillary technique
CN109893852B (en) * 2019-02-26 2022-07-26 北京心智互动科技有限公司 Interface information processing method and device
CN110264316A (en) * 2019-06-20 2019-09-20 浙江口碑网络技术有限公司 Item Information inquires methods of exhibiting and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140040742A1 (en) * 2012-08-03 2014-02-06 Lg Electronics Inc. Mobile terminal and controlling method thereof
CN104461346A (en) * 2014-10-20 2015-03-25 天闻数媒科技(北京)有限公司 Method and device for visually impaired people to touch screen and intelligent touch screen mobile terminal
CN108874356A (en) * 2018-05-31 2018-11-23 珠海格力电器股份有限公司 voice broadcast method, device, mobile terminal and storage medium
CN110618783A (en) * 2019-09-12 2019-12-27 北京小米移动软件有限公司 Text broadcasting method, device and medium
CN112486451A (en) * 2020-11-27 2021-03-12 掌阅科技股份有限公司 Voice broadcasting method, computing device and computer storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117762942A (en) * 2023-12-26 2024-03-26 深圳航天信息有限公司 Form design and storage method, system and readable storage medium

Also Published As

Publication number Publication date
CN112486451B (en) 2022-03-11
CN112486451A (en) 2021-03-12

Similar Documents

Publication Publication Date Title
WO2022111047A1 (en) Voice broadcasting method, computing device and computer storage medium
CN105867925B (en) Shortcut establishing method and electronic equipment
CN107438814B (en) Mobile device and method thereof, and method of mobile device emulator
US20200311342A1 (en) Populating values in a spreadsheet using semantic cues
US10122839B1 (en) Techniques for enhancing content on a mobile device
WO2020221162A1 (en) Application program recommendation method and apparatus, electronic device, and medium
US20200073903A1 (en) Method and device of tagging links included in a screenshot of webpage
US20140082498A1 (en) Method and mobile terminal device for independently playing a video
RU2595524C2 (en) Device and method for processing content of web resource in browser
US9282178B2 (en) Method for providing call log and electronic device thereof
CN107450808B (en) Mouse pointer positioning method of browser and computing device
CN112711372B (en) Page response method in visual impairment mode, computing device and computer storage medium
CN107391017B (en) Word processing method, device, mobile terminal and storage medium
JP6250151B2 (en) Independent hit test for touchpad operation and double tap zooming
CN110806822B (en) Electronic book interaction method, computing device and computer storage medium
WO2018010316A1 (en) Desktop page management method and device
CN109656444B (en) List positioning method, device, equipment and storage medium
WO2016173307A1 (en) Message copying method and device, and smart terminal
US20140013160A1 (en) Independent Hit Testing
WO2017128544A1 (en) Notification prompting method and apparatus
WO2017166640A1 (en) Application calling method and terminal
CN110874176B (en) Interaction method, storage medium, operating system and device
US20140075326A1 (en) Method and apparatus for uploading a file
WO2015035899A1 (en) Search methods and terminals
WO2022089078A1 (en) Method for presenting interface information, and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21896549

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21896549

Country of ref document: EP

Kind code of ref document: A1