WO2018176843A1

WO2018176843A1 - Method and apparatus for searching for focus across boundary, intelligent device and readable storage medium

Info

Publication number: WO2018176843A1
Application number: PCT/CN2017/110501
Authority: WO
Inventors: 尹成; 张文明; 陈少杰
Original assignee: 武汉斗鱼网络科技有限公司
Priority date: 2017-03-30
Filing date: 2017-11-10
Publication date: 2018-10-04
Also published as: CN106998489B; CN106998489A

Abstract

Provided are a method and apparatus for searching for a focus across a boundary, an intelligent device and a readable storage medium. The method comprises the following specific steps: after a focus search trigger instruction is received, adding all the view controls included in a current user interface to a search box, meshing the search box according to the pixel density corresponding to the user interface, then labelling cell search boxes comprised in the meshed search box according to category so as to obtain a boundary empty cell search box and a critical non-empty cell search box by means of partitioning, and finally carrying out a boundary search based on a result after the partitioning to determine a search boundary of a focus across the boundary. Compared with existing no-boundary cross-boundary search mechanisms, the method and the apparatus can effectively prevent the problem of focus loss and improve the search efficiency and accuracy.

Description

Focus out-of-bounds search method, device, smart device and readable storage medium

The present application claims the priority of the Chinese Patent Application No. CN201710200925.4 entitled "A Focus Over-Bound Search Method and Apparatus" filed on March 30, 2017, the entire contents of which is hereby incorporated by reference. in.

Technical field

The present invention relates to the field of focus processing technologies, and in particular, to a focus out-of-bounds search method, apparatus, smart device, and readable storage medium.

Background technique

Unlike the touch interaction mode of smart devices such as mobile phones and tablets, the interactive mode of the Android TV or the Android box needs to rely on a remote control device such as a remote controller or a mobile phone. Taking the interactive mode of the Android TV as an example, after the user presses the remote control button, the television device analyzes the signal source as the button event instruction set after receiving the remote controller button signal; then, the system performs a focus search operation according to the button event instruction set; Finally, the view control that gets the focus makes a response to the updated view.

However, in the focus search process, there are often situations in which it is necessary to deal with out-of-focus search. The search space of the cross-border search is multi-dimensional, and the search boundary of the focus is difficult to determine. Not only the search takes a long time, but also the success rate is low, and the search result with the focus loss is easy to occur, and the user experience is poor.

Summary of the invention

In view of the above, it is an object of the present invention to provide a focus out-of-bounds search method, apparatus, smart device, and readable storage medium to improve the above problems.

A preferred embodiment of the present invention provides a focus out-of-bounds search method, the method comprising:

Receiving a focus search trigger instruction;

Adding all the view controls included in the current user interface into the search box, the size of the search box being calculated by the positional relationship of each view control located in the visible range of the user interface with respect to the direct parent control;

Dividing the search box according to a pixel density corresponding to the user interface;

Sorting the unit search boxes included in the search box after the meshing to classify the boundary empty unit search box and the critical non-empty unit search box;

Based on the above-described divided results, a boundary search is performed to determine a search boundary of the out-of-bounds focus.

Another preferred embodiment of the present invention provides a focus out-of-bounds search device, the device comprising:

An instruction receiving module, configured to receive a focus search trigger instruction;

a search box building module, configured to add all the view controls included in the current user interface into the search box, the size of the search box is calculated by the positional relationship of each view control located in the visible range of the user interface relative to the direct parent control ;

a meshing module, configured to mesh the search box according to a pixel density corresponding to the user interface;

a search box division module, configured to classify and mark the unit search box included in the search box after the mesh division to divide the boundary empty unit search box and the critical non-empty unit search box;

And a boundary determining module, configured to perform a boundary search based on the segmented result, and determine a search boundary of the out-of-bounds focus.

Another preferred embodiment of the present invention further provides a smart device, including a processor and a non-volatile memory storing a plurality of computer instructions, wherein the smart device performs the above implementation when the computer instructions are executed by the processor The focus out of bounds search method described in the example.

Other preferred embodiments of the present invention further provide a readable storage medium, the readable storage medium comprising a computer program, the computer program controlling the electronic device where the readable storage medium is located to perform the operations described in the above embodiments Focus out of bounds search method.

The focus out-of-bounds search method, apparatus, smart device, and readable storage medium provided by the preferred embodiment of the present invention, after receiving the focus search trigger instruction, add all view controls included in the current user interface to the search box, and according to the The search box is meshed by the pixel density corresponding to the user interface, and then the unit search box included in the search box after the mesh division is classified to mark the boundary empty unit search box and the critical non-empty unit search box. Finally, based on the above-mentioned divided results, a boundary search is performed to determine a search boundary of the out-of-bounds focus. The embodiment of the present invention applies the improved search box algorithm to perform out-of-bounds search of the focus, and can effectively avoid the problem of losing focus compared with the existing borderless search mechanism. Moreover, the borderless search function of the borderless search mechanism traverses the entire view tree corresponding to the user interface, the search direction is disordered, and the search efficiency is low. The search method provided in this embodiment can be used to determine the search boundary. Search, search efficiency and accuracy have improved significantly.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly described below. It should be understood that the following drawings show only certain embodiments of the present invention, and therefore It should be seen as a limitation on the scope, and those skilled in the art can obtain other related drawings according to these drawings without any creative work.

FIG. 1 is a schematic block diagram of a smart device for performing a focus out-of-bounds search method according to an embodiment of the present invention;

2 is a flowchart of a method for searching for a focus out of bounds according to an embodiment of the present invention;

FIG. 3 is a schematic diagram of a positional relationship between a view control and a direct parent control thereof according to an embodiment of the present invention;

4 is a schematic diagram of a search box after mesh division in an embodiment according to an embodiment of the present invention;

FIG. 5 is a diagram of a result obtained after performing a boundary search based on the search box shown in FIG. 4 according to an embodiment of the present invention;

FIG. 6 is a flowchart of another focus out-of-bounds search method according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of functional modules of a focus out-of-bounds search device according to an embodiment of the present invention.

Icon: 100-smart device; 110-memory; 120-processor; 130-focal out-of-bounds search device; 1302-instruction Receive module; 1304-search box construction module; 1306-mesh division module; 1308-search box division module; 1310-judgment module; 1312-size adjustment module; 1314-boundary determination module.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. The components of the embodiments of the invention, which are generally described and illustrated in the figures herein, may be arranged and designed in various different configurations. It should be noted that similar reference numerals and letters indicate similar items in the following figures, and therefore, once an item is defined in a drawing, it is not necessary to further define and explain it in the subsequent drawings.

Therefore, the following detailed description of the embodiments of the invention in the claims All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Please refer to FIG. 1 , which is a block diagram of a smart device 100 for performing a focus out-of-bounds search method according to an embodiment of the present invention. The smart device 100 can be, but is not limited to, an Android TV or an Android set top box equipped with an Android operating system. As shown in FIG. 1, the smart device 100 includes a memory 110, a processor 120, and a focus out-of-bounds search device 130.

The memory 110 is electrically connected to the processor 120 to implement transmission or interaction of data. The out of focus search device 130 includes at least one software function module that may be stored in the memory 110 or in an operating system of the smart device 100 in the form of software or firmware. The processor 120 is configured to execute executable modules stored in the memory 110, such as a computer program included by the focus out-of-bounds search device 130. The processor 120 executes the program after receiving the execution instruction, and the method executed by the smart device 100 defined by the flow process disclosed in any embodiment of the present invention may be applied to the processor 120 or by the processor. 120 implementation.

Referring to FIG. 2, it is a flowchart of a method for searching for a focus out of bounds according to an embodiment of the present invention. It should be noted that the method provided in this embodiment is not limited to the specific order described in FIG. 2 and the following. The steps shown in Fig. 2 will be explained in detail below.

Step S101, receiving a focus search trigger instruction.

In this embodiment, taking the Android TV as an example, the focus may refer to an Android TV that, after receiving a button signal of a remote control device such as a remote controller or a mobile phone, processes a corresponding command to perform a display effect on the user interface level, such as zooming and biasing. Shift, background switching, etc. The focus search may refer to the Android system relocating the focus according to the above instruction, to specify a specific view control (View control) to accept the focus, or the system to perform focus relocation according to the default algorithm.

In this embodiment, the focus search trigger instruction may be an instruction or a set of instructions obtained by the smart device 100 parsing the received control signal. The control signal may be sent by a remote control device such as a remote controller or a mobile phone after being operated by a user. The remote control signal.

As an implementation manner, after the user presses the operation button of the remote controller, the Android TV or the Android set top box receives the button signal of the remote controller and parses the button signal as a button event instruction set, so that the system performs the button event instruction set according to the button event instruction set. Focus search operation. It can be understood that, in general, the foregoing operation of parsing the button signal may be performed by a processor executing a corresponding application in an Android architecture layer (Framework layer); subsequent focus search operations may be performed by the processor to execute an Android application layer ( The corresponding application in the Application layer) is completed.

Step S103, adding all view controls included in the current user interface to the search box, the size of the search box is calculated by the coordinate position of each view control located in the visible range of the user interface and its positional relationship with respect to the direct parent control. get.

In this embodiment, the direct parent control of the view control (View control) is a ViewGroup control directly containing the View control.

As an implementation manner, since the number of view controls under the view tree corresponding to the current user interface is not determined, especially the number of view controls included in the out-of-bounds area outside the visible range, the number of view controls may be selected. Each view control is dynamically added to the search box during the Layout phase of the view control. For example, the traversal view tree is traversed according to a preset traversal method (such as preorder, middle or post traversal, etc.), and when traversing to the view control, it is added to the search box, so that the view control is dynamically added to the search box. process.

In this embodiment, the size of the search box is calculated from the coordinate position of the view control in the visible range and its positional relationship with respect to the direct parent control. Since the number of view controls under the view tree is not certain, it is necessary to continuously calculate and update the size of the search box during the process of dynamically adding the view controls to the search box. For example, in an embodiment, the initial size of the search box may be calculated from the currently known coordinate positions of one or more view controls located within the visible range and their positional relationships with respect to respective direct parent controls; Then, the other view controls in the view tree are gradually added to the search box, and during the joining process, it is judged whether the view control is in the visible range, and if it is in the visible range, it is re-based according to the currently known visible range. The coordinate positions of all view controls within them and their positional relationship with respect to their respective direct parent controls calculate the size of the search box and update until all view controls under the view tree have been added to the search box.

As an implementation manner, a specific manner of calculating the size of the search box according to the coordinate position of each view control currently in the search box and located within the visible range of the user interface and its positional relationship with respect to the direct parent control Can be:

First, according to

Calculate the average center point distance of each view control. Where n is the total number of the respective view controls, w is the width value of the view control, h is the height value of the view control, and l is the left margin of the view control from the immediate parent control, r is The view control is from the right margin of its immediate parent control. For the explanation of the above parameters w, h, l and r, please refer to the schematic view of a view control and its direct parent control in the visible range provided in FIG.

Then, according to the calculation formula:

The size of the search box is calculated. Where d _aver represents the diameter of the search box.

It should be noted here that the size of the search box calculated according to the above manner may be the rough size of the search box in actual operation. For example, the calculated size of the diameter is not an integer. For example, when the decimal point includes a multi-digit decimal value, the actual operation may perform rounding processing or approximation processing.

It will be appreciated that in other embodiments, it is not excluded that the size of the search box can be roughly estimated in other ways. For example, as an embodiment, the size of the root node ViewGroup control in the view tree can be directly estimated as the size of the search box.

However, the preferred embodiment in this embodiment still uses the average center point distance of each view control within the visible range to calculate the size of the search box. The reason is that directly estimating the size of the above ViewGroup control as the size of the search box usually causes the search box to be too large or too small, which is generally not conducive to the determination of subsequent search boundaries.

In addition, in this embodiment, in the process of adding the view control to the search box, in order to avoid the situation that the same view control is repeatedly added, the set set may be used to store the view control information. The Set collection is one of the Java collection frameworks, and the elements stored therein have unique attributes, that is, the Set collection does not repeatedly store the same element.

Step S105, meshing the search box according to a pixel density corresponding to the user interface.

It can be understood that the meshing of the search box is to divide the search box constructed by the view tree by using a grid unit having a certain side length. In this embodiment, the meshing may be performed from the inside to the outside direction. For example, the meshing may be performed by using an existing paving method.

In particular, in the present embodiment, a design for determining the side length of a mesh unit by pixel density (Pixels Per Inch, PPI) is proposed. As an implementation manner, according to the calculation formula:

Determine the side length of the grid cell. Where S represents the minimum value of the font in the text view specified by the system, and P represents the pixel density of the interface displayed by the smart device 100. For example, a smart device 100 equipped with an Android operating system having a resolution of 1080×1920 and a pixel density of 320 is taken as an example. The Android system specifies that the minimum value of the font TextView is 12 sp, and the area of the single font TextView is 24 px. 48px is the minimum unit size of the view control that can be focused on the smart device 100, and the focus direction of each subview in the ViewGroup has 4 directions, thereby determining that the side length of the grid unit is 96px.

As shown in FIG. 4, it is a schematic diagram of the search box after meshing in a certain embodiment provided by this embodiment. The black marker points of the scattered distribution in the figure represent the discrete points of the view control (View) added to the search box. A peripheral circle containing the discrete points represents the search box. Each square represents a grid cell.

Step S107, classifying the unit search boxes included in the meshed search box to classify the boundary empty unit search box and the critical non-empty unit search box.

In this embodiment, the cell search box included in the meshed search box is critically marked. If the cell search box near the boundary is empty and there is no cell search box or cell search box in the direction that is still empty, mark the cell search box as Boundary Cell Search Box (SCSB). That is, the boundary has been reached. The non-empty unit search box adjacent to the boundary empty cell search box is labeled as Critical Nonempty Cell Search Box (CNCSB).

Step S109, performing a boundary search based on the divided result to determine a search boundary of the out-of-bounds focus.

In this embodiment, when performing the boundary search, it is first necessary to select a starting point of the search. Generally, any one of the search boxes in the search box can be selected as the starting point. Then, the boundary empty cell search box is searched starting along the top direction of the starting point. If the boundary empty cell search box is searched, the search in the current direction is stopped, and the search direction is adjusted clockwise to continue searching for the next boundary empty cell search box. After the 360-degree search is completed clockwise, the center points of all the boundary empty cell search boxes are connected to form an irregular polygon, which is the search boundary.

As shown in FIG. 5, it is a result graph obtained by performing a boundary search based on the search box shown in FIG. 4 provided by this embodiment. The cell search box filled with dark gray in the figure indicates that it is a boundary empty cell search box, and the cell search box filled with light gray indicates that it is a critical non-empty cell search box. An irregular polygon surrounded by black lines is the resulting search boundary. Wherein, "o" on the polygon indicates the starting point selected during the search, and the arrow indicates that the search is sequentially performed in the clockwise direction.

After determining the boundary of the out-of-focus search, the multi-dimensional space search of the cross-border search can be converted into a one-dimensional search, which can improve the search efficiency, search accuracy, and effectively avoid the phenomenon of losing focus.

Please refer to FIG. 6 , which is a flowchart of another method for out-of-focus search according to an embodiment of the present invention. As shown in FIG. 6, the focus out-of-bounds search method includes:

Step S201, receiving a focus search trigger instruction.

Step S203, adding all the view controls included in the current user interface to the search box, the size of the search box is calculated by the coordinate position of each view control located in the visible range of the user interface and its positional relationship with respect to the direct parent control. get.

Step S205, meshing the search box according to a pixel density corresponding to the user interface.

Step S207, classifying the unit search boxes included in the meshed search box to classify the boundary empty unit search box and the critical non-empty unit search box.

For detailed descriptions and implementations of the steps S201 to S207 in the method, reference may be made to the corresponding steps S101 to S107, and details are not described herein again.

Step S209, determining whether there is a coordinate position located in the boundary empty unit search box and the critical non-empty unit search A view control at the adjacent boundary of the cable box.

In this embodiment, after the search box is divided into multiple unit search boxes by the grid, the coordinate positions of the individual View discrete points often appear in the adjacent boundary of the boundary empty unit search box and the critical non-empty unit search box. At this time, if no processing is done, the View discrete point has the possibility of being classified into the boundary empty cell search box.

If there is a View discrete point located at the boundary between the boundary empty cell search box and the critical non-empty cell search box, the following step S211 is performed. Otherwise, go to step S213.

In step S211, the size of the grid unit is reduced by a preset scale, and the process goes to step S205 to re-mesh the search box according to the reduced grid unit.

In this embodiment, as an embodiment, the reduction ratio may be based on 12px.

Step S213, performing a boundary search based on the divided result to determine a search boundary of the out-of-bounds focus.

FIG. 7 is a schematic diagram of functional blocks of a focus crossing search device 130 according to an embodiment of the present invention. The apparatus includes an instruction receiving module 1302, a search box building module 1304, a meshing module 1306, a search box dividing module 1308, a determining module 1310, a resizing module 1312, and a boundary determining module 1314.

The instruction receiving module 1302 is configured to receive a focus search trigger instruction. In this embodiment, the instruction receiving module 1302 can be used to perform step S101 described in FIG. 2 and step S201 described in FIG. 6. For a detailed description of the instruction receiving module 1302, reference may be made to the description of steps S101 and S201 above.

The search box building module 1304 is configured to add all the view controls included in the current user interface into the search box, the size of the search box is determined by the coordinate position of each view control located within the visible range of the user interface and relative to The positional relationship of the direct parent control is calculated. In this embodiment, the search box construction module 1304 can be used to perform step S103 shown in FIG. 2 and step S203 shown in FIG. 6. For a detailed description of the search box construction module 1304, reference may be made to the description of steps S103 and S203 above.

The meshing module 1306 is configured to perform meshing on the search box according to a pixel density corresponding to the user interface, and further, after the size adjustment module 1312 reduces the size of the grid unit by a preset ratio, The search box is re-divided according to the reduced grid unit. In this embodiment, the mesh dividing module 1306 can be used to perform step S105 shown in FIG. 2 and step S205 shown in FIG. 6. For a detailed description of the meshing module 1306, reference may be made to the description of steps S105 and S205 above.

The search box dividing module 1308 is configured to classify the unit search boxes included in the meshed search box to divide the boundary empty unit search box and the critical non-empty unit search box. In this embodiment, the search box division module 1308 can be used to perform step S107 shown in FIG. 2 and step S207 shown in FIG. 6. For a detailed description of the search box partitioning module 1308, reference may be made to the description of steps S107 and S207 above.

The determining module 1310 is configured to determine whether a view control exists, and the coordinate position of the view control is located at an adjacent boundary of the boundary empty cell search box and the critical non-empty cell search box. The determining module 1310 can be used to perform the process shown in FIG. Step S209. For a detailed description of the judging module 1310, reference may be made to the description of step S209 above.

The size adjustment module 1312 is configured to reduce the size of the grid unit by a preset ratio if the coordinate position of the view control is located at an adjacent boundary of the boundary empty unit search box and the critical non-empty unit search box. The resizing module 1312 can be used to perform step S211 shown in FIG. For a detailed description of the judging module 1310, reference may be made to the description of step S211 above.

The boundary determining module 1314 is configured to perform a boundary search based on the segmented result to determine a search boundary of the out-of-bounds focus. In this embodiment, the boundary determining module 1314 can be used to perform step S109 shown in FIG. 2 and step S213 shown in FIG. 6. For a detailed description of the search box partitioning module 1308, reference may be made to the description of steps S109 and S213 above.

For the specific operation method of each function module in this embodiment, reference may be made to the description of the corresponding steps in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may also be implemented in other manners. The apparatus embodiments described above are merely illustrative, for example, the flowcharts and block diagrams in the figures illustrate the architecture, functionality, and functionality of possible implementations of apparatus, methods, and computer program products according to various embodiments of the invention. operating. In this regard, each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may also occur in a different order than those illustrated in the drawings. For example, two consecutive blocks may be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or function. Or it can be implemented by a combination of dedicated hardware and computer instructions.

In addition, each functional module in each embodiment of the present invention may be integrated to form a separate part, or each module may exist separately, or two or more modules may be integrated to form a separate part.

The functions, if implemented in the form of software functional modules and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read only memory, a random access memory, a magnetic disk, or an optical disk. It is to be understood that the terms "comprises" or "comprising" or "comprising" or "comprising" or "the" Other elements that are explicitly listed, or are included for this process, method, The elements inherent in the item or device.

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the appended claims.

Industrial applicability

Compared with the existing borderless cross-border search mechanism, the focus out-of-bounds search method, device, smart device and readable storage medium can effectively improve search efficiency and search accuracy, and better avoid the problem of losing focus. . In addition, the method and apparatus provided by the embodiment can satisfy most complex focus processing business scenarios, and the system-based borderless-based cross-border search mechanism cannot meet the growing demand scene of smart devices such as Android TVs and Android set-top boxes.

Claims

A focus out-of-bounds search method, characterized in that the method comprises:

Receiving a focus search trigger instruction;

Adding all the view controls included in the current user interface into the search box, the size of the search box is calculated by the coordinate position of each view control located within the visible range of the user interface and its positional relationship with respect to the direct parent control;

Dividing the search box according to a pixel density corresponding to the user interface;

Sorting the unit search boxes included in the search box after the meshing to classify the boundary empty unit search box and the critical non-empty unit search box;

Based on the above-described divided results, a boundary search is performed to determine a search boundary of the out-of-bounds focus.
The method according to claim 1, wherein all the view controls included in the current user interface are added to the search box, and the size of the search box is determined by the coordinates of each view control located within the visible range of the user interface. The steps calculated by the location and its positional relationship relative to the immediate parent control, including:

Adding a view control included in the user interface dynamically into the search box, the manner of dynamically joining the search box includes dynamically adding the search box in a layout phase of the view control;

When a new view control is added to the search box, the coordinate position of each view control currently in the search box and located within the visible range of the user interface and its positional relationship with respect to the direct parent control are calculated and The size of the search box is updated until all view controls contained in the user interface are added to the search box.
The method according to claim 2, wherein said calculating a coordinate position of each view control currently in the search box and located within a visible range of said user interface and its positional relationship with respect to a direct parent control And updating the size of the search box, including:

According to the calculation formula:
Calculating an average center point distance of each view control, where n is the total number of the view controls, w is a width value of the view control, h is a height value of the view control, and l is the view The control is from the left margin of its immediate parent control, and r is the right margin of the view control from its immediate parent control;

According to the calculation formula:
The size of the search box is calculated, where d aver represents the diameter of the search box.
The method according to any one of claims 1 to 3, wherein the step of meshing the search box according to a pixel density corresponding to the user interface comprises:

According to the calculation formula:
Determining the side length of the grid unit, where S represents the minimum value of the font in the text view specified by the system, and P represents the pixel density;

The search box is meshed by a square grid unit having the above-described side lengths.
The method according to any one of claims 1 to 3, wherein before the step of performing a boundary search based on the segmented result and determining a search boundary of the out-of-bounds focus, the method further comprises:

Determining whether there is a view control whose coordinate position is located at an adjacent boundary of the boundary empty cell search box and the critical non-empty cell search box;

If yes, the size of the grid unit is reduced by a preset ratio, and the search box is re-divided according to the reduced grid unit.
The method according to any one of claims 1 to 3, wherein the unit search box included in the meshed search box is classified and marked to define a boundary empty unit search box and a critical non- The steps of the empty unit search box include:

If the unit search box near the boundary is empty and there is no other cell search box or the unit search box in the direction is still empty, the unit search box is marked as a boundary empty unit search box;

A non-empty cell search box adjacent to the boundary empty cell search box is marked as a critical non-empty cell search box.
The method according to any one of claims 1 to 3, wherein the step of performing a boundary search based on the segmented result and determining a search boundary of the out-of-bounds focus comprises:

Select the starting point of the search;

Searching for the boundary empty cell search box along the upper direction of the starting point;

If the boundary empty cell search box is searched, the search in the current direction is stopped, and the search direction is adjusted clockwise to continue searching for the next boundary empty cell search box;

After the 360-degree search is completed clockwise, the center points of all boundary empty cell search boxes are connected to form an irregular polygon, which is the search boundary.
A focus out-of-bounds search device, characterized in that the device comprises:

An instruction receiving module configured to receive a focus search trigger instruction;

a search box building module configured to add all view controls included in the current user interface to a search box, the size of the search box being determined by coordinate positions of respective view controls located within a viewable range of the user interface and relative to the direct parent control The positional relationship is calculated;

a meshing module configured to mesh the search box according to a pixel density corresponding to the user interface;

a search box division module configured to classify and mark the unit search box included in the search box after the mesh division to divide the boundary empty unit search box and the critical non-empty unit search box;

a boundary determination module configured to perform a boundary search based on the segmented result and determine a search for an out-of-bounds focus Cable boundary.
The apparatus of claim 8, wherein the search box construction module is further configured to:

Adding a view control included in the user interface dynamically into the search box, the manner of dynamically joining the search box includes dynamically adding the search box in a layout phase of the view control;

When a new view control is added to the search box, the coordinate position of each view control currently in the search box and located within the visible range of the user interface and its positional relationship with respect to the direct parent control are calculated and The size of the search box is updated until all view controls contained in the user interface are added to the search box.
The apparatus of claim 8, wherein the search box construction module is further configured to:

According to the calculation formula:
Calculating an average center point distance of each view control, where n is the total number of the view controls, w is a width value of the view control, h is a height value of the view control, and l is the view The control is from the left margin of its immediate parent control, and r is the right margin of the view control from its immediate parent control;

According to the calculation formula:
The size of the search box is calculated, where d aver represents the diameter of the search box.
The apparatus according to any one of claims 8 to 10, wherein the mesh dividing module is further configured to:

According to the calculation formula:
Determining the side length of the grid unit, where S represents the minimum value of the font in the text view specified by the system, and P represents the pixel density;

The search box is meshed by a square grid unit having the above-described side lengths.
The device according to any one of claims 8 to 10, further comprising:

a determining module, configured to determine whether there is a view control whose coordinate position is located at an adjacent boundary of the boundary empty cell search box and the critical non-empty cell search box;

The size adjustment module is configured to reduce the size of the grid unit by a preset ratio if there is a view control where the coordinate position is located at an adjacent boundary of the boundary empty unit search box and the critical non-empty unit search box;

The meshing module is further configured to re-mesh the search box according to the reduced grid unit.
The apparatus according to any one of claims 8 to 10, wherein the search box division module is further configured to:

If the unit search box near the boundary is empty and there is no other cell search box or the unit search box in the direction is still empty, the unit search box is marked as a boundary empty unit search box;

A non-empty cell search box adjacent to the boundary empty cell search box is marked as a critical non-empty cell search box.
The apparatus of any of claims 8-10, wherein the boundary determination module is further configured to:

Select the starting point of the search;

Searching for the boundary empty cell search box along the upper direction of the starting point;

If the boundary empty cell search box is searched, the search in the current direction is stopped, and the search direction is adjusted clockwise to continue searching for the next boundary empty cell search box;

After the 360-degree search is completed clockwise, the center points of all boundary empty cell search boxes are connected to form an irregular polygon, which is the search boundary.
A smart device comprising a processor and a non-volatile memory storing a plurality of computer instructions, wherein the smart device performs any one of claims 1-7 when the computer instructions are executed by the processor The focus out-of-bounds search method described in the item.
A readable storage medium, the readable storage medium comprising a computer program, characterized by:

The computer program controlling the electronic device in which the readable storage medium is located to perform the focus out-of-bounds search method according to any one of claims 1-7.