WO2017036208A1 - 显示界面中的信息提取方法及系统 - Google Patents

显示界面中的信息提取方法及系统 Download PDF

Info

Publication number
WO2017036208A1
WO2017036208A1 PCT/CN2016/084419 CN2016084419W WO2017036208A1 WO 2017036208 A1 WO2017036208 A1 WO 2017036208A1 CN 2016084419 W CN2016084419 W CN 2016084419W WO 2017036208 A1 WO2017036208 A1 WO 2017036208A1
Authority
WO
WIPO (PCT)
Prior art keywords
view
control
attribute
determining
subview
Prior art date
Application number
PCT/CN2016/084419
Other languages
English (en)
French (fr)
Inventor
莫子坤
Original Assignee
深圳Tcl数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl数字技术有限公司 filed Critical 深圳Tcl数字技术有限公司
Publication of WO2017036208A1 publication Critical patent/WO2017036208A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present invention relates to the field of multimedia technologies, and in particular, to a method and system for extracting information in a display interface.
  • the content displayed on the interface of the TV terminal is more and more diversified, and more and more control methods are adopted for the TV terminal, such as an external mouse keyboard, gesture control, mobile phone control or voice control, etc.
  • control methods such as an external mouse keyboard, gesture control, mobile phone control or voice control, etc.
  • the main object of the present invention is to provide an information extraction method and system, which aims to solve the technical problem that various control methods cannot implement control of third-party applications in the terminal, and the terminal control is not flexible enough.
  • the present invention provides an information extraction method in a display interface, and the information extraction method includes the following steps:
  • the function information corresponding to the control view is stored in association with the control view.
  • the step of sequentially determining whether each of the views has a sub-view includes:
  • the information extraction method further includes:
  • the attribute of the subview is an unclickable attribute, it is determined that the subview is a teletext view.
  • the present invention further provides an information extraction method in a display interface, where the information extraction method includes the following steps:
  • the step of determining the control view and the graphic view corresponding to the current display interface according to the attributes of each of the views includes:
  • the attribute of the view is a non-clickable attribute, it is determined that the view is a teletext view.
  • the step of sequentially determining whether each of the views has a sub-view includes:
  • the information extraction method further includes:
  • the attribute of the subview is an unclickable attribute, it is determined that the subview is a teletext view.
  • the function information corresponding to the control view is stored in association with the control view.
  • the present invention further provides an information extraction system in a display interface, where the information extraction system includes:
  • the obtaining module is configured to obtain each view in the root view of the current display interface
  • a determining module configured to sequentially determine whether each of the views has a subview
  • the determining module is further configured to determine an attribute of the view when there is no sub-view in the view;
  • the determining module is further configured to: when the attribute of the view is a clickable attribute, determine that the view is a control view;
  • the determining module is further configured to: when the attribute of the view is an unclickable attribute, determine that the view is a graphic view;
  • a storage module configured to store the control view to a corresponding control list, and store the graphic view into a corresponding text list, wherein the control view of the control list is clickable, and the text list is The graphic view is not clickable;
  • the storage module is further configured to store the function information corresponding to the control view in association with the control view.
  • the determining module is further configured to determine whether a sub-view is included in each of the views, or to determine whether a sub-view associated with a triggering operation of each of the views is pre-stored.
  • the determining module is further configured to determine an attribute of the sub-view when a view has a sub-view; and when the attribute of the sub-view is a clickable attribute, determine that the sub-view is a control view When the attribute of the subview is an unclickable attribute, it is determined that the subview is a teletext view.
  • the present invention further provides an information extraction system in a display interface, where the information extraction system includes:
  • the obtaining module is configured to obtain each view in the root view of the current display interface
  • a determining module configured to determine, according to attributes of each of the views, a control view and a graphic view corresponding to the current display interface
  • a storage module configured to store the control view to a corresponding control list, and store the graphic view into a corresponding text list, wherein the control view of the control list is clickable, and the text list is The graphic view is not clickable.
  • the determining module comprises:
  • a first determining unit configured to sequentially determine whether each of the views has a sub-view
  • a second determining unit configured to determine an attribute of the view when there is no sub view in the view
  • the second determining unit is further configured to: when the attribute of the view is a clickable attribute, determine that the view is a control view;
  • the second determining unit is further configured to: when the attribute of the view is an unclickable attribute, determine that the view is a graphic view.
  • the first determining unit is further configured to determine whether a sub-view is included in each of the views, or to determine whether a sub-view associated with a triggering operation of each of the views is pre-stored.
  • the determining module further includes:
  • a third determining unit configured to determine an attribute of the sub-view when a view has a sub-view
  • a fourth determining unit configured to determine that the subview is a control view when an attribute of the subview is a clickable attribute
  • the fourth determining unit is further configured to: when the attribute of the sub-view is an unclickable attribute, determine that the sub-view is a teletext view.
  • the storage module is further configured to store the function information corresponding to the control view in association with the control view.
  • the information extraction method and system in the display interface of the present invention first acquires each view in the root view of the current display interface, and then determines the control view and the graphic view corresponding to the current display interface according to the attributes of each of the views, and finally The control view is stored in the corresponding control list, and the graphic view is stored in the corresponding text list, and the control view and the graphic view corresponding to each view are obtained according to the attributes of the respective views in the display interface. Then, according to the obtained control view and the graphic view, an interface of the third-party application is generated, and various control systems can control the third-party application in the terminal, thereby improving the flexibility of controlling the terminal.
  • FIG. 1 is a schematic flowchart of a first embodiment of an information extraction method according to the present invention
  • FIG. 2 is a schematic flowchart of a preferred embodiment of a control view and a graphic view corresponding to a current display interface according to the attributes of the respective views;
  • FIG. 3 is a schematic flowchart of a third embodiment of an information extraction method according to the present invention.
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of an information extraction system according to the present invention.
  • FIG. 5 is a schematic diagram of a first refinement function module of the determining module in FIG. 4;
  • FIG. 6 is a schematic diagram of a second refinement function module of the determining module of FIG. 4.
  • the invention provides an information extraction method.
  • FIG. 1 is a schematic flowchart diagram of a first embodiment of an information extraction method according to the present invention.
  • This embodiment provides an information extraction method, where the information extraction method includes:
  • Step S10 Obtain each view in the root view of the current display interface.
  • the object of the current display interface is obtained first, because the layout of the object of the current display interface is arranged in a tree, which is equivalent to acquiring a root view (RootView) displayed by the current display interface, and then traversing the root view. And get the various views (View) in the root view.
  • RootView a root view displayed by the current display interface
  • Step S20 determining a control view and a graphic view corresponding to the current display interface according to the attributes of the respective views
  • the control view (ViewGroup) and the graphic view corresponding to the current display interface are determined according to the attributes of the respective views, and the graphic view further includes a text view (TextView) and a picture view.
  • the attribute is an attribute corresponding to each view.
  • the view is a control view
  • the attribute of the view is a non-clickable attribute
  • the view is a graphic view.
  • the step of setting an attribute to the view that is, marking the attribute of each view in advance, preferably using the clickable attribute and the non-clickable attribute Different identification information is marked, so that when the terminal obtains the view, it can be known according to the identification information that the view is a clickable attribute or a non-clickable attribute.
  • Step S30 storing the control view to a corresponding control list, and storing the graphic view into a corresponding text list, wherein the control view of the control list is clickable, and the text of the text list is Views are not clickable.
  • the attribute of the view is a clickable attribute, that is, when the view is a control view; first determining whether the control view is a web view, and if the control view is not a web view, according to the control
  • the view creates an actionable object control view (ControlView) and adds the control view to the control view set (ControlViewList).
  • ControlView actionable object control view
  • ControlViewList the control view set
  • the control view is used as a control sublist, the control view set That is, the corresponding control list, therefore, the control sublist is added to the control list.
  • controlView is used to record the newly created control sublist, indicating that the control view is currently traversed, and the control view is stored in the newly created control sublist, which can be understood.
  • the tag control view is equivalent to pointer information, indicating the list of widgets currently pointed to.
  • the function view corresponding to the control view is stored in association with the control view while the control view is stored in the corresponding control list.
  • the function information corresponding to the control view is stored in association with the control view, so that when the display terminal displays the control view, the function corresponding to the control view is simultaneously displayed, such as Save the save function of the control, copy the copy function of the control, and so on.
  • control view determines whether the control view is a web view (WebView), if the control view is a web view, creating a sub-control list, similarly adding the sub-control list to the control list, at this time, using the mark
  • the control view records the newly created child control list, analyzes the web page view process, acquires the graphic information of the web page view, and associates the graphic information of the web page view with the web page view, preferably the graphic
  • the information is stored in a preset text list, and the web page view is stored in the corresponding control list, and the association relationship between the text list and the control list is established, so that when the user invokes the web page view, the same is displayed.
  • the graphic information associated with the web page view is a web view (WebView)
  • the graphic view is added to the corresponding text list, that is, when the attribute of the graphic view is not clickable, Determining whether a text list is present, the text list is set in advance for storing a non-clickable graphic view, and if the text list exists, storing the graphic view into the text list, if If the text list does not exist, the text list is created and the text information is stored with the created text list.
  • the information extraction method in the display interface of the present embodiment first acquires each view in the root view of the current display interface, and then determines a control view and a graphic view corresponding to the current display interface according to the attributes of each of the views, and finally The control view is stored in the corresponding control list, and the graphic view is stored in the corresponding text list, and the control view and the graphic view corresponding to each view are obtained according to the attributes of the respective views in the display interface, and then According to the acquired control view and the graphic view, an interface of the third-party application is generated, and various control systems can control the third-party application in the terminal, thereby improving the flexibility of controlling the terminal.
  • the step S20 includes:
  • Step S21 sequentially determining whether each of the views has a subview
  • Step S22 determining an attribute of the view when there is no sub-view in the view
  • Step S23 when the attribute of the view is a clickable attribute, determining that the view is a control view;
  • Step S24 When the attribute of the view is an unclickable attribute, determine that the view is a teletext view.
  • each view when each view is obtained, it is first determined whether each view has a sub-view, and the sub-view includes one or more sub-views.
  • the attributes of the view are directly determined.
  • the attribute includes a clickable attribute and a non-clickable attribute.
  • the attribute of the view is a clickable attribute, determining that the view is a control view, and when the attribute of the view is a non-clickable attribute, determining the The view is a graphic view.
  • the manner of determining whether each of the views has a sub-view preferably includes: a, determining whether a sub-view is included in each of the views, for example, as follows: in the word document interface, the toolbar includes multiple control views, such as In the font control view, the font control view contains many subviews, such as a font bold subview, a font tilt subview, and the like. b. determining whether a sub-view associated with the triggering operation of each of the views is pre-stored, for example, as follows: in the word document interface, the menu bar includes multiple control views, such as starting the control view, and detecting based on the start menu bar When the interface input is clicked, the font subview, the paragraph subview and the style subview, and so on are displayed. It should be noted that the triggering operation may include a click operation and a touch operation input by the user based on the interface corresponding to the control view, and further may further include a voice instruction.
  • the information extraction method is further include:
  • Step S25 determining a property of the subview when a view has a subview
  • Step S26 when the attribute of the sub-view is a clickable attribute, determining that the sub-view is a control view
  • Step S27 When the attribute of the sub-view is an unclickable attribute, it is determined that the sub-view is a teletext view.
  • determining the attribute of the sub-view is determining whether the attribute of the sub-view is a clickable attribute or a non-clickable attribute, when the sub-view has When the attribute is a clickable attribute, it is determined that the child view is a control view, and when the attribute of the child view is an unclickable attribute, it is determined that the child view is a graphic view.
  • the sub-view includes not only a sub-view of one level, but also a sub-view of multiple levels, that is, in a display interface.
  • traversing the respective views corresponding to the root view in turn, determining whether each view includes a sub-view, and further determining whether the sub-view includes a second-level sub-view until the sub-view no longer exists at a lower level.
  • each view in the root view is obtained, and then the control view and the graphic view in the current display interface are determined according to the attributes.
  • the invention further provides an information extraction system.
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of an information extraction system according to the present invention.
  • the functional module diagram shown in FIG. 4 is merely an exemplary diagram of a preferred embodiment, and those skilled in the art can surround the functional modules of the information extraction system shown in FIG. It is easy to add a new function module; the name of each function module is a custom name, which is only used to assist in understanding the various program function blocks of the information extraction system, and is not used to define the technical solution of the present invention, and the core of the technical solution of the present invention is , the function to be achieved by the function module of each name.
  • the information extraction system proposed in this embodiment preferably runs in a controlled terminal such as a television or a computer.
  • This embodiment provides an information extraction system, where the information extraction system includes:
  • the obtaining module 10 is configured to obtain each view in a root view of the current display interface
  • the acquiring module 10 first acquires an object of the current display interface, and the layout of the object of the current display interface is arranged in a tree-like manner, which is equivalent to acquiring a root view (RootView) displayed by the current display interface, and then traversing.
  • the root view, and the obtaining module 10 acquires respective views in the root view.
  • a determining module 20 configured to determine, according to attributes of each of the views, a control view and a graphic view corresponding to the current display interface
  • the determining module 20 determines a control view (ViewGroup) and a graphic view corresponding to the current display interface according to the attributes of the respective views, and the graphic view further includes a text view (TextView) and a picture view, the attribute is an attribute corresponding to each view, and preferably, when the attribute of the view is a clickable attribute, the view is a control view, and correspondingly, when the attribute of the view is not When you click on an attribute, the view is a teletext view.
  • ViewGroup control view
  • graphic view further includes a text view (TextView) and a picture view
  • the attribute is an attribute corresponding to each view, and preferably, when the attribute of the view is a clickable attribute, the view is a control view, and correspondingly, when the attribute of the view is not When you click on an attribute, the view is a teletext view.
  • the determining module 20 determines whether the attribute corresponding to the view is a clickable attribute or a non-clickable attribute, and includes setting an attribute to the view, that is, marking the attribute of each view in advance, preferably the clickable attribute and the non-clickable attribute.
  • the information is marked with different identification information, so that when the obtaining module 10 obtains the view, it can be known according to the identification information that the view is a clickable attribute or a non-clickable attribute.
  • a storage module 30 configured to store the control view to a corresponding control list, and store the graphic view into a corresponding text list, wherein the control view of the control list is clickable, the text list The graphic view is not clickable.
  • the determining module 20 first determines whether the control view is a web view, and if the control view is not a web view Creating an actionable object control view (ControlView) according to the control view, the storage module 30 adding a control view to the control view set (ControlViewList), and distinguishing the control view and the control view as the control view
  • ControlViewList the control view set
  • the control sub-list which is the corresponding control list, therefore, the control sub-list is added to the control list.
  • controlView is used to record the newly created control sublist, indicating that the control view is currently traversed, and the control view is stored in the newly created control sublist, which can be understood.
  • the tag control view is equivalent to pointer information, indicating the list of widgets currently pointed to.
  • the storage module 30 stores the control view to the corresponding control list, and stores the function information corresponding to the control view in association with the control view. That is, when the control view is stored in the control list, the function information corresponding to the control view is stored in association with the control view, so that when the display terminal displays the control view, the function corresponding to the control view is simultaneously displayed, such as Save the save function of the control, copy the copy function of the control, and so on.
  • control view is a web view (WebView)
  • WebView web view
  • the control view records the newly created child control list and analyzes the web page view process
  • the obtaining module 10 acquires the graphic information of the web page view
  • the storage module 30 displays the graphic information of the web page view and the web page view.
  • the storage module 30 stores the graphic information to a preset text list, stores the web page view to a corresponding control list, and establishes an association relationship between the text list and the control list.
  • the graphic information associated with the web page view is simultaneously displayed.
  • the storage module 30 adds the graphic view to the corresponding text list, that is, when the graphic view is When the attribute is not clickable, it is first determined whether the text list exists, and the text list is set in advance for storing a non-clickable graphic view. If the text list exists, the storage module 30 will display the graphic The view is stored in the text list, and if the text list does not exist, the text list is created, and the graphic information is stored in the created text list.
  • the information extraction system in the display interface of the present embodiment first acquires the respective views in the root view of the current display interface, and then determines the control view and the graphic view corresponding to the current display interface according to the attributes of the respective views, and finally The control view is stored in the corresponding control list, and the graphic view is stored in the corresponding text list, and the control view and the graphic view corresponding to each view are obtained according to the attributes of the respective views in the display interface, and then According to the acquired control view and the graphic view, an interface of the third-party application is generated, and various control systems can control the third-party application in the terminal, thereby improving the flexibility of controlling the terminal.
  • the determining module 20 includes:
  • a first determining unit 21 configured to sequentially determine whether each of the views has a sub-view
  • a second determining unit 22 configured to determine an attribute of the view when there is no subview in the view
  • the second determining unit 22 is further configured to: when the attribute of the view is a clickable attribute, determine that the view is a control view;
  • the second determining unit 22 is further configured to: when the attribute of the view is an unclickable attribute, determine that the view is a teletext view.
  • the first determining unit 21 first determines whether there is a sub-view in each view, and the sub-view includes one or more sub-views, and the view does not exist.
  • the second determining unit 22 directly determines attributes of the view, preferably the attribute includes a clickable attribute and a non-clickable attribute, and when the attribute of the view is a clickable attribute, the second The determining unit 22 determines that the view is a control view, and when the attribute of the view is an unclickable attribute, the second determining unit 22 determines that the view is a teletext view.
  • the manner in which the first determining unit 21 determines whether each of the views has a sub-view preferably includes: a, determining whether a sub-view is included in each of the views, for example, as follows: in the word document interface, the toolbar includes multiple Control views, such as font control views, contain a number of subviews within the font control view, such as font bold subviews, font tilt subviews, and more. b.
  • the menu bar includes multiple control views, such as starting the control view, and detecting based on the start menu bar
  • the triggering operation may include a click operation and a touch operation input by the user based on the interface corresponding to the control view, and further may further include a voice instruction.
  • the determining module 20 further includes:
  • a third determining unit 23 configured to determine an attribute of the sub-view when a view has a sub-view
  • a fourth determining unit 24 configured to determine that the subview is a control view when an attribute of the subview is a clickable attribute
  • the fourth determining unit 24 is further configured to: when the attribute of the sub-view is an unclickable attribute, determine that the sub-view is a teletext view.
  • the third determining unit 23 determines the attribute of the sub-view, that is, whether the attribute of the sub-view is a clickable attribute or a non-clickable attribute.
  • the fourth determining unit 24 determines that the subview is a control view, and when the attribute of the subview is an unclickable attribute, the fourth The determining unit 24 determines that the subview is a teletext view.
  • the third determining unit 23 determines an attribute of the sub-view, and the sub-view includes not only a sub-view of one level but also a sub-view of multiple levels, That is, in the process of extracting information in the display interface, the respective views corresponding to the root view are sequentially traversed, the third determining unit 23 determines whether each view includes a sub-view, and the third determining unit 23 further determines the Whether the sub-view includes a second-level sub-view until the sub-view no longer has a sub-view of a lower level.
  • the obtaining module 10 acquires each view in the root view, and the determining module 20 further determines the attribute according to the attribute. Determine the control view and the teletext view in the current display interface.
  • the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better.
  • Implementation Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

Abstract

一种显示界面中的信息提取方法，获取当前显示界面的根视图中的各个视图(S10)；根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图(S20)；将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的(S30)。此外，还提供了一种显示界面中的信息提取系统。通过获取第三方应用界面中的控件信息，实现对终端中第三方应用的控制，提高了对终端控制的灵活性。

Description

显示界面中的信息提取方法及系统
技术领域
本发明涉及多媒体技术领域，尤其涉及一种显示界面中的信息提取方法及系统。
背景技术
随着互联网的快速发展，多媒体领域中的各项技术也随之发展。在智能电视领域中，电视终端界面上显示的内容越来越多样化，对电视终端进行控制方式也越来越多，如外接鼠标键盘、手势控制、手机控制或语音控制等等，上述方式在控制终端中的第三当应用时，往往需要获取到第三方应用界面中的控件信息，并根据控件信息对第三方应用进行控制，但现有的外接鼠标键盘、手势控制、手机控制或语音控制等系统无法获取第三方应用界面中的控件信息，导致无法实现对终端中第三方应用的控制，对终端控制不够灵活。
发明内容
本发明的主要目的在于提出一种信息提取方法及系统，旨在解决各种控制方式无法实现对终端中第三方应用的控制，对终端控制不够灵活的技术问题。
为实现上述目的，本发明提供的一种显示界面中的信息提取方法，所述信息提取方法包括以下步骤：
获取当前显示界面的根视图中的各个视图；
依次确定各个所述视图是否存在子视图；
在有视图不存在子视图时，确定所述视图的属性；
当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
当所述视图的属性为不可点击的属性时，确定所述视图是图文视图；
将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的；
所述将所述控件视图存储到对应的控件列表的同时执行以下步骤：
将所述控件视图对应的功能信息与所述控件视图关联存储。
优选地，所述依次确定各个所述视图是否存在子视图的步骤包括：
确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
优选地，所述依次确定各个所述视图是否存在子视图步骤之后，所述信息提取方法还包括：
在有视图存在子视图时，确定所述子视图的属性；
当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
此外，为实现上述目的，本发明还提出一种显示界面中的信息提取方法，所述信息提取方法包括以下步骤：
获取当前显示界面的根视图中的各个视图；
根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图；
将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的。
优选地，所述根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图的步骤包括：
依次确定各个所述视图是否存在子视图；
在有视图不存在子视图时，确定所述视图的属性；
当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
当所述视图的属性为不可点击的属性时，确定所述视图是图文视图。
优选地，所述依次确定各个所述视图是否存在子视图的步骤包括：
确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
优选地，所述依次确定各个所述视图是否存在子视图步骤之后，所述信息提取方法还包括：
在有视图存在子视图时，确定所述子视图的属性；
当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
优选地，所述将所述控件视图存储到对应的控件列表的同时执行以下步骤：
将所述控件视图对应的功能信息与所述控件视图关联存储。
此外，为实现上述目的，本发明还提出一种显示界面中的信息提取系统，所述信息提取系统包括：
获取模块，用于获取当前显示界面的根视图中的各个视图；
确定模块，用于依次确定各个所述视图是否存在子视图；
所述确定模块，还用于在有视图不存在子视图时，确定所述视图的属性；
所述确定模块，还用于当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
所述确定模块，还用于当所述视图的属性为不可点击的属性时，确定所述视图是图文视图；
存储模块，用于将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的；
所述存储模块，还用于将所述控件视图对应的功能信息与所述控件视图关联存储。
优选地，所述确定模块，还用于确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
优选地，所述确定模块，还用于在有视图存在子视图时，确定所述子视图的属性；当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
此外，为实现上述目的，本发明还提出一种显示界面中的信息提取系统，所述信息提取系统包括：
获取模块，用于获取当前显示界面的根视图中的各个视图；
确定模块，用于根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图；
存储模块，用于将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的。
优选地，所述确定模块包括：
第一确定单元，用于依次确定各个所述视图是否存在子视图；
第二确定单元，用于在有视图不存在子视图时，确定所述视图的属性；
所述第二确定单元，还用于当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
所述第二确定单元，还用于当所述视图的属性为不可点击的属性时，确定所述视图是图文视图。
优选地，所述第一确定单元还用于确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
优选地，所述确定模块还包括：
第三确定单元，用于在有视图存在子视图时，确定所述子视图的属性；
第四确定单元，用于当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
所述第四确定单元，还用于当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
优选地，所述存储模块还用于将所述控件视图对应的功能信息与所述控件视图关联存储。
本发明提出的显示界面中的信息提取方法及系统，先获取当前显示界面的根视图中的各个视图，然后根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图，最后将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，实现了根据显示界面中各个视图的属性，获取各个所述视图对应的控件视图和图文视图，然后根据获取的控件视图和图文视图，生成第三方应用的界面，实现各种控制系统可对终端中第三方应用的控制，提高了对终端控制的灵活性。
附图说明
图1为本发明信息提取方法第一实施例的流程示意图；
图2为本发明根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图较佳实施例的流程示意图；
图3为本发明信息提取方法第三实施例的流程示意图；
图4为本发明信息提取系统第一实施例的功能模块示意图；
图5为图4中确定模块的第一细化功能模块示意图；
图6为图4中确定模块的第二细化功能模块示意图。
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
本发明提供一种信息提取方法。
参照图1，图1为本发明信息提取方法第一实施例的流程示意图。
本实施例提出一种信息提取方法，所述信息提取方法包括：
步骤S10，获取当前显示界面的根视图中的各个视图；
在本实施例中，先获取当前显示界面的对象，由于当前显示界面的对象的布局呈树状性排布，相当于获取当前显示界面显示的根视图(RootView)，然后遍历所述根视图，并获取所述根视图中的各个视图（View）。
步骤S20，根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图；
在本实施例中，获取到各个视图后，根据各个所述视图的属性确定当前显示界面对应的控件视图（ViewGroup）和图文视图，图文视图进一步包括文本视图（TextView）和图片视图，所述属性是各个视图对应的属性，优选当所述视图的属性为可点击属性时，则所述视图是控件视图，相应的当所述视图的属性为不可点击属性时，所述视图是图文视图。
所述确定视图对应的属性是否为可点击属性或不可点击的属性之前，包括对视图设定属性的步骤，即事先对各个视图的属性进行标记，优选将可点击的属性与不可点击的属性用不同的标识信息标记出来，以便终端获取到所述视图时，根据所述标识信息即可得知视图是可点击属性或不可点击属性。
步骤S30，将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的。
在本实施例中，若视图的属性为可点击的属性，也就是当视图是控件视图时；先确定所述控件视图是否为网页视图，若所述控件视图不为网页视图，根据所述控件视图创建可操作对象控制视图（ControlView），并将控件视图添加到控制视图集合中（ControlViewList），为区分所述控件视图和控制视图，将所述控制视图作为控件子列表，所述控制视图集合也就是对应的控件列表，因此，也就是将控件子列表添加至控件列表中。此时，用标记控制视图（mcontrolView）记录最新创建的控件子列表，表示当前遍历到所述控件视图了，并将所述控件视图存储到所述最新创建的控件子列表中，可以理解，所述标记控制视图相当于指针信息，表示当前指向的控件子列表。进一步地，为提高信息提取的智能性，所述将所述控件视图存储到对应的控件列表的同时，将所述控件视图对应的功能信息与所述控件视图关联存储。也就是将控件视图存储到控件列表时，将所述控件视图对应的功能信息与所述控件视图关联存储，以供显示终端显示所述控件视图时，同时显示所述控件视图对应的功能，如保存控件的保存功能，复制控件的复制功能等等。
进一步地，确定所述控件视图是否为网页视图（WebView），若所述控件视图为网页视图，则创建子控件列表，同理将所述子控件列表添加到控件列表中，此时，用标记控制视图记录最新创建的子控件列表，并分析所述网页视图流程，获取所述网页视图的图文信息，并将网页视图的图文信息与所述网页视图关联存储，优选将所述图文信息存储至预设的文本列表，再将所述网页视图存储到对应的控件列表，并建立所述文本列表与所述控件列表的关联关系，以供用户调用所述网页视图时，同时显示所述网页视图关联的图文信息。
在本实施例中，若所述视图的属性为不可点击的属性，说明视图是图文视图，则将所述图文视图添加至对应的文本列表，即当图文视图的属性不可点击时，先确定文本列表是否存在，所述文本列表是事先设置好的，用于存储不可点击的图文视图，若存在所述文本列表，则将所述图文视图存储至所述文本列表中，若不存在所述文本列表，则建立所述文本列表，并用建立的文本列表存储所述图文信息。
本实施例提出的显示界面中的信息提取方法，先获取当前显示界面的根视图中的各个视图，然后根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图，最后将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，实现了根据显示界面中各个视图的属性，获取各个所述视图对应的控件视图和图文视图，然后根据获取的控件视图和图文视图，生成第三方应用的界面，实现各种控制系统可对终端中第三方应用的控制，提高了对终端控制的灵活性。
进一步地，为了提高信息提取的灵活性，基于第一实施例提出本发明信息提取方法第二实施例，在本实施例中，参照图2，所述步骤S20包括：
步骤S21，依次确定各个所述视图是否存在子视图；
步骤S22，在有视图不存在子视图时，确定所述视图的属性；
步骤S23，当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
步骤S24，当所述视图的属性为不可点击的属性时，确定所述视图是图文视图。
在本实施例中，获取到各个视图时，先确定各个视图是否存在子视图，所述子视图包括一级或多级子视图，在有视图不存在子视图时，直接确定所述视图的属性，优选所述属性包括可点击属性和不可点击属性，当所述视图的属性为可点击的属性时，确定所述视图是控件视图，当所述视图的属性为不可点击的属性时，确定所述视图是图文视图。进一步地，所述确定各个所述视图是否存在子视图的方式优选包括：a、确定各个所述视图内是否包含有子视图，举例如下：在word文档界面中工具栏包括多个控件视图，如字体控件视图，则所述字体控件视图内就包含许多子视图，如字体加粗子视图，字体倾斜子视图等等。b、确定是否预存有与各个所述视图的触发操作关联的子视图，举例如下，在word文档界面中菜单栏包括多个控件视图，如开始控件视图，则在检测基于所述开始菜单栏对应界面输入的点击操作时，则显示字体子视图，段落子视图和样式子视图等等。值得注意的是，所述触发操作可包括用户基于所述控件视图对应的界面输入的点击操作、触摸操作，进一步地还可包括语音指令。
进一步地，为了提高信息提取的灵活性，基于第二实施例提出本发明信息提取方法的第三实施例，在本实施例中，参照图3，所述步骤S21之后，所述信息提取方法还包括：
步骤S25，在有视图存在子视图时，确定所述子视图的属性；
步骤S26，当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
步骤S27，当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
在本实施例中，在有视图存在子视图时，确定所述子视图的属性也就是判断所述子视图的属性是为可点击的属性还是为不可点击的属性，当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图，当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
进一步地，所述在有视图存在子视图时，确定所述子视图的属性，所述子视图不仅包括一级的子视图，还可包括多级的子视图，也就是说，在显示界面中提取信息过程中，依次遍历所述根视图对应的各个视图，确定各个视图是否包含子视图，再进一步确定所述子视图是否包含二级子视图，直到所述子视图不再存在低一级的子视图为止，通过这个遍历过程，获取根视图中各个视图，再根据属性确定当前显示界面中的所述控件视图和图文视图。
本发明进一步提供一种信息提取系统。
参照图4，图4为本发明信息提取系统第一实施例的功能模块示意图。
需要强调的是，对本领域的技术人员来说，图4所示功能模块图仅仅是一个较佳实施例的示例图，本领域的技术人员围绕图4所示的信息提取系统的功能模块，可轻易进行新的功能模块的补充；各功能模块的名称是自定义名称，仅用于辅助理解该信息提取系统的各个程序功能块，不用于限定本发明的技术方案，本发明技术方案的核心是，各自定义名称的功能模块所要达成的功能。
本实施例提出的信息提取系统优选运行于被控终端（如电视或电脑）中。
本实施例提出一种信息提取系统，所述信息提取系统包括：
获取模块10，用于获取当前显示界面的根视图中的各个视图；
在本实施例中，所述获取模块10先获取当前显示界面的对象，由于当前显示界面的对象的布局呈树状性排布，相当于获取当前显示界面显示的根视图(RootView)，然后遍历所述根视图，并且所述获取模块10获取所述根视图中的各个视图（View）。
确定模块20，用于根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图；
在本实施例中，所述获取模块10获取到各个视图后，所述确定模块20根据各个所述视图的属性确定当前显示界面对应的控件视图（ViewGroup）和图文视图，图文视图进一步包括文本视图（TextView）和图片视图，所述属性是各个视图对应的属性，优选当所述视图的属性为可点击属性时，则所述视图是控件视图，相应的当所述视图的属性为不可点击属性时，所述视图是图文视图。
所述确定模块20确定视图对应的属性是否为可点击属性或不可点击的属性之前，包括对视图设定属性，即事先对各个视图的属性进行标记，优选将可点击的属性与不可点击的属性用不同的标识信息标记出来，以便所述获取模块10获取到所述视图时，根据所述标识信息即可得知视图是可点击属性或不可点击属性。
存储模块30，用于将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的。
在本实施例中，若视图的属性为可点击的属性，也就是当视图是控件视图时；所述确定模块20先确定所述控件视图是否为网页视图，若所述控件视图不为网页视图，根据所述控件视图创建可操作对象控制视图（ControlView），所述存储模块30将控件视图添加到控制视图集合中（ControlViewList），为区分所述控件视图和控制视图，将所述控制视图作为控件子列表，所述控制视图集合也就是对应的控件列表，因此，也就是将控件子列表添加至控件列表中。此时，用标记控制视图（mcontrolView）记录最新创建的控件子列表，表示当前遍历到所述控件视图了，并将所述控件视图存储到所述最新创建的控件子列表中，可以理解，所述标记控制视图相当于指针信息，表示当前指向的控件子列表。
进一步地，为提高信息提取的智能性，所述存储模块30将所述控件视图存储到对应的控件列表的同时，将所述控件视图对应的功能信息与所述控件视图关联存储。也就是将控件视图存储到控件列表时，将所述控件视图对应的功能信息与所述控件视图关联存储，以供显示终端显示所述控件视图时，同时显示所述控件视图对应的功能，如保存控件的保存功能，复制控件的复制功能等等。
进一步地，确定所述控件视图是否为网页视图（WebView），若所述控件视图为网页视图，则创建子控件列表，同理将所述子控件列表添加到控件列表中，此时，用标记控制视图记录最新创建的子控件列表，并分析所述网页视图流程，所述获取模块10获取所述网页视图的图文信息，所述存储模块30将网页视图的图文信息与所述网页视图关联存储，优选所述存储模块30将所述图文信息存储至预设的文本列表，再将所述网页视图存储到对应的控件列表，并建立所述文本列表与所述控件列表的关联关系，以供用户调用所述网页视图时，同时显示所述网页视图关联的图文信息。
在本实施例中，若所述视图的属性为不可点击的属性，说明视图是图文视图，则所述存储模块30将所述图文视图添加至对应的文本列表，即当图文视图的属性不可点击时，先确定文本列表是否存在，所述文本列表是事先设置好的，用于存储不可点击的图文视图，若存在所述文本列表，则所述存储模块30将所述图文视图存储至所述文本列表中，若不存在所述文本列表，则建立所述文本列表，并用建立的文本列表存储所述图文信息。
本实施例提出的显示界面中的信息提取系统，先获取当前显示界面的根视图中的各个视图，然后根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图，最后将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，实现了根据显示界面中各个视图的属性，获取各个所述视图对应的控件视图和图文视图，然后根据获取的控件视图和图文视图，生成第三方应用的界面，实现各种控制系统可对终端中第三方应用的控制，提高了对终端控制的灵活性。
进一步地，为了提高信息提取的灵活性，基于第一实施例提出本发明信息提取系统第二实施例，在本实施例中，参照图5，所述确定模块20包括：
第一确定单元21，用于依次确定各个所述视图是否存在子视图；
第二确定单元22，用于在有视图不存在子视图时，确定所述视图的属性；
所述第二确定单元22，还用于当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
所述第二确定单元22，还用于当所述视图的属性为不可点击的属性时，确定所述视图是图文视图。
在本实施例中，所述获取模块10获取到各个视图时，所述第一确定单元21先确定各个视图是否存在子视图，所述子视图包括一级或多级子视图，在有视图不存在子视图时，所述第二确定单元22直接确定所述视图的属性，优选所述属性包括可点击属性和不可点击属性，当所述视图的属性为可点击的属性时，所述第二确定单元22确定所述视图是控件视图，当所述视图的属性为不可点击的属性时，所述第二确定单元22确定所述视图是图文视图。进一步地，所述第一确定单元21确定各个所述视图是否存在子视图的方式优选包括：a、确定各个所述视图内是否包含有子视图，举例如下：在word文档界面中工具栏包括多个控件视图，如字体控件视图，则所述字体控件视图内就包含许多子视图，如字体加粗子视图，字体倾斜子视图等等。b、确定是否预存有与各个所述视图的触发操作关联的子视图，举例如下，在word文档界面中菜单栏包括多个控件视图，如开始控件视图，则在检测基于所述开始菜单栏对应界面输入的点击操作时，则显示字体子视图，段落子视图和样式子视图等等。值得注意的是，所述触发操作可包括用户基于所述控件视图对应的界面输入的点击操作、触摸操作，进一步地还可包括语音指令。
进一步地，为了提高信息提取的灵活性，基于第二实施例提出本发明信息提取系统的第三实施例，在本实施例中，参照图6，所述确定模块20还包括：
第三确定单元23，用于在有视图存在子视图时，确定所述子视图的属性；
第四确定单元24，用于当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
所述第四确定单元24，还用于当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
在本实施例中，在有视图存在子视图时，所述第三确定单元23确定所述子视图的属性也就是判断所述子视图的属性是为可点击的属性还是为不可点击的属性，当有所述子视图的属性为可点击的属性时，所述第四确定单元24确定所述子视图是控件视图，当有所述子视图的属性为不可点击的属性时，所述第四确定单元24确定所述子视图是图文视图。
进一步地，所述在有视图存在子视图时，所述第三确定单元23确定所述子视图的属性，所述子视图不仅包括一级的子视图，还可包括多级的子视图，也就是说，在显示界面中提取信息过程中，依次遍历所述根视图对应的各个视图，所述第三确定单元23确定各个视图是否包含子视图，所述第三确定单元23再进一步确定所述子视图是否包含二级子视图，直到所述子视图不再存在低一级的子视图为止，通过这个遍历过程，所述获取模块10获取根视图中各个视图，所述确定模块20再根据属性确定当前显示界面中的所述控件视图和图文视图。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其它变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其它要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。
上述本发明实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质（如ROM/RAM、磁碟、光盘）中，包括若干指令用以使得一台终端设备（可以是手机，计算机，服务器，空调器，或者网络设备等）执行本发明各个实施例所述的方法。
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其它相关的技术领域，均同理包括在本发明的专利保护范围内。

Claims (16)

  1. 一种显示界面中的信息提取方法，其特征在于，所述信息提取方法包括以下步骤：
    获取当前显示界面的根视图中的各个视图；
    依次确定各个所述视图是否存在子视图；
    在有视图不存在子视图时，确定所述视图的属性；
    当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
    当所述视图的属性为不可点击的属性时，确定所述视图是图文视图；
    将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的；
    所述将所述控件视图存储到对应的控件列表的同时执行以下步骤：
    将所述控件视图对应的功能信息与所述控件视图关联存储。
  2. 如权利要求1所述的信息提取方法，其特征在于，所述依次确定各个所述视图是否存在子视图的步骤包括：
    确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
  3. 如权利要求2所述的信息提取方法，其特征在于，所述依次确定各个所述视图是否存在子视图步骤之后，所述信息提取方法还包括：
    在有视图存在子视图时，确定所述子视图的属性；
    当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
    当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
  4. 一种显示界面中的信息提取方法，其特征在于，所述信息提取方法包括以下步骤：
    获取当前显示界面的根视图中的各个视图；
    根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图；
    将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的。
  5. 如权利要求4所述的信息提取方法，其特征在于，所述根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图的步骤包括：
    依次确定各个所述视图是否存在子视图；
    在有视图不存在子视图时，确定所述视图的属性；
    当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
    当所述视图的属性为不可点击的属性时，确定所述视图是图文视图。
  6. 如权利要求5所述的信息提取方法，其特征在于，所述依次确定各个所述视图是否存在子视图的步骤包括：
    确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
  7. 如权利要求5所述的信息提取方法，其特征在于，所述依次确定各个所述视图是否存在子视图步骤之后，所述信息提取方法还包括：
    在有视图存在子视图时，确定所述子视图的属性；
    当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
    当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
  8. 如权利要求4所述的信息提取方法，其特征在于，所述将所述控件视图存储到对应的控件列表的同时执行以下步骤：
    将所述控件视图对应的功能信息与所述控件视图关联存储。
  9. 一种显示界面中的信息提取系统，其特征在于，所述信息提取系统包括：
    获取模块，用于获取当前显示界面的根视图中的各个视图；
    确定模块，用于依次确定各个所述视图是否存在子视图；
    所述确定模块，还用于在有视图不存在子视图时，确定所述视图的属性；
    所述确定模块，还用于当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
    所述确定模块，还用于当所述视图的属性为不可点击的属性时，确定所述视图是图文视图；
    存储模块，用于将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的；
    所述存储模块，还用于将所述控件视图对应的功能信息与所述控件视图关联存储。
  10. 如权利要求9所述的信息提取系统，其特征在于，所述确定模块，还用于确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
  11. 如权利要求10所述的信息提取系统，其特征在于，所述确定模块，还用于在有视图存在子视图时，确定所述子视图的属性；当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
  12. 一种显示界面中的信息提取系统，其特征在于，所述信息提取系统包括：
    获取模块，用于获取当前显示界面的根视图中的各个视图；
    确定模块，用于根据各个所述视图的属性确定当前显示界面对应的控件视图和图文视图；
    存储模块，用于将所述控件视图存储到对应的控件列表，并将所述图文视图存储到对应的文本列表，其中，所述控件列表的控制视图为可点击的，所述文本列表的图文视图是不可点击的。
  13. 如权利要求12所述的信息提取系统，其特征在于，所述确定模块包括：
    第一确定单元，用于依次确定各个所述视图是否存在子视图；
    第二确定单元，用于在有视图不存在子视图时，确定所述视图的属性；
    所述第二确定单元，还用于当所述视图的属性为可点击的属性时，确定所述视图是控件视图；
    所述第二确定单元，还用于当所述视图的属性为不可点击的属性时，确定所述视图是图文视图。
  14. 如权利要求13所述的信息提取系统，其特征在于，所述第一确定单元还用于确定各个所述视图内是否包含有子视图，或者，确定是否预存有与各个所述视图的触发操作关联的子视图。
  15. 如权利要求13所述的信息提取系统，其特征在于，所述确定模块还包括：
    第三确定单元，用于在有视图存在子视图时，确定所述子视图的属性；
    第四确定单元，用于当有所述子视图的属性为可点击的属性时，确定所述子视图是控件视图；
    所述第四确定单元，还用于当有所述子视图的属性为不可点击的属性时，确定所述子视图是图文视图。
  16. 如权利要求12所述的信息提取系统，其特征在于，所述存储模块还用于将所述控件视图对应的功能信息与所述控件视图关联存储。
PCT/CN2016/084419 2015-09-02 2016-06-02 显示界面中的信息提取方法及系统 WO2017036208A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510556412.8A CN105183291A (zh) 2015-09-02 2015-09-02 显示界面中的信息提取方法及系统
CN201510556412.8 2015-09-02

Publications (1)

Publication Number Publication Date
WO2017036208A1 true WO2017036208A1 (zh) 2017-03-09

Family

ID=54905403

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084419 WO2017036208A1 (zh) 2015-09-02 2016-06-02 显示界面中的信息提取方法及系统

Country Status (2)

Country Link
CN (1) CN105183291A (zh)
WO (1) WO2017036208A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113726948A (zh) * 2020-05-12 2021-11-30 北京字节跳动网络技术有限公司 图片展示方法和装置

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105183291A (zh) * 2015-09-02 2015-12-23 深圳Tcl数字技术有限公司 显示界面中的信息提取方法及系统
CN107391091A (zh) * 2016-05-17 2017-11-24 武汉宏途科技有限公司 一种基于父子状态的全景多视图系统及其构建方法
CN109062653B (zh) * 2018-08-20 2022-02-25 珠海市筑巢科技有限公司 长图文信息显示方法、计算机装置及计算机可读存储介质
CN111147777A (zh) * 2019-10-12 2020-05-12 深圳Tcl数字技术有限公司 智能终端语音交互方法、装置和存储介质
CN114115777A (zh) * 2021-11-19 2022-03-01 武汉虹信技术服务有限责任公司 一种基于安卓系统的增强文本显示方法
CN116170646A (zh) * 2021-11-25 2023-05-26 中移（杭州）信息技术有限公司 一种机顶盒的控制方法和系统，及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101382887A (zh) * 2008-09-19 2009-03-11 金蝶软件（中国）有限公司 一种调整界面布局的方法及装置
CN102385515A (zh) * 2011-10-21 2012-03-21 广州市久邦数码科技有限公司 一种基于Android系统的GO图像动画引擎
CN103455414A (zh) * 2012-06-04 2013-12-18 腾讯科技（深圳）有限公司 获取控件的逻辑位置的方法及装置
CN104182124A (zh) * 2014-08-25 2014-12-03 广东欧珀移动通信有限公司 移动终端的操作方法和装置
CN105183291A (zh) * 2015-09-02 2015-12-23 深圳Tcl数字技术有限公司 显示界面中的信息提取方法及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101382887A (zh) * 2008-09-19 2009-03-11 金蝶软件（中国）有限公司 一种调整界面布局的方法及装置
CN102385515A (zh) * 2011-10-21 2012-03-21 广州市久邦数码科技有限公司 一种基于Android系统的GO图像动画引擎
CN103455414A (zh) * 2012-06-04 2013-12-18 腾讯科技（深圳）有限公司 获取控件的逻辑位置的方法及装置
CN104182124A (zh) * 2014-08-25 2014-12-03 广东欧珀移动通信有限公司 移动终端的操作方法和装置
CN105183291A (zh) * 2015-09-02 2015-12-23 深圳Tcl数字技术有限公司 显示界面中的信息提取方法及系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113726948A (zh) * 2020-05-12 2021-11-30 北京字节跳动网络技术有限公司 图片展示方法和装置
CN113726948B (zh) * 2020-05-12 2022-08-23 北京字节跳动网络技术有限公司 图片展示方法和装置

Also Published As

Publication number Publication date
CN105183291A (zh) 2015-12-23

Similar Documents

Publication Publication Date Title
WO2017036208A1 (zh) 显示界面中的信息提取方法及系统
WO2017041538A1 (zh) 终端用户界面的受控显示方法及装置
WO2014082500A1 (zh) 页面加载方法及其系统、计算机存储介质
WO2017028601A1 (zh) 智能终端的语音控制方法、装置及电视机系统
WO2018107610A1 (zh) 业务数据处理方法、系统、设备及计算机可读存储介质
WO2019051902A1 (zh) 终端控制方法、空调器及计算机可读存储介质
WO2019119771A1 (zh) 语音交互方法、装置及计算机可读存储介质
WO2019037396A1 (zh) 账户清结算方法、装置、设备及存储介质
WO2016058258A1 (zh) 终端远程控制方法和系统
WO2013159482A1 (zh) 图标智能显示的方法和装置
WO2018126888A1 (zh) 电视功能的快捷启动设置方法及装置
WO2018018681A1 (zh) 视频节目预览方法及装置
WO2018113187A1 (zh) 一种显示控制方法及显示装置
WO2014000635A1 (zh) 阅读器提供服务的方法、阅读器、终端及计算机存储介质
WO2016000560A1 (en) File transmission method, file transmission apparatus, and file transmission system
WO2017121066A1 (zh) 应用程序显示方法和系统
WO2018120430A1 (zh) 一种页面构建方法、终端、计算机可读存储介质及页面构建设备
WO2019085543A1 (zh) 电视机系统及电视机控制方法
WO2017063366A1 (zh) 应用启动方法和系统
WO2017059686A1 (zh) 桌面显示方法及装置
WO2017071223A1 (zh) 电视应用的控制方法及装置
WO2018006581A1 (zh) 智能电视的播放方法及装置
WO2019051901A1 (zh) 终端控制方法、装置及计算机可读存储介质
WO2017088429A1 (zh) 移动终端控制显示终端上触屏应用程序的方法及系统
WO2017181501A1 (zh) 键值扩展方法及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16840637

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11.07.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16840637

Country of ref document: EP

Kind code of ref document: A1