WO2016197430A1 - 信息输出的方法、终端和计算机存储介质 - Google Patents
信息输出的方法、终端和计算机存储介质 Download PDFInfo
- Publication number
- WO2016197430A1 WO2016197430A1 PCT/CN2015/083858 CN2015083858W WO2016197430A1 WO 2016197430 A1 WO2016197430 A1 WO 2016197430A1 CN 2015083858 W CN2015083858 W CN 2015083858W WO 2016197430 A1 WO2016197430 A1 WO 2016197430A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- view object
- display screen
- touch operation
- information
- text information
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
Definitions
- the present invention relates to the field of terminal applications, and in particular, to a method for outputting information, a terminal, and a computer storage medium.
- the user can control the terminal to take a screen shot of the current screen by means of a shortcut key or the like, obtain an image of the displayed content, and then recognize the text information in the image and convert it into a voice.
- the signal is output to the user.
- the screen capture area is the entire screen, the screen capture image contains more content, and there may be a large amount of redundant information, resulting in inaccurate text recognition.
- the information output to the user through the voice signal may have a certain amount. error.
- embodiments of the present invention are directed to providing a method and a terminal for information output, which can partially improve the accuracy of content recognition in an application window, reduce the output of error information, and provide a good user experience.
- an embodiment of the present invention provides a method for outputting information, including: when Obtaining a voice output instruction when an application window is displayed on the touch display screen; executing the voice output instruction to determine a view object corresponding to the touch operation on the touch display screen; and acquiring text information in the view object; The text information is converted into voice information and output.
- the obtaining a voice output instruction comprises: obtaining the voice output instruction based on a user operation; or detecting an ambient light intensity value illuminated on the touch display screen, and detecting the ambient light intensity When the value is greater than the threshold, the voice output instruction is obtained.
- the determining the view object corresponding to the touch operation on the touch display screen includes: detecting whether there is a touch operation on the touch display screen; when the touch operation exists on the touch display screen Determining the view object according to the location of the touch operation.
- the application window includes at least one layer of view objects; and determining the view object according to the location of the touch operation comprises: finding the touch operation in the at least one layer view object The innermost view object to which the position belongs; the view object of the innermost layer is determined as the view object.
- the acquiring the text information in the view object includes: starting from the innermost view object, sequentially acquiring text from the at least one layer view object in order from the inside to the outside Information; the obtained text information is determined as the text information.
- an embodiment of the present invention provides a terminal, including: an instruction obtaining unit, configured to obtain a voice output instruction when an application window is displayed on a touch display screen of the terminal; and an instruction execution unit configured to perform the a voice output instruction, determining a view object corresponding to the touch operation on the touch display screen; a text obtaining unit configured to acquire text information in the view object; and a voice converting unit configured to convert the text information into a voice Information; a voice output unit configured to output the voice information.
- the instruction obtaining unit is configured to obtain the voice output instruction based on a user operation; or detect an ambient light intensity value irradiated on the touch display screen, and the ambient light intensity value is greater than At the threshold value, the voice output command is obtained.
- the instruction execution unit is configured to detect whether there is a touch operation on the touch display screen; when the touch operation exists on the touch display screen, determine the location according to the location of the touch operation View object.
- the application window includes at least one layer of view objects; the instruction execution unit is configured to find, in the at least one layer of view objects, an innermost view object to which the location of the touch operation belongs Determining the innermost view object as the view object.
- the text obtaining unit is configured to, in order from the innermost view object, sequentially obtain text information from the at least one layer view object in order from the inside to the outside;
- the text information is determined as the text information.
- the embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, where the computer executable instructions are used to perform at least one of the methods in the foregoing first aspect. one.
- the embodiment of the invention provides a method for outputting information, a terminal and a computer storage medium.
- the terminal obtains a voice output instruction, and then executes the voice output instruction to determine the touch.
- the view object corresponding to the touch operation on the display screen next, the text information in the determined view object is obtained, and finally, the text information is converted into voice information and output.
- the terminal determines the view object according to the touch operation of the user on the touch screen, and does not treat all the view objects in a non-discriminate manner as in the prior art. Then, the determined text information does not contain or contain a minimum amount of redundant information.
- the text information is more accurate after being converted into voice information, which improves the accuracy of content recognition in the application window, reduces the output of error information, and provides a good user experience.
- FIG. 1 is a schematic diagram of an application window according to an embodiment of the present invention
- FIG. 2 is a schematic flowchart of a method for outputting information according to an embodiment of the present invention
- FIG. 3 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
- the embodiment of the invention provides a method for outputting information, which is applied to terminals such as smart phones, tablet computers, electronic readers, smart watches, smart glasses and the like.
- terminals such as smart phones, tablet computers, electronic readers, smart watches, smart glasses and the like.
- a touch display screen is provided on these terminals, and an application window can be displayed on the touch display screen.
- the text information of the view object is converted into voice information output instead of converting the information displayed on the entire screen of the terminal into voice information output, so that the targeted operation is performed.
- the voice conversion output not only solves the problem of excessive redundant information, but also solves the problems of low recognition accuracy and large terminal processing load due to redundant information in the process of conversion recognition.
- the above terminal can run an Android system, an iOS system, a Windows system, and the like.
- the invention is not specifically limited.
- the Android system is taken as an example for description.
- the Android system provides an application window (Activity) to interact with the user to complete a function.
- Activity is the basic page unit.
- An Activity is usually a separate screen. It can display some objects on it, and can also listen to and handle user events to respond.
- Include a Window object inside an Activity and draw at least one View object on the Window object.
- a View object called Decor View which is the highest level view object of the Window object, used as a View Group.
- the Decor View object also includes View objects such as Title View and Content View.
- each Activity has an associated Window object, which is used to describe an application window.
- Each Window object also contains a Decor View object, which is used to describe the view of the application window, and each Decor View object is Contains at least one other View object.
- the Activity 11 is associated with a Window object 12, which includes a Decor View object 13, and the Decor View object 13 includes a Title View object 14 and a Content View object 15.
- the method includes:
- the above-mentioned Activity is displayed on the touch display screen of the terminal, and the external light is too strong or the light is directly on the touch display screen of the terminal, so that the user cannot see the content in the Activity, and at this time, according to the user operation,
- the above voice output instruction or, detecting the ambient light intensity on the touch display screen of the terminal, and obtaining the voice output command when the ambient light intensity satisfies the preset condition.
- the user can perform a manual manner such as long pressing the Home button and pressing the volume button to trigger the terminal to generate a voice output command; or, the user performs voice input through the microphone of the terminal. For example, input "What is displayed here?" to trigger the terminal to generate a voice output command; or, at the edge of the touch display screen, a light intensity sensor for detecting the ambient light intensity value on the touch display screen when detecting When the ambient light intensity value is greater than the threshold value, it means that the light on the touch display screen is too strong. At this time, the terminal generates a voice output command.
- the terminal executes a voice output command to detect whether there is a touch operation on the touch display screen; if so, according to the position of the touch operation, the corresponding View object is determined; if not, the process ends.
- the terminal executes a voice output instruction to detect whether there is a touch operation on the touch display screen.
- the step of determining the corresponding View object may include Finding the innermost view object to which the position of the touch operation belongs in at least one layer of the View object; determining the innermost view object as the View object corresponding to the touch operation.
- the terminal can start from the outermost object, that is, the Decor View object, determine which View object is inside the View object, and then pass it to the internal View object, such as Title View, and touch the operation. Converting the coordinates on the touch display screen to the coordinates of the internal View object, further determining which View object the location of the touch operation belongs to within the internal View object, repeating the above process until the innermost layer where the touch operation is located is located View object.
- the operation of the user in triggering the terminal to obtain the voice output instruction in S201 and the touch operation on the touch display screen in S202 may be the same operation.
- the terminal when the user cannot see the content in the Activity, the user points any position in the Title View object with a finger and keeps the preset time, such as 3s, 5s, etc. At this time, the terminal generates a voice output instruction, and executes S202.
- the terminal In the actual application, there are many ways to trigger the terminal to obtain the voice output command, which is not specifically limited in the embodiment of the present invention.
- the terminal After the terminal determines the View object corresponding to the touch operation, the terminal reads the View.
- the text information in the object At this time, there is no redundant information in the text information or only a minimum amount of redundant information, that is, the text information is information that the user wants to obtain.
- S203 may include: The innermost view object starts, and the text information is sequentially acquired from at least one layer of the view object in order from the inside to the outside; the obtained text information is determined as the text information of the View object corresponding to the touch operation.
- the terminal when the innermost View object does not contain text information, the terminal returns to the penultimate layer of the View object, taking the text information therein, or the text information in other View objects inside, if not, then Going back to the last third-level View object, and so on, until the text information is obtained, the text information is determined as the text information of the View object corresponding to the touch operation.
- S204 Convert text information into voice information, and output.
- the terminal converts the text information obtained in S203 into voice information, and then outputs the content to the user by playing.
- the terminal determines the view object according to the touch operation of the user on the touch screen, and does not treat all the view objects generally as in the prior art, then the determined text information does not contain or contains a minimum amount of redundancy.
- the information makes the text information more accurate after being converted into voice information, improves the accuracy of content recognition in the application window, reduces the output of error information, and provides a good user experience.
- the embodiment of the present invention further provides a terminal that is consistent with the terminal in one or more of the foregoing embodiments.
- the terminal includes: an instruction obtaining unit 31 configured to obtain a voice output instruction when an application window is displayed on the touch display screen of the terminal; the instruction execution unit 32 is configured to execute a voice output instruction, and determine Touch the view corresponding to the touch operation on the display a text object obtaining unit 33 configured to acquire text information in the view object; a voice converting unit 34 configured to convert the text information into voice information; and a voice output unit 35 configured to output the voice information.
- an instruction obtaining unit 31 configured to obtain a voice output instruction when an application window is displayed on the touch display screen of the terminal
- the instruction execution unit 32 is configured to execute a voice output instruction, and determine Touch the view corresponding to the touch operation on the display
- a text object obtaining unit 33 configured to acquire text information in the view object
- a voice converting unit 34 configured to convert the text information into voice information
- a voice output unit 35 configured to output the voice information.
- the instruction obtaining unit 31 is configured to obtain a voice output instruction based on a user operation; or, to detect an ambient light intensity value irradiated on the touch display screen, and obtain a voice when the ambient light intensity value is greater than a threshold value; Output instructions.
- the instruction execution unit 32 is configured to detect whether there is a touch operation on the touch display screen; when there is a touch operation on the touch display screen, the view object is determined according to the position of the touch operation.
- the application window includes at least one layer of the view object; the instruction execution unit 32 is specifically configured to find the innermost view object to which the location of the touch operation belongs in at least one layer of the view object;
- the view object is determined to be a view object.
- the text obtaining unit 33 is configured to, in order from the innermost view object, sequentially obtain text information from at least one layer of the view object in order from the inside to the outside; and determine the obtained text information as text. information.
- the instruction obtaining unit 31, the instruction executing unit 32, the text obtaining unit 33, and the voice converting unit 34 may be disposed inside a processor such as a CPU, an ARM, or a DSP in the terminal, and the voice output unit 35 may be configured.
- the voice converting unit 34 may also be disposed inside the sound card, which is not specifically limited in the present invention.
- An embodiment of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, where the computer executable instructions are used to perform at least one of the foregoing methods; specifically, as shown in FIG. method.
- the computer storage medium described in this embodiment may be a storage medium such as a mobile hard disk, a USB disk, an optical disk, or a magnetic tape, and may be a non-transitory storage medium.
- a storage medium such as a mobile hard disk, a USB disk, an optical disk, or a magnetic tape
- a non-transitory storage medium Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may employ hardware embodiments, software embodiments, or a combination of soft A form of embodiment of hardware and hardware.
- the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
- These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
- the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
Abstract
一种信息输出的方法，包括：当终端的触摸显示屏上显示有一应用程序窗口时，获得一语音输出指令(S201)；执行所述语音输出指令，确定所述触摸显示屏上的触摸操作所对应的视图对象(S202)；获取所述视图对象内的文本信息(S203)；将所述文本信息转换为语音信息，并输出(S204)。同时还公开了一种终端和一种计算机存储介质。
Description
本发明涉及终端应用领域，尤其涉及一种信息输出的方法、终端和计算机存储介质。
随着科学技术的不断发展，电子技术也得到了飞速的发展，电子产品的种类也越来越多，人们也享受到了科技发展带来的各种便利。现在人们可以通过各种类型的电子设备，享受随着科技发展带来的舒适生活。
目前，以智能手机为例，当用户处于阳光比较强烈的户外，或者光线直射在手机的屏幕上时，用户是无法看清楚当前屏幕上显示的内容，也就无法获取相应的信息，影响用户使用。所以，为了消除该影响，在上述情况下，用户可以通过快捷键等方式，控制终端对当前屏幕进行截屏，获得显示内容的图像，然后，对该图像中的文本信息进行识别，并转化为语音信号输出给用户。但是，由于截屏区域为整个屏幕，使得截屏图像中所包含的内容较多，可能存在大量的冗余信息，导致文本识别不准确，这样，最后通过语音信号输出给用户的信息就会存在一定的误差。
发明内容
有鉴于此，本发明实施例期望提供一种信息输出的方法及终端，能够部分实现提高对应用程序窗口中内容识别的准确度，减少误差信息的输出，提供良好的用户体验。
本发明实施例的技术方案是这样实现的：
第一方面，本发明实施例提供一种信息输出的方法，包括：当终端的
触摸显示屏上显示有一应用程序窗口时，获得一语音输出指令；执行所述语音输出指令，确定所述触摸显示屏上的触摸操作所对应的视图对象；获取所述视图对象内的文本信息；将所述文本信息转换为语音信息，并输出。
在上述方案中，所述获得一语音输出指令，包括：基于用户操作，获得所述语音输出指令；或，检测照射在所述触摸显示屏上的环境光强值，并在所述环境光强值大于门限值时，获得所述语音输出指令。
在上述方案中，所述确定所述触摸显示屏上的触摸操作所对应的视图对象，包括：检测所述触摸显示屏上是否存在触摸操作；当所述触摸显示屏上存在所述触摸操作时，根据所述触摸操作的位置，确定所述视图对象。
在上述方案中，所述应用程序窗口包含至少一层视图对象；所述根据所述触摸操作的位置，确定所述视图对象，包括：在所述至少一层视图对象中查找出所述触摸操作的位置所属的最内层的视图对象；将所述最内层的视图对象确定为所述视图对象。
在上述方案中，所述获取所述视图对象内的文本信息，包括：从所述最内层的视图对象开始，按照从内到外的顺序，依次从所述至少一层视图对象内获取文本信息；将获取到的文本信息确定为所述文本信息。
第二方面，本发明实施例提供一种终端，包括：指令获得单元，配置为当终端的触摸显示屏上显示有一应用程序窗口时，获得一语音输出指令；指令执行单元，配置为执行所述语音输出指令，确定所述触摸显示屏上的触摸操作所对应的视图对象；文本获取单元，配置为获取所述视图对象内的文本信息；语音转换单元，配置为将所述文本信息转换为语音信息；语音输出单元，配置为输出所述语音信息。
在上述方案中，所述指令获得单元，配置为基于用户操作，获得所述语音输出指令；或，检测照射在所述触摸显示屏上的环境光强值，并在所述环境光强值大于门限值时，获得所述语音输出指令。
在上述方案中，所述指令执行单元，配置为检测所述触摸显示屏上是否存在触摸操作；当所述触摸显示屏上存在所述触摸操作时，根据所述触摸操作的位置，确定所述视图对象。
在上述方案中，所述应用程序窗口包含至少一层视图对象；所述指令执行单元，配置为在所述至少一层视图对象中查找出所述触摸操作的位置所属的最内层的视图对象；将所述最内层的视图对象确定为所述视图对象。
在上述方案中，所述文本获取单元，配置为从所述最内层的视图对象开始，按照从内到外的顺序，依次从所述至少一层视图对象内获取文本信息；将获取到的文本信息确定为所述文本信息。
第三方面，本发明实施例还提供一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行前述的第一方面中所述方法的至少其中之一。
本发明实施例提供了一种信息输出的方法、终端和计算机存储介质，当终端的触摸显示屏上显示有一应用程序窗口时，终端获得一语音输出指令，然后，执行该语音输出指令，确定触摸显示屏上的触摸操作所对应的视图对象，接下来，获取上述确定出来的视图对象内的文本信息，最后，将所述文本信息转换为语音信息，并输出。可见，终端是根据用户在触摸屏上的触摸操作确定视图对象的，而并不如现有技术一般无差别对待所有视图对象，那么，确定出来的文本信息会不包含或者包含最小量的冗余信息，使得文本信息在转换为语音信息后，更加准确，提高了对应用程序窗口中内容识别的准确度，减少误差信息的输出，提供良好的用户体验。
图1为本发明实施例提供的一种应用程序窗口的示意图；
图2为本发明实施例提供的一种信息输出的方法流程示意图；
图3为本发明实施例中提供的一种终端的结构示意图。
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述；应当理解，以下所说明的优选实施例仅用于说明和解释本发明，并不用于限定本发明。
本发明实施例提供一种信息输出的方法，该方法应用于智能手机、平板电脑、电子阅读器、智能手表、智能眼镜等终端上。在这些终端上均设置有触摸显示屏，在触摸显示屏能够显示一应用程序窗口。在获得用户输入的语音输出指令或终端被乾光照射的情况下，将视图对象的文本信息转换语音信息输出，而非将终端整个屏幕显示的信息转换成语音信息输出，这样有针对性的进行语音转换输出，既解决了冗余信息过多的问题，同时解决转换识别过程中因冗余信息多导致的识别准确率低及终端处理负荷大等问题。
以下结合具体实施例做进一步举例说明，这些举例仅是基于本申请技术方案的可选实施例，并非对本申请技术方案的范围限定。在实际应用中，上述终端内可以运行Android系统、iOS系统、Windows系统等。本发明不做具体限定。在下面一个或者多个实施例中，以Android系统为例进行说明。
Android系统提供一个应用程序窗口(Activity)与用户进行交互，以完成某项功能。在一个Android应用中，Activity是基本的页面单元，一个Activity通常就是一个单独的屏幕，它上面可以显示一些对象，也可以监听并处理用户的事件做出响应。在一个Activity的内部包含一个窗口(Window)对象，在Window对象上可以绘制至少一个视图(View)对象。在所有View对象中，有一个叫Decor View的View对象，是Window对象的最高级别的视图对象，作为容器(View Group)来使用。在Decor View对象中还包括含有Title View、Content View等View对象。
可见，每一个Activity都有一个关联的Window对象，用来描述一个应用程序窗口，每一个Window对象内部又包含有一个Decor View对象，用来描述应用程序窗口的视图，每一个Decor View对象中又包含着至少一个其他View对象。例如，参见图1所示，该Activity11关联着一个Window对象12，该Window对象12包含一Decor View对象13，Decor View对象13中包括Title View对象14和Content View对象15。
下面结合图1，对本发明实施例提供的信息输出的方法进行说明。
参见图2所示，该方法包括：
S201：当终端的触摸显示屏上显示有一Activity时，获得一语音输出指令；
具体来说，终端的触摸显示屏上显示有上述Activity，由于外部光线太强或者光线直射在终端的触摸显示屏上，导致用户无法看清楚该Activity中的内容，此时，根据用户操作，获得上述语音输出指令；或，检测照射在终端的触摸显示屏上的环境光强，并在环境光强满足预设条件时，获得上述语音输出指令。
例如，当用户无法看清楚该Activity中的内容时，用户可以进行如长按Home键、同时按下音量键等手动的方式，触发终端生成语音输出指令；或者，用户通过终端的麦克风进行语音输入，如输入“这里显示的是什么？”来触发终端生成语音输出指令；或者，在触摸显示屏的边缘设置一光强传感器，用来检测照射在触摸显示屏上的环境光强值，当检测到的环境光强值大于门限值时，就表示照射在触摸显示屏上的光线过强，此时，终端生成语音输出指令。
S202：执行语音输出指令，确定触摸显示屏上的触摸操作所对应的View对象；
具体来说，用户在看不清楚Activity中的内容时，可以用手指点触所要
的获取信息所在的位置，此时，终端执行语音输出指令，检测触摸显示屏上是否存在触摸操作；若是，根据触摸操作的位置，确定对应View对象；若否，流程结束。例如，参见图1所示，假设用户想要获取Title View对象的内容，那么，用户就可以将手指点触Title View对象内任意位置，终端执行语音输出指令，检测触摸显示屏上是否存在触摸操作，检测到后，根据触摸操作在触摸显示屏上的位置，就能够确定出对应的View对象，即Title View对象。
在具体实施过程中，由于View对象都是多层嵌套的，一个外层View对象的内部可以嵌套至少一层View对象，所以，上述根据触摸操作的位置，确定对应View对象的步骤可以包括：在至少一层View对象中查找出上述触摸操作的位置所属的最内层的视图对象；将最内层的视图对象确定为触摸操作所对应的View对象。例如，终端可以从最外层对象，即Decor View对象开始，判断触摸操作的位置属于该View对象内部的哪个View对象，然后，再传递到该内部View对象，如Title View，并将触摸操作在触摸显示屏上的坐标换算成相对该内部View对象的坐标，进一步判断该触摸操作的位置属于该内部View对象内部的哪个View对象，重复上述流程，直到查找该触摸操作的位置所在的最内层View对象。
在另一实施例中，用户在S201中触发终端获得语音输出指令的操作与S202中在触摸显示屏上的触摸操作可以为同一操作。比如，当用户无法看清楚该Activity中的内容时，用户用手指点Title View对象内任意位置，并保持预设时间，如3s、5s等，此时，终端生成获得语音输出指令，并执行S202。当然，在实际应用中，触发终端获得语音输出指令的方式还有很多种，本发明实施例不做具体限定。
S203：获取触摸操作所对应的View对象的文本信息；
具体来说，终端在确定出触摸操作所对应的View对象之后，读取View
对象中的文本信息，此时，该文本信息中没有冗余信息或者仅包含了最少量的冗余信息，也就是说，该文本信息就是用户要获取的信息。
在实际应用中，由于终端确定出的触摸操作所对应的View对象是触摸操作的位置所在的最内层View对象，该View对象内可能并没有文本信息，那么，此时，S203可以包括：从最内层的视图对象开始，按照从内到外的顺序，依次从至少一层视图对象内获取文本信息；将获取到的文本信息确定为上述触摸操作所对应的View对象的文本信息。也就是说，当最内层View对象不包含文本信息时，终端就重新回到倒数第二层View对象，取其中的文本信息，或者其内部其他View对象中的文本信息，如果都没有，再回到倒数第三层View对象，以此类推，直到获取到文本信息为止，将该文本信息确定为触摸操作对应的View对象的文本信息。
S204：将文本信息转换为语音信息，并输出。
也就是说，终端将S203中获得的文本信息转换为语音信息，然后通过播放的方式输出给用户。
至此，终端就完成了信息输出的流程了。
由上述可知，终端是根据用户在触摸屏上的触摸操作确定视图对象的，而并不如现有技术一般无差别对待所有视图对象，那么，确定出来的文本信息会不包含或者包含最小量的冗余信息，使得文本信息在转换为语音信息后，更加准确，提高了对应用程序窗口中内容识别的准确度，减少误差信息的输出，提供良好的用户体验。
基于同一发明构思，本发明实施例还提供一种终端，该终端与上述一个或者多个实施例中的终端一致。
参见图3所示，该终端包括：指令获得单元31，配置为当终端的触摸显示屏上显示有一应用程序窗口时，获得一语音输出指令；指令执行单元32，配置为执行语音输出指令，确定触摸显示屏上的触摸操作所对应的视
图对象；文本获取单元33，配置为获取视图对象内的文本信息；语音转换单元34，配置为将文本信息转换为语音信息；语音输出单元35，配置为输出语音信息。
在上述方案中，指令获得单元31，配置为基于用户操作，获得语音输出指令；或，检测照射在触摸显示屏上的环境光强值，并在环境光强值大于门限值时，获得语音输出指令。
在上述方案中，指令执行单元32，配置为检测触摸显示屏上是否存在触摸操作；当触摸显示屏上存在触摸操作时，根据触摸操作的位置，确定视图对象。
在上述方案中，应用程序窗口包含至少一层视图对象；指令执行单元32，具体用于在至少一层视图对象中查找出触摸操作的位置所属的最内层的视图对象；将最内层的视图对象确定为视图对象。
在上述方案中，文本获取单元33，配置为从最内层的视图对象开始，按照从内到外的顺序，依次从至少一层视图对象内获取文本信息；将获取到的文本信息确定为文本信息。
在实际应用中，上述指令获得单元31、指令执行单元32、文本获取单元33及语音转换单元34均可以设置在上述终端中的CPU、ARM、DSP等处理器的内部，语音输出单元35可以设置在声卡或者扬声器的内部；进一步地，语音转换单元34也可以设置在声卡内部，本发明不做具体限定。
本发明实施例还提供了一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行上述方法的至少其中之一；具体如图2所示的方法。本实施例中所述的计算机存储介质可为移动硬盘、U盘、光盘、磁带等存储介质，可选为非瞬间存储介质。本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用硬件实施例、软件实施例、或结合软
件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
以上所述，仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围；凡按照本发明原理所作的修改，都应当理解为落入本发明的保护范围。
Claims (11)
- 一种信息输出的方法，包括：当终端的触摸显示屏上显示有一应用程序窗口时，获得一语音输出指令；执行所述语音输出指令，确定所述触摸显示屏上的触摸操作所对应的视图对象；获取所述视图对象内的文本信息；将所述文本信息转换为语音信息，并输出。
- 根据权利要求1所述的方法，其中，所述获得一语音输出指令，包括：基于用户操作，获得所述语音输出指令；或，检测照射在所述触摸显示屏上的环境光强值，并在所述环境光强值大于门限值时，获得所述语音输出指令。
- 根据权利要求1所述的方法，其中，所述确定所述触摸显示屏上的触摸操作所对应的视图对象，包括：检测所述触摸显示屏上是否存在触摸操作；当所述触摸显示屏上存在所述触摸操作时，根据所述触摸操作的位置，确定所述视图对象。
- 根据权利要求3所述的方法，其中，所述应用程序窗口包含至少一层视图对象；所述根据所述触摸操作的位置，确定所述视图对象，包括：在所述至少一层视图对象中查找出所述触摸操作的位置所属的最内层的视图对象；将所述最内层的视图对象确定为所述视图对象。
- 根据权利要求4所述的方法，其中，所述获取所述视图对象内的文本信息，包括：从所述最内层的视图对象开始，按照从内到外的顺序，依次从所述至少一层视图对象内获取文本信息；将获取到的文本信息确定为所述文本信息。
- 一种终端，包括：指令获得单元，配置为当终端的触摸显示屏上显示有一应用程序窗口时，获得一语音输出指令；指令执行单元，配置为执行所述语音输出指令，确定所述触摸显示屏上的触摸操作所对应的视图对象；文本获取单元，配置为获取所述视图对象内的文本信息；语音转换单元，配置为将所述文本信息转换为语音信息；语音输出单元，配置为输出所述语音信息。
- 根据权利要求6所述的终端，其中，所述指令获得单元，配置为基于用户操作，获得所述语音输出指令；或，检测照射在所述触摸显示屏上的环境光强值，并在所述环境光强值大于门限值时，获得所述语音输出指令。
- 根据权利要求6所述的终端，其中，所述指令执行单元，配置为检测所述触摸显示屏上是否存在触摸操作；当所述触摸显示屏上存在所述触摸操作时，根据所述触摸操作的位置，确定所述视图对象。
- 根据权利要求8所述的终端，其中，所述应用程序窗口包含至少一层视图对象；所述指令执行单元，配置为在所述至少一层视图对象中查找出所述触摸操作的位置所属的最内层的视图对象；将所述最内层的视图对象确定为所述视图对象。
- 根据权利要求9所述的终端，其中，所述文本获取单元，配置为从所述最内层的视图对象开始，按照从内到外的顺序，依次从所述至少一层视图对象内获取文本信息；将获取到的文本信息确定为所述文本信息。
- 一种计算机存储介质，所述计算机存储介质中存储有计算机可执行指令，所述计算机可执行指令用于执行权利要求1至5所述方法的至少其中之一。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510319882.2 | 2015-06-11 | ||
| CN201510319882.2A CN106293034A (zh) | 2015-06-11 | 2015-06-11 | 一种信息输出的方法及终端 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016197430A1 true WO2016197430A1 (zh) | 2016-12-15 |
Family
ID=57502919
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2015/083858 WO2016197430A1 (zh) | 2015-06-11 | 2015-07-13 | 信息输出的方法、终端和计算机存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106293034A (zh) |
| WO (1) | WO2016197430A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108833715A (zh) * | 2018-07-03 | 2018-11-16 | 佛山市影腾科技有限公司 | 一种读取文本信息的方法、装置及移动终端 |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110275667B (zh) * | 2019-06-25 | 2021-12-17 | 努比亚技术有限公司 | 内容显示方法、移动终端及计算机可读存储介质 |
| CN112684936A (zh) * | 2020-12-29 | 2021-04-20 | 深圳酷派技术有限公司 | 一种信息识别方法、存储介质及计算机设备 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102207843A (zh) * | 2010-03-31 | 2011-10-05 | 上海博泰悦臻电子设备制造有限公司 | 车载系统语音朗读方法和装置 |
| CN102576251A (zh) * | 2009-09-02 | 2012-07-11 | 亚马逊技术股份有限公司 | 触摸屏用户界面 |
| CN102736886A (zh) * | 2011-04-12 | 2012-10-17 | 德信互动科技（北京）有限公司 | 视觉辅助系统 |
| US20130325484A1 (en) * | 2012-05-29 | 2013-12-05 | Samsung Electronics Co., Ltd. | Method and apparatus for executing voice command in electronic device |
| CN104683564A (zh) * | 2013-11-27 | 2015-06-03 | Lg电子株式会社 | 移动终端及其控制方法 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095927A (zh) * | 2013-02-06 | 2013-05-08 | 吴玉胜 | 基于移动通讯终端及眼镜的显示及语音输出方法及系统 |
| KR102208110B1 (ko) * | 2013-09-11 | 2021-01-27 | 엘지전자 주식회사 | 착용형 컴퓨팅 디바이스 및 사용자 인터페이스 방법 |
| CN103853355A (zh) * | 2014-03-17 | 2014-06-11 | 吕玉柱 | 电子设备操作方法及其操控设备 |
| CN104571917A (zh) * | 2015-01-23 | 2015-04-29 | 广东能龙教育股份有限公司 | 一种基于触摸屏的点读方法和系统 |
-
2015
- 2015-06-11 CN CN201510319882.2A patent/CN106293034A/zh active Pending
- 2015-07-13 WO PCT/CN2015/083858 patent/WO2016197430A1/zh active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102576251A (zh) * | 2009-09-02 | 2012-07-11 | 亚马逊技术股份有限公司 | 触摸屏用户界面 |
| CN102207843A (zh) * | 2010-03-31 | 2011-10-05 | 上海博泰悦臻电子设备制造有限公司 | 车载系统语音朗读方法和装置 |
| CN102736886A (zh) * | 2011-04-12 | 2012-10-17 | 德信互动科技（北京）有限公司 | 视觉辅助系统 |
| US20130325484A1 (en) * | 2012-05-29 | 2013-12-05 | Samsung Electronics Co., Ltd. | Method and apparatus for executing voice command in electronic device |
| CN104683564A (zh) * | 2013-11-27 | 2015-06-03 | Lg电子株式会社 | 移动终端及其控制方法 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108833715A (zh) * | 2018-07-03 | 2018-11-16 | 佛山市影腾科技有限公司 | 一种读取文本信息的方法、装置及移动终端 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106293034A (zh) | 2017-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110199350B (zh) | 用于感测语音结束的方法和实现该方法的电子设备 | |
| EP3567584B1 (en) | Electronic apparatus and method for operating same | |
| US11314898B2 (en) | Operating method of electronic device for function execution based on voice command in locked state and electronic device supporting the same | |
| EP3335214B1 (en) | Method and electronic device for playing a virtual musical instrument | |
| CN106971723B (zh) | 语音处理方法和装置、用于语音处理的装置 | |
| EP3327719A1 (en) | Electronic device for processing multi-modal input, method for processing multi-modal input and server for processing multi-modal input | |
| US20170052760A1 (en) | Voice-triggered macros | |
| KR101421638B1 (ko) | 터치 검출 방법 및 이를 이용하는 터치 제어 장치 | |
| JP2019185011A (ja) | アプリケーションプログラムをウェイクアップする処理方法、装置及び記憶媒体 | |
| US20140006033A1 (en) | Method and apparatus for processing multiple inputs | |
| KR20180022021A (ko) | 음성 인식 방법 및 이를 수행하는 전자 장치 | |
| KR20160021850A (ko) | 환경 인식 다이얼로그 정책 및 응답 생성 | |
| EP3444811B1 (en) | Speech recognition method and device | |
| KR20180047801A (ko) | 전자 장치 및 전자 장치 제어 방법 | |
| KR102252448B1 (ko) | 제어 방법 및 그 방법을 처리하는 전자장치 | |
| CN111523850B (zh) | 响应于共同存在确定的调用动作 | |
| US20150310878A1 (en) | Method and apparatus for determining emotion information from user voice | |
| WO2019205552A1 (zh) | 在线文档的评论方法和装置 | |
| US11144175B2 (en) | Rule based application execution using multi-modal inputs | |
| US20150029225A1 (en) | Technique to Reverse Automatic Screen Content Rotation | |
| US20200075008A1 (en) | Voice data processing method and electronic device for supporting same | |
| US10950221B2 (en) | Keyword confirmation method and apparatus | |
| WO2016197430A1 (zh) | 信息输出的方法、终端和计算机存储介质 | |
| WO2015131590A1 (zh) | 一种控制黑屏手势处理的方法及终端 | |
| US10691717B2 (en) | Method and apparatus for managing data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15894699 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 15894699 Country of ref document: EP Kind code of ref document: A1 |