CN115793915A

CN115793915A - Terminal control method, device, equipment and medium

Info

Publication number: CN115793915A
Application number: CN202111064217.5A
Authority: CN
Inventors: 杨博文; 王也
Original assignee: Beijing Youzhuju Network Technology Co Ltd
Current assignee: Beijing Youzhuju Network Technology Co Ltd
Priority date: 2021-09-10
Filing date: 2021-09-10
Publication date: 2023-03-14

Abstract

The disclosed embodiment relates to a terminal control method, a device, equipment and a medium, wherein the method comprises the following steps: responding to a preset instruction, and controlling the current screen content of the electronic equipment to enter an interface locking state; determining a target position in response to the selection operation of a user on the interface locking state, and acquiring an identification result corresponding to the target position; and converting the recognition result into voice to be played, and acquiring display content corresponding to the recognition result to be displayed in a target area in a preset form. By adopting the technical scheme, the click-to-read can be performed on any content in the screen content of the electronic equipment, the learning efficiency is improved, and the learning requirement of a user for click-to-read any content is met; and relevant contents can be displayed based on selection operation of a user, so that the learning range under the network learning scene is further improved, and the learning effect is improved.

Description

Terminal control method, device, equipment and medium

Technical Field

The present disclosure relates to the field of information processing technologies, and in particular, to a terminal control method, apparatus, device, and medium.

Background

With the rapid development of internet technology and intelligent terminals, a touch and talk pen or a touch and talk machine has become a basic tool in learning.

At present, in some related products, a user can click a specified teaching material of a manufactured paper book through a click-and-read pen to click to read a sentence, or a click-and-read machine pre-records a Chinese and English textbook sentence, and click-and-read is realized through an auxiliary electronic pen.

Disclosure of Invention

In order to solve the above technical problems, or at least partially solve the above technical problems, the present disclosure provides a terminal control method, apparatus, device, and medium.

The embodiment of the disclosure provides a terminal control method, which comprises the following steps:

responding to a preset instruction, and controlling the current screen content of the electronic equipment to enter an interface locking state;

determining a target position in response to the selection operation of the user on the interface locking state, and acquiring an identification result corresponding to the target position;

and converting the recognition result into voice playing, and acquiring display content corresponding to the recognition result to display in a target area in a preset form.

The embodiment of the present disclosure further provides a terminal control device, where the terminal control device includes:

the screen freezing responding module is used for responding to a preset instruction and controlling the current screen content of the electronic equipment to enter an interface locking state;

the response acquisition module is used for responding to the selection operation of the user on the interface locking state to determine a target position and acquiring an identification result corresponding to the target position;

and the playing display module is used for converting the recognition result into voice playing and acquiring display content corresponding to the recognition result to display in a target area in a preset form.

An embodiment of the present disclosure further provides an electronic device, which includes: a processor; a memory for storing the processor-executable instructions; the processor is configured to read the executable instructions from the memory and execute the instructions to implement the terminal control method provided by the embodiment of the disclosure.

The embodiment of the present disclosure also provides a computer-readable storage medium, which stores a computer program for executing the terminal control method provided by the embodiment of the present disclosure.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: the click-to-read scheme provided by the embodiment of the disclosure controls the current screen content of the electronic device to enter the interface locking state in response to the preset instruction, determines the target position in response to the selection operation of the user on the interface locking state, acquires the recognition result corresponding to the target position, converts the recognition result into voice playing, and acquires the display content corresponding to the recognition result to display in the target area in the preset form. By adopting the technical scheme, the click-to-read can be performed on any content in the screen content of the electronic equipment, the learning efficiency is improved, and the learning requirement of a user for click-to-read any content is met; and relevant contents can be displayed based on selection operation of a user, so that the learning range under the network learning scene is further improved, and the learning effect is improved.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and components are not necessarily drawn to scale.

Fig. 1 is a schematic flowchart of a terminal control method according to an embodiment of the present disclosure;

fig. 2 is a schematic flowchart of another terminal control method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram illustrating a locked state of an interface according to an embodiment of the disclosure;

FIG. 4 is a schematic diagram of an interface lock state provided by an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a selection operation provided by an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a selection operation provided by an embodiment of the present disclosure;

fig. 7 is a schematic diagram of a terminal control provided in the embodiment of the present disclosure;

fig. 8 is a schematic diagram of a terminal control provided in the embodiment of the present disclosure;

fig. 9 is a schematic diagram of another terminal control provided in the embodiments of the present disclosure;

fig. 10 is a schematic diagram of still another terminal control provided by the embodiment of the present disclosure;

fig. 11 is a schematic structural diagram of a terminal control device according to an embodiment of the present disclosure;

fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein is intended to be open-ended, i.e., "including but not limited to". The term "based on" is "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.

It is noted that references to "a" or "an" in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will appreciate that references to "one or more" are intended to be exemplary and not limiting unless the context clearly indicates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

Fig. 1 is a flowchart illustrating a terminal control method according to an embodiment of the present disclosure, where the method may be executed by a terminal control apparatus, where the apparatus may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 1, the method includes:

step 101, responding to a preset instruction, and controlling the current screen content of the electronic equipment to enter an interface locking state.

In the embodiment of the present disclosure, the type of the electronic device is not limited, and for example, the electronic device may be a hardware device such as a mobile phone, a tablet computer, a personal digital assistant, and the like, which has various operating systems, a touch screen, and/or a display screen. The interface locking state refers to shielding a click event and responding to a query operation, and in the embodiment of the disclosure, the interface content displayed on the current screen is locked, that is, the current screen content is locked, and the touch reading mode is entered.

In the embodiment of the present disclosure, there are many ways to respond to the preset instruction, and as an example, the preset instruction is responded based on a trigger operation of a user on a click-to-read control in the current screen content. The current screen content refers to interface content for current screen display, the click-to-read control refers to an anchor point for click-to-read, and the expression form of the click-to-read control is not limited, for example, the click-to-read control may be an icon of a finger or text information such as "query" or the like, and is specifically selected and set according to an application scene.

Specifically, in the process of using the electronic device, a trigger operation of the user on the current screen content may be detected, and when an operation such as a click operation or a hover operation of the user on the touch-and-talk control is detected, the current screen content of the electronic device may be controlled to enter an interface lock state.

And 102, responding to the selection operation of the user on the interface locking state to determine a target position, and acquiring an identification result corresponding to the target position.

In the embodiment of the present disclosure, the target position refers to a position of any character, for example, the current screen content is "AABBCC", the target position may be a position corresponding to the above-mentioned letter, and one or more letters may be selected as the target position at the same time. The selection operation refers to an operation of clicking, long-pressing and the like on any position in the interface locking state by a user to realize content selection, and in the embodiment of the disclosure, the selection operation refers to an operation of selecting any content in the current screen content. The recognition result refers to the content selected by the selection operation in the current screen content, and in the embodiment of the present disclosure, refers to the content information corresponding to the target position.

In the embodiment of the present disclosure, there are various ways to determine the target position in response to the user selecting the interface lock state, and obtain the identification result corresponding to the target position, and as an example, the target content is obtained as the identification result based on the user clicking the target content in the current screen content.

Specifically, as an example, when an operation such as clicking on an interface locking state by a user is detected, coordinate information of a target position may be obtained, and a content corresponding to the target position is matched in current screen content according to the coordinate information and serves as an identification result; as another example, when an operation such as a click of a user on the interface lock state is detected, a screenshot corresponding to the click operation is obtained, and text information corresponding to the screenshot is directly identified as an identification result.

And 103, converting the recognition result into voice to be played, and acquiring display content corresponding to the recognition result to be displayed in the target area in a preset form.

In the embodiment of the present disclosure, the recognition result may be converted into voice information in a text-to-speech manner and played through an audio device of the electronic device. The display content refers to display content related to the recognition result, in the embodiment of the present disclosure, the recognition result is chinese, the display content may be chinese and corresponding pinyin as the display content, the recognition result is english, the display content may be english and corresponding translation result as the display content, further, the recognition result is a name of a classical story, the display content may be a full text of the classical story, and the like, and is specifically selected and set according to an application scenario.

The preset form refers to a display form of display content, and in the embodiment of the present disclosure, the preset form may be a pop-up window, a floating window, or the like, which is not limited herein. The target area refers to any area of the current screen content, and in the embodiment of the present disclosure, may be a right area of the current screen content, and the like, which is not limited herein.

In the embodiment of the present disclosure, there are many ways of obtaining the display content corresponding to the recognition result and displaying the display content in the target area in a preset form, and as an example, obtaining a subsequent text of the recognition result, obtaining the recognition result and a pinyin corresponding to each chinese character in the subsequent text, and displaying the recognition result, the subsequent text, and the pinyin corresponding to each chinese character in a pop-up window form in a right area of the current screen content; as another example, the recognition result is translated into Chinese text, and the recognition result and the Chinese text are displayed in a floating window form in the left area of the current screen content.

The click-to-read scheme provided by the embodiment of the disclosure controls the current screen content of the electronic device to enter the interface locking state in response to the preset instruction, determines the target position in response to the selection operation of the user on the interface locking state, acquires the recognition result corresponding to the target position, converts the recognition result into voice playing, and acquires the display content corresponding to the recognition result to display in the target area in the preset form. By adopting the technical scheme, the click-to-read can be performed on any content in the screen content of the electronic equipment, the learning efficiency is improved, and the learning requirement of a user for click-to-read any content is met; and related contents can be displayed based on selection operation of a user, so that the learning range in a network learning scene is further improved, and the learning effect is improved.

In some embodiments, the terminal control method may further include: and when the interface is in a locked state, acquiring a screenshot corresponding to the current screen content, and performing character recognition on the screenshot to acquire text data.

In some embodiments, coordinate information of the target location is determined based on the selection operation, and the recognition result is determined from the text data based on the coordinate information.

In the embodiment of the disclosure, when the interface is in the locked state, the screenshot corresponding to the current screen content may be obtained, and the screenshot is subjected to character recognition, that is, characters in the image are converted into a text format, and text data in the text format corresponding to the current screen content may be obtained.

It can be understood that the text stored in the text data is in one-to-one correspondence with the current screen content, that is, each character has corresponding coordinate information, and each coordinate can uniquely determine the corresponding character, so that the coordinate information of the target position can be obtained, the matching is performed in the text data according to the coordinate information, the corresponding content is obtained as the identification result, the accuracy and the efficiency of the identification result are further improved, that is, the selection of any content in the screen of the electronic device can be realized, the click-to-read of any content in the screen content of the electronic device is realized, the learning efficiency is improved, and the learning requirement of the user for clicking to read any content is met.

In some embodiments, the terminal control method may further include: and displaying the current screen content by using a preset prompt identifier to prompt that the electronic equipment is in an interface locking state.

The preset prompt mark can be a result of arbitrary combination of colors such as red, green and blue and shapes such as square, rectangle and circle, so as to prompt the user that the electronic equipment is in an interface locking state, and can select arbitrary contents to realize click-reading, thereby satisfying the use requirements of users and improving the use experience of users.

In some embodiments, the terminal control method may further include displaying the target icon at the time of the selection operation, and may further control the target icon to disappear when it is determined that the recognition result is acquired or not acquired.

In some embodiments, the terminal control method may further include displaying, in the current screen content, the selection content corresponding to the selection operation in the target color when the identification result is obtained, and controlling the target color to disappear when the operation of closing the display content is detected.

In the embodiment of the disclosure, when the user selects an operation, whether the user selects the operation, such as an icon of a gesture, an arrow, and the like, can be prompted through the target icon, the setting can be selected according to the need, and the setting is not limited here.

In the embodiment of the disclosure, when the identification result is obtained, the selection content corresponding to the selection operation may be displayed in the current screen content in the target color, that is, the selection content is further determined to prompt the user whether to adjust in time, and when the operation of closing the display content is detected, the target color is controlled to disappear, so that the use requirement of the user is met, and the use experience of the user is improved.

In some embodiments, when the electronic device is in a full-screen video playing state, the current screen content is a current video frame, and in an interface locking state, the video playing application keeps playing audio.

In the embodiment of the present disclosure, the electronic device may also be in a full-screen video playing state, that is, the current screen content is the current video frame, and in the interface locking state, the playing video application keeps audio playing, so as to ensure that the recognition result can be converted into voice playing subsequently, and ensure the click-to-read effect.

In some embodiments, the terminal control method may further include converting the display content into voice playing in response to a click operation on a play control in the target region; or responding to the selection operation of any content in the target area, and converting the selected content into voice playing.

In the embodiment of the disclosure, after the recognition result is played and the display content related to the recognition is displayed, the user can select to play the recognition result again or display the content or display any content in the content according to the application requirement, so as to further meet the user use requirement, further improve the learning range in the network learning scene, and improve the learning effect.

Fig. 2 is a schematic flow chart of another terminal control method provided in the embodiment of the present disclosure, and the embodiment further optimizes the terminal control method on the basis of the above embodiment.

As shown in fig. 2, the method includes:

step 201, in the using process of the electronic device, based on the triggering operation of the preset click-to-read control on the current screen content by the user, controlling the current screen content of the electronic device to enter an interface locking state.

Exemplarily, fig. 3 is a schematic diagram of an interface locking state provided by the embodiment of the present disclosure, and fig. 3 shows a schematic diagram of an interface locking state, where a current screen content includes a page content and a preset click-to-read control 11, the click-to-read control 11 is set in a form of a circle including "look-up" text information, and when a user triggers the click-to-read control 11, the electronic device may receive a preset instruction to control the current screen content of the electronic device to enter the interface locking state. In addition, in fig. 3, a clock control, a voice control, a search control and a read control are also shown in the current screen content, and the text content is "a garden is in front of the house that my grandpa has grandpa" and the word "Dance".

In order to further prompt the user that the electronic device is in the interface locking state, all display contents can be surrounded by a square black frame in fig. 3 to prompt the user to be in a point reading mode, so that the use requirement of the user is further met.

It should be noted that, after the current screen content of the electronic device enters the frozen screen interface, the click-to-read control 11 in the current screen content disappears, and an exit control 12 that controls the current screen content of the electronic device to exit the interface locking state is displayed, as shown in fig. 4, the current screen content includes page content and a preset exit control 12, the exit control 12 is set in a form that a circle includes "X", and when the user triggers the exit control 12, the electronic device may receive an exit request and control the current screen content of the electronic device to exit the interface locking state.

It should be noted that, in the embodiment of the present disclosure, for the operation of exiting the interface lock state, the user may trigger the exit control 12 to control the current screen content of the electronic device to exit the interface lock state, and may also trigger a return key, a home key, a message notification skip application, and the like, and specifically select a setting according to the application scene needs.

Step 202, determining coordinate information of the target position according to the selection operation of the user on the interface locking state, and determining an identification result from the text data according to the coordinate information.

When the interface is in a locked state, acquiring a screenshot corresponding to the current screen content, and performing character recognition on the screenshot to acquire text data, wherein the text data can store text information corresponding to coordinates of each position in the screen, so that the coordinate information of a target position corresponding to an operation can be selected to determine a recognition result from the text data.

Fig. 5 is a schematic diagram of a selection operation provided by an embodiment of the present disclosure, and fig. 5 shows a schematic diagram of a selection operation, where a user clicks a word "Dance" and a selection state is also displayed in fig. 5 by an icon "gesture".

It should be noted that, when it is determined that the recognition result is obtained or not obtained, the control target icon disappears, and when the icon "gesture" is displayed, and when the recognition result is obtained, the selection content corresponding to the selection operation may be displayed in the target color in the current screen content, as shown in fig. 6, the word "Dance" is highlighted, and when the target operation closing the display content on the right side of fig. 6 is detected, the control target color disappears.

When the "move back" control is touched or the non-display content area on the right side of fig. 6 is touched, the above-described prompt form in which all the display contents are surrounded by a square black frame and the target area of the display contents on the right side of fig. 6 disappear. After the target area for displaying the content disappears, namely the target area exits from the result window, the Chinese and English sentences in the current screen content can be continuously clicked for continuous check, and the click of the exit button at the lower right corner enables the click-read mode in the screen to exit.

After step 202, step 203, step 204 or step 205 may be executed, and the execution order of step 203 to step 205 may be determined according to practical situations, which is only an example in fig. 2.

And 203, acquiring a subsequent text of the identification result, acquiring the identification result and the pinyin corresponding to each Chinese character in the subsequent text, and displaying the identification result, the subsequent text and the pinyin corresponding to each Chinese character in the target area in a preset form as display contents.

The recognition result is Chinese, the subsequent text of the recognition result can refer to the first sentence of the ancient poetry as the recognition result, the subsequent text can refer to the remaining poetry of the ancient poetry and also can refer to classically estimated fragments, and the subsequent text is the text of a subsequent story and is specifically selected and set according to an application scene.

In the embodiment of the present disclosure, the subsequent text and the pinyin corresponding to each chinese character may be queried through a preset database, or may be obtained in real time through server query or the like, which is not limited herein, and the database may be preset to improve the query efficiency.

Exemplarily, fig. 7 is a schematic view of a reading in the embodiment of the present disclosure, fig. 7 shows a schematic view of a reading in the current screen interface, and in fig. 7, a garden is located in front of a house whose screen display content is "i grandpa's milk". Flowers, grass, shallots and shallots are depressed and slightly faint fragrance is generated, the grandpa home is visited every time \8230, and the recognition result corresponding to the selection operation is that a garden is arranged in front of the grandpa home milk house. The display content corresponding to the target area display recognition result in the form of a pop-up window on the right side is that a garden is arranged in front of the house of the grandpa of I. The flower, grass, scallion and shallot are depressed, faint scent is generated, every time the Chinese character goes to the grandpa home ", pinyin is added to each Chinese character, and in the picture 7, a closing control, a playing control and a printing control are displayed in the current screen content. Therefore, the display content of the original text plus the pinyin can read any Chinese character aloud, automatically generate the pinyin of the Chinese character (containing Chinese tone), and display each Chinese character in the Chinese sentence and the pinyin thereof in a contrast way, thereby further meeting the learning requirement of the user.

It should be noted that, the display content is relatively many, and the display content can be displayed in the target area in a paging manner, and the page can be turned or automatically played by sliding the user, so that the use requirement of the user is further met.

And 204, translating the recognition result into a Chinese text, and displaying the recognition result and the Chinese text as display contents in a target area in a preset form.

The recognition result is English, and the display content refers to the Chinese text and the recognition result corresponding to English translation.

Exemplarily, fig. 8 is a schematic diagram of a point reading provided by the embodiment of the present disclosure, fig. 8 shows a schematic diagram of a point reading, and in fig. 8, in the current screen interface, the screen display content on the left side is "My grandparents have a garden in front of the family of the people house. The identification result corresponding to the selection operation is My grandimatters have a garden in front of the family house. "the display content corresponding to the recognition result displayed in the target area in the form of a pop-up window on the right side is the recognition result" My representations have a garden in front of the third house. "and corresponding Chinese text" i have a garden in front of the house that grandpa said. The English language translation method can read any English language aloud, automatically generate English sentence translation, and display the English sentence and the translation in a contrast manner, thereby further meeting the learning requirement of the user.

And 205, detecting that the subsequent text of the recognition result is English, acquiring the subsequent English text, translating the recognition result and the subsequent English text into the corresponding Chinese text, and displaying the recognition result, the subsequent English text and the corresponding Chinese text as display contents in a preset form in the target area.

The recognition result is English, and the display content comprises the recognition result, the corresponding Chinese text, the subsequent English text of the recognition result and the corresponding Chinese text.

Exemplarily, fig. 9 is a schematic diagram of a point reading provided by the embodiment of the present disclosure, fig. 9 shows a schematic diagram of a point reading, and in fig. 9, in the current screen interface, the screen display content on the left side is "My grandparents have a garden in front of the family of the people house. Grandpa, soft letters, stores from my childhood. The pure aromatic exotic flowers and plants cultivated by my grandipa for human years in the garden. The identification result corresponding to the selection operation is My grandimatters have a garden in front of the ir house. The display content corresponding to the recognition result displayed in the target area in the form of a popup on the right side is the recognition result "my grandigrams have a garden in front of the family of the ir house. "and corresponding Chinese text" I have a garden in front of the house of grandpa. ", and the subsequent English text" Grandpa, from files from my childhood of the recognition result. "and corresponding Chinese text" grandfather often and I talk about the story of that hour "" the re are exogenous flowers and plants focused by my grandpa for the human year in the garden. "and corresponding Chinese text" the strange grass of strange flower that grandpa cultivated for many years in garden ", further satisfy user's study demand.

And step 206, responding to the click operation of the playing control in the target area, and converting the display content into voice playing.

And displaying the display content corresponding to the recognition result in the target area, setting a play control in order to further improve the learning efficiency, and converting the display content into voice play based on the clicking operation of the user on the play control.

Exemplarily, fig. 10 is a schematic view of click-to-read provided by an embodiment of the present disclosure, and fig. 10 shows a schematic view of click-to-read, in fig. 10, a current screen content of an electronic device is an english learning material display, a selected content is displayed through a box on the left side of fig. 10, a user is prompted to select a content corresponding to an operation, and an identification result of "do Grace drive water every moving? "do you get the Chinese text" drink water every morning with lace? ", on the right side of fig. 10," do Grace drive water event moving? "and the corresponding Chinese text" does lace drink water every morning? Furthermore, in the target area in fig. 10, a play control and a print control are further included, and by triggering the play control, the horn icon in fig. 10 can play the display content. Therefore, under the scenes that the user uses electronic equipment to carry out Chinese or English web lessons, reads Chinese and English picture books and the like, the user can accurately read any sentence in the screen when encountering the scenes that long sentences do not know how to read or have reading requirements, and the learning effect can be improved in a mode of visually and quickly identifying and answering sentence contents in the screen.

The point-reading scheme provided by the embodiment of the disclosure can effectively point-read a plurality of scenes, especially learning scenes such as Chinese and English network courses, on-line question making and reading, book drawing and reading and the like, and when a user recognizes few characters, the user can read out the inexorable Chinese and English words and long and difficult sentences when using the electronic equipment, so that the user can use the electronic equipment more conveniently

The click-to-read scheme provided by the embodiment of the disclosure controls the current screen content of the electronic device to enter an interface locking state based on the trigger operation of a user on a preset click-to-read control in the current screen content during the use of the electronic device, determines the coordinate information of a target position according to the selection operation of the user on the interface locking state, determines a recognition result from text data according to the coordinate information, acquires a subsequent text of the recognition result, acquires the recognition result and the pinyin corresponding to each Chinese character in the subsequent text, displays the recognition result, the subsequent text and the pinyin corresponding to each Chinese character as the display content in a preset form in the target region, or detects that the subsequent text of the recognition result is English, acquires the subsequent English text, translates the recognition result and the subsequent English text into the corresponding Chinese text, displays the recognition result, the subsequent English text and the corresponding Chinese text as the display content in the preset form in the target region, and converts the display content into a voice play control in the target region in response to a click operation of the play control. By adopting the technical scheme, the click-to-read can be performed on any content in the screen content of the electronic equipment, the learning efficiency is improved, and the learning requirement of a user for click-to-read any content is met; and the display content is flexibly determined based on whether the text corresponding to the user selection operation is Chinese or English, and the display content can be played again based on the user click operation, so that the learning range under the network learning scene is further improved, and the learning effect is improved.

Fig. 11 is a schematic structural diagram of a terminal control device provided in an embodiment of the present disclosure, where the terminal control device may be implemented by software and/or hardware, and may be generally integrated in an electronic device. As shown in fig. 11, the apparatus includes:

the response screen freezing module 301 is configured to respond to a preset instruction, and control the current screen content of the electronic device to enter an interface locking state.

The response obtaining module 302 is configured to determine a target position in response to a selection operation of the user on the interface locking state, and obtain an identification result corresponding to the target position.

And a playing and displaying module 303, configured to convert the recognition result into a voice for playing, and obtain a display content corresponding to the recognition result and display the display content in the target area in a preset form.

Optionally, the apparatus further includes a screenshot module and an identification module;

the screenshot module is used for: when the interface is in a locked state, acquiring a screenshot corresponding to the current screen content; the recognition module is used for carrying out character recognition on the screenshot and acquiring text data.

Optionally, the response obtaining module 302 is specifically configured to:

determining coordinate information of the target position according to the selection operation; and determining a recognition result from the text data according to the coordinate information.

Optionally, the apparatus further includes a status display module, configured to:

and displaying the current screen content by using a preset prompt identifier to prompt that the electronic equipment is in an interface locking state.

Optionally, the apparatus further includes a detection display module, configured to: and displaying the target icon when in selection operation.

Optionally, the apparatus further includes a display control module, configured to:

and when the identification result is obtained, displaying the selected content corresponding to the selection operation in the current screen content in a target color, and when the operation of closing the displayed content is detected, controlling the target color to disappear.

Optionally, when the electronic device is in a full-screen video playing state, the current screen content is a current video frame, and in an interface locking state, the playing video application keeps playing audio.

Optionally, the playing and displaying module 303 is specifically configured to:

acquiring a subsequent text of the recognition result, and acquiring the recognition result and pinyin corresponding to each Chinese character in the subsequent text;

and taking the recognition result, the subsequent text and the pinyin corresponding to each Chinese character as display contents to be displayed in the target area in a preset form.

and translating the recognition result into a Chinese text, and displaying the recognition result and the Chinese text as display contents in a preset form in the target area.

detecting that a subsequent text of the recognition result is English, and acquiring the subsequent English text;

and translating the recognition result and the subsequent English text into corresponding Chinese text, and displaying the recognition result, the subsequent English text and the corresponding Chinese text as display contents in a preset form in the target area.

Optionally, the apparatus further includes a response playing module, configured to:

responding to the click operation of a play control in the target area, and converting the display content into voice play; or the like, or, alternatively,

and responding to the selection operation of any content in the target area, and converting the selected content into voice playing.

The terminal control device provided by the embodiment of the disclosure can execute the terminal control method provided by any embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.

Embodiments of the present disclosure also provide a computer program product, which includes a computer program/instruction, and when the computer program/instruction is executed by a processor, the terminal control method provided in any embodiment of the present disclosure is implemented.

Fig. 12 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. Referring now specifically to fig. 12, a schematic diagram of a structure suitable for implementing an electronic device 400 in an embodiment of the present disclosure is shown. The electronic device 400 in the disclosed embodiment may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle mounted terminal (e.g., a car navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 12 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 12, electronic device 400 may include a processing device (e.g., central processing unit, graphics processor, etc.) 401 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM) 402 or a program loaded from a storage device 408 into a Random Access Memory (RAM) 403. In the RAM403, various programs and data necessary for the operation of the electronic apparatus 400 are also stored. The processing device 401, the ROM 402, and the RAM403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.

Generally, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 407 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 408 including, for example, tape, hard disk, etc.; and a communication device 409. The communication means 409 may allow the electronic device 400 to communicate wirelessly or by wire with other devices to exchange data. While fig. 12 illustrates an electronic device 400 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be alternatively implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 409, or from the storage device 408, or from the ROM 402. The computer program, when executed by the processing device 401, performs the above-described functions defined in the terminal control method of the embodiment of the present disclosure.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (Hyper Text Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may be separate and not incorporated into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: receiving information display triggering operation of a user in the video playing process; acquiring at least two pieces of target information related to the video; displaying first target information in the at least two pieces of target information in an information display area of a playing page of the video, wherein the size of the information display area is smaller than that of the playing page; and receiving a first switching trigger operation of a user, and switching the first target information displayed in the information display area into second target information of the at least two pieces of target information.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of an element does not in some cases constitute a limitation on the element itself.

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided a terminal control method including:

According to one or more embodiments of the present disclosure, the terminal control method further includes:

when the interface is in a locked state, acquiring a screenshot corresponding to the current screen content;

and performing character recognition on the screenshot to obtain text data.

According to one or more embodiments of the present disclosure, in a terminal control method provided by the present disclosure, determining a target position in response to a selection operation of a user on an interface lock state, and acquiring an identification result corresponding to the target position includes:

determining coordinate information of the target position according to the selection operation;

and determining a recognition result from the text data according to the coordinate information.

and displaying the target icon when in selection operation.

and when the identification result is obtained, displaying the selected content corresponding to the selection operation in the current screen content in the target color, and when the operation of closing the displayed content is detected, controlling the target color to disappear.

According to one or more embodiments of the present disclosure, in a terminal control method provided by the present disclosure, when an electronic device is in a full-screen video playing state, a current screen content is a current video frame, and in an interface locking state, a video playing application keeps playing an audio.

According to one or more embodiments of the present disclosure, a terminal control method provided by the present disclosure, in which a recognition result is chinese, and display content corresponding to the recognition result is acquired, includes:

and taking the recognition result, the subsequent text and the pinyin corresponding to each Chinese character as display content.

According to one or more embodiments of the present disclosure, a terminal control method provided by the present disclosure, in which a recognition result is english, and display content corresponding to the recognition result is acquired, includes:

translating the recognition result into a Chinese text, and taking the recognition result and the Chinese text as display contents.

and translating the recognition result and the subsequent English text into corresponding Chinese texts, and taking the recognition result, the subsequent English text and the corresponding Chinese text as display contents.

responding to the click operation of the playing control in the target area, and converting the display content into voice playing; or the like, or, alternatively,

According to one or more embodiments of the present disclosure, there is provided a terminal control apparatus including:

the response screen freezing module is used for responding to a preset instruction and controlling the current screen content of the electronic equipment to enter an interface locking state;

and the playing display module is used for converting the recognition result into voice playing and acquiring display content corresponding to the recognition result to display in the target area in a preset form.

According to one or more embodiments of the present disclosure, the terminal control device provided by the present disclosure further includes a screenshot module and an identification module;

According to one or more embodiments of the present disclosure, in a terminal control apparatus provided by the present disclosure, the response obtaining module 302 is specifically configured to:

According to one or more embodiments of the present disclosure, the terminal control device further includes a status display module configured to:

According to one or more embodiments of the present disclosure, the terminal control apparatus further includes a detection display module, configured to:

and displaying the target icon when in selection operation.

According to one or more embodiments of the present disclosure, the terminal control device further includes a display control module configured to:

According to one or more embodiments of the present disclosure, in a terminal control apparatus provided by the present disclosure, when an electronic device is in a full-screen video playing state, a current screen content is a current video frame, and in an interface locking state, a video playing application is played to keep audio playing.

According to one or more embodiments of the present disclosure, in the terminal control device provided by the present disclosure, the playing and displaying module 303 is specifically configured to:

and displaying the recognition result, the subsequent text and the pinyin corresponding to each Chinese character as display contents in a preset form in the target area.

and translating the recognition result and the subsequent English text into corresponding Chinese texts, and displaying the recognition result, the subsequent English text and the corresponding Chinese texts in a target area in a preset form by taking the recognition result, the subsequent English text and the corresponding Chinese text as display contents.

According to one or more embodiments of the present disclosure, in the terminal control device provided by the present disclosure, the device further includes a response playing module, configured to:

responding to the click operation of a play control in the target area, and converting the display content into voice play; or the like, or a combination thereof,

In accordance with one or more embodiments of the present disclosure, there is provided an electronic device including:

a processor;

a memory for storing the processor-executable instructions;

the processor is configured to read the executable instructions from the memory and execute the instructions to implement any of the terminal control methods provided in this disclosure.

According to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing any of the terminal control methods provided by the present disclosure.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A terminal control method, comprising:

2. The terminal control method according to claim 1, further comprising:

and performing character recognition on the screenshot to obtain text data.

3. The terminal control method according to claim 2, wherein the determining a target position in response to the user selecting the interface lock state and obtaining an identification result corresponding to the target position includes:

and determining the recognition result from the text data according to the coordinate information.

4. The terminal control method according to claim 1, further comprising:

5. The terminal control method according to claim 1, further comprising:

and displaying a target icon in response to triggering the selection operation.

6. The terminal control method according to claim 1, further comprising:

and when the identification result is obtained, displaying the selected content corresponding to the selection operation in a target color in the current screen content, and when the operation of closing the displayed content is detected, controlling the target color to disappear.

7. The terminal control method according to claim 1,

and when the electronic equipment is in a full-screen video playing state, the current screen content is a current video frame, and in the interface locking state, the playing video application keeps audio playing.

8. The terminal control method according to claim 1, wherein the recognition result is chinese, and the acquiring the display content corresponding to the recognition result includes:

and taking the recognition result, the subsequent text and the pinyin corresponding to each Chinese character as the display content.

9. The terminal control method according to claim 1, wherein the recognition result is english, and the acquiring the display content corresponding to the recognition result includes:

and translating the recognition result into a Chinese text, and taking the recognition result and the Chinese text as the display content.

10. The terminal control method according to claim 1, wherein the recognition result is english, and the acquiring the display content corresponding to the recognition result includes:

and translating the recognition result and the subsequent English text into corresponding Chinese texts, and taking the recognition result, the subsequent English text and the corresponding Chinese text as the display content.

11. The terminal control method according to any one of claims 1 to 10, further comprising:

12. A terminal control device, comprising:

13. An electronic device, characterized in that the electronic device comprises:

a processor;

a memory for storing the processor-executable instructions;

the processor is configured to read the executable instructions from the memory and execute the instructions to implement the terminal control method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that the storage medium stores a computer program for executing the terminal control method according to any one of claims 1 to 9.