WO2021197094A1

WO2021197094A1 - Translation text display

Info

Publication number: WO2021197094A1
Application number: PCT/CN2021/081742
Authority: WO
Inventors: 胡伟韬; 潘勇; 顾健旭; 李岩
Original assignee: 支付宝实验室(新加坡)有限公司
Priority date: 2020-04-02
Filing date: 2021-03-19
Publication date: 2021-10-07
Also published as: CN111553172A

Abstract

The embodiments of the present description disclose a translation text display method and device, a system, and a storage medium, which are applied to a mobile terminal. Said method comprises: upon detection of a translation start operation of a user, capturing current screen content on a mobile terminal to obtain a target screenshot, the target screenshot containing more than one object to be translated; and displaying the target screenshot, creating, for each of said objects on the target screenshot, a translation display overlay in a text line region where said objects are located, and adding a translation corresponding to said object to the corresponding translation display overlay for display.

Description

Translation copy display

Technical field

The embodiments of this specification relate to the field of display, and in particular to a method, system and storage medium for displaying translated texts.

Background technique

With the development of business in multiple countries, App users have expanded to multiple countries, and the App has multi-language support to provide a better user experience. Therefore, users hope to understand the scene by translating the text displayed in the APP.

Summary of the invention

The embodiments of this specification provide a translation copy display method, system and storage medium, so that the translation copy UI has user interaction capabilities, and it is convenient for users to compare the translation copy with the original copy.

In the first aspect, the embodiment of this specification provides a translation copy display method, which is applied to a mobile terminal, and the method includes: if a user's translation start operation is detected, intercepting the current screen content of the mobile terminal to obtain a target screenshot, The target screenshot contains more than one translation object; the translation copy of each translation object on the target screenshot is obtained; the target screenshot is displayed, and for each translation object on the target screenshot, the translation object is located A translation display floating layer is created in the text line area, and the translation text corresponding to the translation object is added to the translation display floating layer for display.

In the second aspect, the embodiment of this specification provides a translation copy display device, which is applied to a mobile terminal, and the device includes: a first operation detection unit configured to intercept the current translation of the mobile terminal if the user's translation start operation is detected Screen content, obtain a target screenshot, the target screenshot contains more than one translation object; a copy acquisition unit, used to obtain the translation copy of each translation object on the target screenshot; a copy display unit, used to display the target screenshot, And for each translation object on the target screenshot, a translation display floating layer is created in the text line area where the translation object is located, and the translation copy corresponding to the translation object is added to the translation display floating layer for display .

In a third aspect, an embodiment of this specification provides a translation system, including: a mobile terminal, configured to intercept the current screen content of the mobile terminal to obtain a target screenshot if a user's translation activation operation is detected, and send the target screenshot to The server side, the target screenshot contains more than one translation object; the server side, is used to process the target screenshot to obtain the translation copy of each translation object on the target screenshot, and send the translation copy to the The mobile terminal; the mobile terminal is also used to display the target screenshot, and for each translation object on the target screenshot, create a translation display floating layer in the text line area of the translation object, which will be compared with the The translation copy corresponding to the translation object is added to the translation display floating layer for display.

In a fourth aspect, an embodiment of the present specification provides a mobile terminal, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor. The processor implements the program described in the first aspect when the program is executed. Method steps.

In a fifth aspect, the embodiments of this specification provide a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the method described in the first aspect are implemented.

The one or more technical solutions provided in the embodiments of this specification at least achieve the following technical effects: the target screenshot is obtained by intercepting the screen content containing the translation object, and the translation display floating layer is created in the text line area where the translation object is located on the target screenshot. Display the translation copy of the translation object, so that the translation copy will not replace the translation object, but the translation copy and the translation object can exist at the same time, which facilitates the comparison between the translation copy and the translation object, and improves the user experience.

Further, if the translation copy display method provided by the embodiment of this specification is applied to the text translation displayed on the APP page, it is convenient for the user to understand the scene content displayed in the APP more quickly and accurately.

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only It is an embodiment of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on the provided drawings without creative work.

Figure 1 is a system architecture diagram of the translation system in the embodiment of the specification;

Figure 2 is a schematic flow diagram of a method for displaying translated text in an embodiment of the specification;

Figure 3 is a schematic diagram of a screenshot of a target captured in an embodiment of the specification;

Figure 4 is a schematic diagram showing the effect of the translation copy in the embodiment of the specification;

Figure 5 is a schematic diagram showing the effect of unfolding the translation to show the floating layer in the embodiment of the specification;

FIG. 6 is a schematic diagram of the effect of moving the translation to display the floating layer in the embodiment of the specification;

FIG. 7 is a schematic diagram of the effect of the translation copy display device in the embodiment of the specification;

Fig. 8 is a schematic structural diagram of a mobile terminal in an embodiment of this specification.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

In the first aspect, the embodiments of this specification provide a translation system architecture that implements the method for displaying translated texts. Referring to FIG. 1, the translation system includes a mobile terminal 10 and a server 20.

In the embodiment of this specification, the mobile terminal 10 may be a terminal device such as a smart phone, a tablet computer, etc. If the mobile terminal 10 detects the user's translation start operation, it will intercept the current screen content of the mobile terminal 10 to obtain the corresponding screen content. Target screenshot, where the target screenshot contains more than one translation object. The mobile terminal 10 sends the target screenshot to the server 20.

The server 20 is used to process the target screenshot, obtain the translation copy of each translation object on the target screenshot, and send the translation copy to the mobile terminal 10. A text detection model and a translation model are deployed on the server 20. The server 20 detects each translation object from the target screenshot received from the mobile terminal 10 through the text detection model, and then translates each translation object through the translation model. The translation copy corresponding to the translation object is obtained, and the server 20 feeds back each translation copy to the mobile terminal 10.

The target screenshot is displayed on the mobile terminal 10, a translation display floating layer is created in the text line area of each translation object on the target screenshot, and the translation text corresponding to the translation object is added to the corresponding translation display floating layer for display, so that the translation The copy is floating on the upper layer corresponding to the translation object on the target screenshot, thereby ensuring that the translation copy and the translation object can exist at the same time, and it is convenient for users to compare the content between the translation copy and the translation object.

Specifically, a target application is installed on the mobile terminal 10, and the target application may be a social application, a shopping application, and other apps that have requirements for delivery in multiple countries. Add a translation applet in the target application. When the target application is running in the foreground, the mobile terminal 10 interacts with the server 20 through the translation applet to realize a block of text content displayed in the application page of the target application (for example, a text content block). It is a translation object) for translation, and the translation copy corresponding to the text content block is displayed in the text line area where the text content block is located in the form of a translation display floating layer, so that the translation copy floats on the upper layer of the text content block. Of course, in the specific implementation process, a translation application can also be installed in the mobile terminal 10, and the translation application interacts with the server 20 through the translation application to implement translation of the text content block displayed in the application page of any foreground running application on the mobile terminal 10. , And display the translation copy corresponding to the text content block in the form of translation display floating layer.

In the second aspect, the embodiment of this specification provides a method for displaying translated text, which is applied to the mobile terminal as shown in FIG. 1. The following describes the translation copy display method provided by the embodiment of this specification with reference to FIG. 1 and FIG. 2. Fig. 2 is a schematic flow chart of the method for displaying a translation copy in an embodiment of the specification. The method for displaying a translation copy provided in an embodiment of the specification includes the following steps S200-S204:

S200. If the mobile terminal detects the user's translation start operation, it intercepts the current screen content of the mobile terminal to obtain a target screenshot corresponding to the current screen content, and the target screenshot contains more than one translation object.

In the embodiment of this specification, the translation applet added in the target application is started, and the translation applet after the startup is provided to the user for the translation operation portal, and the user performs the translation start operation through the translation operation portal.

Specifically, the translation operation entry may be as shown in FIG. 3, which is displayed in a fixed position on the application page with a floating button component, for example, a floating button component implemented with a fixed div, displayed in the lower right corner of the current screen. If the user's click operation on the virtual floating button component is detected, the current screen content of the mobile terminal is captured to obtain a target screenshot corresponding to the current screen content. The target screenshot may be: a screenshot image obtained by taking a screenshot of the mobile terminal or scrolling the screenshot, the screenshot image contains the current application page of the target application, and the screenshot image can be referred to as shown in FIG. 3. Or the target screenshot may be a screenshot of the application page obtained by taking a screenshot of the current application page of the target application.

In the embodiment of this specification, the target screenshot contains more than one translation object. Each translation object is more than one text in the form of an image in the target screenshot. Each translation object on the target screenshot is independent of each other.

S202. The mobile terminal obtains the translation text of each translation object in the target screenshot.

In the embodiment of this specification, by processing the target screenshot, the translation copy of each translation object on the target screenshot is obtained. The process of processing the target screenshot to obtain the translated text can be executed by the mobile terminal or the server. In view of the large amount of calculation in the processing process, it is best to be executed by the server.

Below, the process of interacting between the mobile terminal and the server to obtain the translation copy of each translation object in the target screenshot will be described in detail:

The mobile terminal sends the target screenshot to the server. The server performs text detection on the received target screenshot through the text detection model, and obtains each translation object on the target screenshot. Specifically, the text detection model may be an OCR (Optical Character Recognition) model. The OCR model is used to perform OCR recognition on the target screenshot to obtain a recognition result queue. Among them, the recognition result queue contains more than one recognition result, the recognition result and the translation object are one object, each recognition result contains the translation object in text format, and the relative coordinate information of the text line area where the translation object is located. The translation object represented in the text format in the recognition result can be a single word, a single word, a sequence of words, or more than one sentence. Next, for each recognition result in the recognition result queue, the server translates the translation object represented in the text format in the recognition result through the translation model, and obtains the translation copy corresponding to the translation object. The server feeds back each translation text it gets to the mobile terminal. Thus, the mobile terminal receives the translation copy of each translation object on the target screenshot from the server.

The process of processing the target screenshot on the mobile terminal to obtain the translation copy is similar to the aforementioned process of processing the target screenshot to obtain the translation copy.

S204. Display the target screenshot on the mobile terminal, and for each translation object in the target screenshot, create a translation display floating layer within the text line area of the translation object, and add the translation copy corresponding to the translation object to the corresponding translation display Display in the floating layer.

In the specific implementation process, the specific execution sequence of step S204 may be: create translation display floating layers in the text line area where each translation object is located on the target screenshot, and write the floating layer in the container of each translation display floating layer. The translation copy corresponding to the translation object, in order to obtain the result of the splicing of the target screenshot and the translation copy, and display the splicing result, so as to avoid the loss of the original copy information caused by the translation copy cover and the replacement of the translation target, and to avoid the user's translation The inconvenience caused by the understanding of the content.

In the specific implementation process, the specific execution order of step S204 can also be: first display the target screenshot after obtaining the target screenshot, and create the i-th translation display after obtaining the i-th translation copy corresponding to the i-th translation object on the target screenshot Floating layer and write the i-th translation copy in the i-th translation display floating layer, and add the i-th translation display floating layer after the i-th translation copy is written into the text line area where the i-th translation object is located on the target screenshot.

In many cases, the size of the translation copy is different from the size of the translation object. By creating a translation display floating layer within the text line area where the translation object is located, only the text line area where the corresponding translation object is located will be blocked instead of replacing the corresponding translation object. Moreover, the text line area where other translation objects are located will not be obstructed, thereby avoiding mutual obscuration between different translation texts.

The following is a detailed description of the process of creating a translation display floating layer on the target screenshot and the process of displaying the translation copy in the translation display floating layer:

①Create translation display floating layer:

Specifically, the implementation process of creating a translation display floating layer is: for each translation object on the target screenshot, determine the relative coordinate information of the text line area where the translation object is located. The target screenshot contains N translation objects, and N is a positive integer; The relative coordinate information of the text line area where the i-th translation object is located on the target screenshot, creates a floating layer of the i-th translation display that matches the text line area where the i-th translation object is located, and i takes 1 to N in turn.

Specifically, according to the relative coordinate information of the text line area where the i-th translation object is located, determine the area size and area position of the text line area where the i-th translation object is located; create the same area size of the text line area where the i-th translation object is located. The i-th translation display floating layer, according to the area position of the text line area where the i-th translation object is located, adds the i-th translation display floating layer to the upper layer of the target screenshot to cover the text line area where the i-th translation object is located.

It should be noted that the relative coordinate information of the text line area where each translation object is located specifically refers to: the diagonal coordinates (x1, y1), (x2, y2) of the text line area where the translation object is located. In the embodiment of this specification, the relative coordinate information of the text line area where each translation object is located on the target screenshot also comes from the server, which has been explained in the foregoing and will not be repeated here.

Through the above method of creating a translation display floating layer on the target screenshot, each created translation display floating layer will not cover the text line area where any translation object except the corresponding translation object is located, showing the effect of the translation copy. Refer to Figure 4 to improve the display effect of the translated text.

②Display the translation copy in each translation display floating layer:

Specifically, according to the original floating layer size of the i-th translation display floating layer, the i-th translation copy is displayed in the i-th translation display floating layer, and i is sequentially selected from 1 to N to more rationally translate the copy. The embodiment of this specification provides two implementation modes: Implementation mode one:

Compare whether the original floating layer size of the i-th translation display floating layer is greater than or equal to the size of the i-th translation copy; if so, display the complete translation content of the i-th translation copy in the i-th translation display floating layer; otherwise, according to the i-th translation Display the original floating layer size of the floating layer, and display part of the translation content of the i-th translation copy in the i-th translation display floating layer.

Further, in order to display part of the translation content of the i-th translation copy in the i-th translation display floating layer, if the user's expansion operation on the i-th translation display floating layer is detected, expand the i-th translation display floating layer; Display the complete translation content of the i-th translation copy in the expanded float size of the i-th translation display floating layer. If it is detected that the user restores the i-th translation display floating layer after unfolding, the original floating layer size of the i-th translation display floating layer and the partial translation content of the i-th translation copy displayed in the original floating layer size are restored.

Specifically, the trigger operation for expanding and restoring the i-th translation display floating layer can be predefined as any of the following:

①, when the stay operation on the i-th translation display floating layer is detected, expand the i-th translation display floating layer according to the size of the corresponding i-th translation copy; when the leaving operation on the i-th translation display floating layer is detected, Restore the original floating layer size of the i-th translation to show the floating layer.

②, when the click operation on the i-th translation display floating layer is detected, expand the i-th translation display floating layer according to the size of the i-th translation copy; after the i-th translation display floating layer is expanded for the preset duration, or after the detection of the right After unfolding, when the i-th translation display floating layer is clicked, the original floating layer size of the i-th translation display floating layer is restored.

③, when the two-finger sliding operation of the i-th translation display floating layer is detected, expand the i-th translation display floating layer according to the size of the i-th translation copy, and the two-finger folding operation of the i-th translation display floating layer after the expansion is detected When, restore the original floating layer size of the i-th translation to show the floating layer.

In the specific implementation process, an expandable mark is set on each expandable translation display floating layer on the target screenshot. Refer to the triangle mark set on the translation display floating layer as shown in Figure 4 to identify the expandable translation display floating layer. , It is convenient for users to distinguish whether the translation display floating layer can be expanded, and the user experience is improved.

Through the first embodiment of displaying the translation copy in the translation display floating layer, the unfolding effect of the translation display floating layer can be referred to as shown in Figure 5. Figure 5 illustrates the translation copy corresponding to the translation object "cross-border traffic" The effect of unfolding shows that the translation copy UI has user-interactive capabilities, which enables users to quickly view the complete translation content through gesture operations, avoiding the problem of excessively long translated copy text and incomplete display.

Implementation mode two:

According to the original floating layer size of the i-th translation display floating layer and the size of the i-th translation copy to be displayed, calculate the text size for displaying the i-th translation copy; use the calculated text size to display the translation copy in the translation display floating layer The complete translation content of. Thus, by adjusting the text size, the complete translation content corresponding to the i-th translation copy is displayed in the i-th translation display floating layer. When the expansion operation of the i-th translation display floating layer is detected, the complete translation content corresponding to the i-th translation copy is displayed in the expansion floating layer size of the i-th translation display floating layer with a preset standard text size.

Through the second implementation manner of displaying the translation text in the translation display floating layer, the problem of the text of the translation text being too long and unclear is avoided, and the content of the translation can be clearly displayed through gesture operations.

Further, in order to facilitate the user to compare the translation object and the translation copy, the floating layer is displayed for each translation created on the target screenshot. If the user's movement operation on the translation display floating layer is detected, it will be based on the operation of the movement operation. The information moves the translation display floating layer so that the translation copy that shields the translation object can be moved to other areas, so that the translation object and the translation copy can be displayed at the same time, so as to compare the content before and after translation, and show the moving effect of the floating layer in the translation. Refer to Figure 6, which illustrates the effect of moving the translation text corresponding to the translation object "cross-border traffic".

In an optional implementation manner, in order to facilitate the user to move the translation display floating layer through a gesture operation, the movement operation is specifically a drag operation. For any translation display floating layer on the target screenshot, obtain the drag trajectory of the user's drag operation on the translation display floating layer; move the translation display floating layer according to the drag trajectory to move to the text line area corresponding to the translation object Outside. When the end of the drag operation is detected, the translation display floating layer is moved back to the original display area of the translation display floating layer. It should be noted that the original display area of the translation display floating layer is the text line corresponding to the translation object. area. According to the relative coordinate information of the text line area where the corresponding translation object is located, the translation display floating layer is moved back to the original display area of the translation display floating layer. Avoid the floating layer of the translated translation after moving to affect the display of other translation texts.

Or, when the end of the drag operation is detected, the position coordinates at the end of the drag operation are determined, and the translation display floating layer stays on the target screenshot according to the position indicated by the position coordinates.

Take the i-th translation display floating layer as an example, if the user's drag operation on the i-th translation display floating layer is detected, the i-th translation display floating layer is moved according to the drag trajectory of the drag operation, and the drag operation ends When, move the i-th translation display floating layer back to the text line area where the i-th translation object is displayed.

In order to further improve the efficiency of interaction, click and drag operations can be combined to display the translated text of the translated text and display the floating layer to improve the user experience of multilingual translation:

For any translation display floating layer displayed on the target screenshot: when the user's click operation on the translation display floating layer is detected, the translation display floating layer is expanded from the original floating layer size, and the floating layer is displayed in the translation. The full translation content of the corresponding translation copy is displayed within the expanded floating layer size of the layer. If the user continues to perform a drag operation on the translation display floating layer after the click operation, the drag operation will be detected and the expanded translation will be displayed The floating layer moves according to the drag trajectory of the drag operation. In this process, the corresponding translation object and translation copy will be presented at the same time. When it is detected that the drag operation of the translation display floating layer is completed, the translation display floating layer is moved back to the text line area where the translation object is located, so as to avoid subsequent impact on other content.

In this way, the user can complete the complete translation view of the translation text and the comparison before and after translation with only one continuous gesture operation formed by clicking + dragging. For users, it is convenient and fast, and is in line with the use characteristics of mobile terminals.

Further, in order to facilitate user operations and improve user experience, if a user's translation hiding operation is detected, each translation display floating layer created on the target screenshot is hidden to show each translation object. In combination with the foregoing embodiment, the translation hiding operation may be a clicking operation on the translation operation entry.

Specifically, when the current screen content of the mobile terminal is the application page of the target application, if a click operation of the floating button component set in a fixed position on the current screen is detected, steps S200 to S204 are executed to display the target screenshot Each translation text is displayed in the floating layer of the translation; the current screen content of the mobile terminal is displayed in the floating layer of the translation when the target screenshot of each translation text is displayed, if the click of the floating button component is detected Operation, hide each translation display floating layer displayed on the target screenshot to show the user each translation object on the target screenshot. Therefore, the user's operation complexity is reduced, and multiple interactive operations are realized with a single floating virtual button, which is more concise and more convenient to operate.

In the third aspect, the embodiment of this specification provides a translation copy display device, which is applied to a mobile terminal. As shown in FIG. 7, the device includes: a first operation detection unit 701, configured to capture the current screen content of the mobile terminal if the user's translation start operation is detected to obtain a target screenshot, the target screenshot containing more than one Translation object; copy acquisition unit 702, used to obtain the translation copy of each translation object on the target screenshot; the first copy display unit 703, used to display the target screenshot, and for each translation object on the target screenshot , Creating a translation display floating layer in the text line area where the translation object is located, and adding the translation text corresponding to the translation object to the translation display floating layer for display.

In an optional implementation manner, the first copywriting display unit 703 includes: a coordinate determination subunit, configured to determine the relative coordinate information of the text line area where the translation object is located for each translation object on the target screenshot , The target screenshot contains N translation objects, and N is a positive integer; the floating layer creation unit is used to create a translation with the i-th translation object based on the relative coordinate information of the text line area where the i-th translation object is located on the target screenshot The i-th translation that matches the text line area where the object is located displays the floating layer, and i takes 1 to N in turn.

In an alternative embodiment, the first copywriting display unit 703 includes: a comparison subunit for comparing whether the original floating layer size of the i-th translation display floating layer is greater than or equal to the i-th translation copy The size of i is taken from 1 to N in turn; the content display subunit is used to display the complete translation content of the i-th translation copy within the original floating layer size of the i-th translation display floating layer, otherwise, according to The i-th translation shows the original floating layer size of the floating layer, and part of the translated content of the i-th translation copy is displayed within the original floating layer size of the i-th translation display floating layer.

In an optional embodiment, the device further includes: a second operation detection unit 705, configured to display part of the translation content of the i-th translation copy within the original floating layer size of the i-th translation display floating layer , If the user's expansion operation on the i-th translation display floating layer is detected, then the i-th translation display floating layer will be expanded; Within the layer size, the complete translation content of the i-th translation copy is displayed.

In an optional implementation manner, the device further includes: a copywriting moving unit 704, configured to display a floating layer for each translation created on the target screenshot, and if a user's movement operation on the translation display floating layer is detected , Then move the translation display floating layer according to the operation information of the moving operation.

In an optional embodiment, the moving operation is a dragging operation, and the copywriting moving unit 704 includes: a drag trajectory subunit for acquiring the drag operation performed by the user on the translation display floating layer Trajectory, to move the translation display floating layer according to the dragging trajectory; an end determination subunit for moving the translation display floating layer back to the translation display when the end of the drag operation is detected The original display area of the floating layer, or the position coordinates at the end of the drag operation are determined, and the translation display floating layer stays on the target screenshot according to the position indicated by the position coordinates.

In an optional implementation manner, the copywriting acquisition unit 702 includes: a screenshot sending subunit, configured to send the target screenshot to the server, so that the server processes the target screenshot to generate the The translation copy of each translation object on the target screenshot; the copy receiving subunit is used to receive the translation copy corresponding to the translation object fed back by the server for each translation object on the target screenshot.

In an optional implementation manner, the device further includes: a copy hiding unit 707, configured to hide each translation display floating layer created on the target screenshot if the user's translation hiding operation is detected.

In the fourth aspect, based on the same inventive concept as the translation copy display method in the foregoing embodiment, an embodiment of this specification also provides a mobile terminal. As shown in FIG. 8, the server includes a memory 804, a processor 802, and a memory 804. A computer program that can be run on the processor 802. When the processor 802 executes the program, the steps in any of the foregoing embodiments of the translation copy presentation method are implemented.

Wherein, in FIG. 8, the bus architecture (represented by a bus 800), the bus 800 can include any number of interconnected buses and bridges, and the bus 800 will include one or more processors represented by the processor 802 and a memory 804 represented by The various circuits of the memory are linked together. The bus 800 may also link various other circuits such as peripheral devices, voltage regulators, power management circuits, etc., which are all known in the art, and therefore, no further description is provided herein. The bus interface 805 provides an interface between the bus 800 and the receiver 801 and the transmitter 803. The receiver 801 and the transmitter 803 may be the same element, that is, a transceiver, which provides a unit for communicating with various other devices on the transmission medium. The processor 802 is responsible for managing the bus 800 and general processing, and the memory 804 may be used to store data used by the processor 802 when performing operations.

In the fifth aspect, based on the same inventive concept as the translation copy display method in the foregoing embodiment, the embodiment of this specification also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the foregoing Describe the steps of the translation copy display method.

This specification is described with reference to flowcharts and/or block diagrams of methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are used to generate It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

Although the specific embodiments of this specification have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including all changes and modifications that have determined the embodiments and fall within the scope of this specification.

Obviously, those skilled in the art can make various changes and modifications to this specification without departing from the spirit and scope of the specification. In this way, if these modifications and variations of this specification fall within the scope of the claims of this specification and their equivalent technologies, this specification is also intended to include these modifications and variations.

Claims

A method for displaying translation texts, applied to a mobile terminal, and the method includes:

If the user's translation start operation is detected, intercept the current screen content of the mobile terminal to obtain a target screenshot, and the target screenshot contains more than one translation object;

Obtain the translation copy of each translation object on the target screenshot;

Display the target screenshot, and for each translation object on the target screenshot, create a translation display floating layer in the text line area where the translation object is located, and add the translation copy corresponding to the translation object to the translation Display in the display floating layer.
The method according to claim 1, wherein for each translation object on the target screenshot, creating a translation display floating layer in the text line area where the translation object is located includes:

For each translation object on the target screenshot, determine the relative coordinate information of the text line area where the translation object is located, the target screenshot contains N translation objects, and N is a positive integer;

According to the relative coordinate information of the text line area where the i-th translation object is located on the target screenshot, an i-th translation display floating layer that matches the text line area where the i-th translation object is located is created, and i takes 1 to N in turn.
The method according to claim 2, wherein the adding the translation copy corresponding to the translation object to the translation display floating layer for display comprises:

Comparing the i-th translation to show whether the original floating layer size of the floating layer is greater than or equal to the size of the i-th translation copy, and i takes 1 to N in turn;

If yes, display the complete translation content of the i-th translation copy within the original floating layer size of the i-th translation display floating layer; otherwise, display the original floating layer size of the i-th translation based on the original floating layer size of the i-th translation display floating layer. Part of the translation content of the i-th translation copy is displayed in the original floating layer size of the i-th translation display floating layer.
The method according to claim 3, after displaying part of the translation content of the i-th translation copy within the original floating layer size of the i-th translation display floating layer, further comprising:

If the user's expansion operation on the i-th translation display floating layer is detected, expand the i-th translation display floating layer;

Within the unfolded floating layer size of the i-th translation display floating layer, the complete translation content of the i-th translation copy is displayed.
The method according to any one of claims 1 to 4, for each translation object on the target screenshot, after creating a translation display floating layer in the text line area where the translation object is located, the method further comprises:

For each translation display floating layer created on the target screenshot, if a user's movement operation on the translation display floating layer is detected, the translation display floating layer is moved according to the operation information of the moving operation.
The method according to claim 5, wherein the moving operation is a drag operation, and the moving the translation display floating layer according to the operation information of the moving operation comprises:

Acquiring a drag trajectory of a drag operation performed by a user on the translation display floating layer, and moving the translation display floating layer according to the drag trajectory;

When the end of the drag operation is detected, the translation display floating layer is moved back to the original display area of the translation display floating layer, or the position coordinates at the end of the drag operation are determined, and the translation The display floating layer stays at the position indicated by the position coordinates on the target screenshot.
The method according to claim 1, wherein the obtaining the translation copy of each translation object on the target screenshot includes:

Sending the target screenshot to the server, so that the server processes the target screenshot to generate a translation copy of each translation object on the target screenshot;

For each translation object on the target screenshot, a translation copy corresponding to the translation object fed back by the server is received.
The method according to claim 1, after creating a translation display floating layer in the text line area of each translation object on the target screenshot, the method further comprises:

If the user's translation hiding operation is detected, the display floating layer of each translation created on the target screenshot is hidden.
A translation copy display device applied to a mobile terminal, the device comprising:

The first operation detection unit is configured to, if a user's translation start operation is detected, intercept the current screen content of the mobile terminal to obtain a target screenshot, and the target screenshot contains more than one translation object;

The copywriting acquisition unit is used to obtain the translation copy of each translation object on the target screenshot;

The copywriting display unit is used to display the target screenshot, and for each translation object on the target screenshot, create a translation display floating layer in the text line area where the translation object is located, and convert the translation corresponding to the translation object The copy is added to the translation display floating layer for display.
9. The device of claim 9, wherein the copy display unit comprises:

The coordinate determination subunit is used to determine the relative coordinate information of the text line area where the translation object is located for each translation object on the target screenshot, the target screenshot contains N translation objects, and N is a positive integer;

The floating layer creation unit is used to create an i-th translation display floating layer matching the text line region where the i-th translation object is located according to the relative coordinate information of the text line region where the i-th translation object is located on the target screenshot, and i is taken in turn 1 to N.
The device according to claim 10, wherein the copy display unit comprises:

The comparison sub-unit is used to compare whether the original floating layer size of the i-th translation display floating layer is greater than or equal to the size of the i-th translation copy, and i takes 1 to N in turn;

The content display subunit is used to, if yes, display the complete translation content of the i-th translation copy within the original floating layer size of the i-th translation display floating layer; otherwise, display the original floating layer according to the i-th translation Floating layer size, displaying part of the translation content of the i-th translation copy within the original floating layer size of the i-th translation display floating layer.
The device according to claim 11, further comprising:

The second operation detection unit is used to display part of the translation content of the i-th translated text within the original floating layer size of the i-th translation display floating layer, if it is detected that the user shows the floating layer to the i-th translation Expand operation, expand the i-th translation display floating layer;

The second copywriting display unit is used to display the complete translation content of the i-th translation copy within the unfolded floating layer size of the i-th translation display floating layer.
The device according to any one of claims 9-12, the device further comprising:

The copywriting moving unit is used to display the floating layer for each translation created on the target screenshot, and if a user's movement operation on the translation display floating layer is detected, display the translation according to the operation information of the moving operation The floating layer moves.
The device according to claim 13, wherein the moving operation is a dragging operation, and the copy moving unit includes:

The drag trajectory subunit is used to obtain the drag trajectory of the drag operation performed by the user on the translation display floating layer, and move the translation display floating layer according to the drag trajectory;

The end determination subunit is used to move the translation display float back to the original display area of the translation display float when the end of the drag operation is detected, or determine the position at the end of the drag operation Coordinates, and the translation display floating layer stays on the target screenshot according to the position indicated by the position coordinates.
The device according to claim 9, wherein the copy acquisition unit comprises:

The screenshot sending subunit is used to send the target screenshot to the server, so that the server processes the target screenshot, and generates a translation copy of each translation object on the target screenshot;

The copywriting receiving subunit is configured to receive, for each translation object on the target screenshot, the translation copy corresponding to the translation object fed back by the server.
The device of claim 9, further comprising:

The copywriting hiding unit is used to hide each translation display floating layer created on the target screenshot if the user's translation hiding operation is detected.
A translation system including:

The mobile terminal is configured to, if a user's translation start operation is detected, intercept the current screen content of the mobile terminal to obtain a target screenshot, and send the target screenshot to the server, and the target screenshot contains more than one translation object;

The server is used to process the target screenshot, obtain the translation copy of each translation object on the target screenshot, and send the translation copy to the mobile terminal;

The mobile terminal is also used to display the target screenshot, and for each translation object on the target screenshot, create a translation display floating layer in the text line area of the translation object, which will correspond to the translation object The translation copy is added to the translation display floating layer for display.
A mobile terminal, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, and the processor implements the steps of the method in any one of claims 1-8 when the processor executes the program .
A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in any one of claims 1-8.