WO2023082198A1

WO2023082198A1 - Data processing method, intelligent terminal, and storage medium

Info

Publication number: WO2023082198A1
Application number: PCT/CN2021/130435
Authority: WO
Inventors: 段德昀
Original assignee: 上海传英信息技术有限公司; 深圳传音控股股份有限公司
Priority date: 2021-11-12
Filing date: 2021-11-12
Publication date: 2023-05-19
Also published as: CN118202362A

Abstract

Provided in the present application are a data processing method, an intelligent terminal, and a storage medium. The data processing method comprises the following steps: S12, in response to a first display instruction in a target language, acquiring displayed content in a first area; S13, translating the displayed content in the target language, so as to determine or generate target content; and S14, outputting the target content in a second area. By means of the present application, the content displayed by an intelligent terminal can be translated and displayed in real time with a relatively high processing efficiency.

Description

Data processing method, intelligent terminal and storage medium

technical field

The present application relates to the technical field of smart terminals, and in particular to a data processing method, a smart terminal and a storage medium.

Background technique

At present, smart terminals such as mobile phones, tablet PCs and/or computers have been deeply applied to various fields and play an important role in people's life and work. Groups using these smart terminals often have different language backgrounds. If these smart terminals use one language to respond to the needs of multiple users with different language backgrounds at the same time, it will easily affect the user experience provided.

During the process of conceiving and implementing the present application, the inventors found at least the following problems: when the smart terminal provides the translation interface corresponding to the display interface, there is a problem of low efficiency.

The foregoing description is provided to provide general background information and does not necessarily constitute prior art.

Contents of the invention

In view of the above technical problems, the present application provides a data processing method, a smart terminal and a storage medium, capable of real-time translation and display of the content displayed by the smart terminal, with high display efficiency.

In order to solve the above technical problems, this application provides a data processing method, which can be applied to smart terminals such as mobile phones, including the following steps:

S12. Responding to the first display instruction in the target language, acquire the display content of the first area;

S13, using the target language to translate the displayed content, and determine or generate the target content;

S14. Output the target content in the second area.

Optionally, the obtaining process of the first display instruction includes:

responding to a second display command in the target language;

If the smart translation function is turned on, determine or generate the first display instruction in the target language;

Optionally, if the smart translation function is not turned on, output a first prompt message for turning on the smart translation function.

Optionally, the second display instruction includes at least one of the following:

Display the area identification command corresponding to the interface;

The first trigger instruction received by the first control.

Optionally, step S13 includes:

The displayed content is input into a preset content translation model, and the content translation model outputs target content; the content translation model is used to translate specified content in a target language, and the specified content is represented by at least one language.

Optionally, the content translation model is used to translate pictures represented by at least one language; the acquisition process of the content translation model includes:

Obtaining at least one sample picture represented by at least one language, and a translation result corresponding to at least one sample picture;

Use sample images and translation results to train the initial network to obtain a content translation model.

Optionally, step S14 includes:

Obtain the display characteristics of the display content in the first area;

The target content is output in the second area according to the display characteristics.

Optionally, the process of enabling the smart translation function includes:

Output configuration information in response to the first activation command of the smart translation function;

Respond to the configuration operation corresponding to the configuration information, and enable the smart translation function.

Optionally, the first opening instruction includes: an opening operation received by the second control.

Optionally, the second control includes at least one of the following items:

The function control set in the setting item;

Trigger controls located on screen pull menus;

Trigger controls suspended on the display interface;

Shortcut controls located on the display desktop;

Voice wake-up control;

And physical controls for turning on the smart translation function.

Optionally, after step S14, the method further includes:

Obtain the entity and the associated information of the entity in the target content;

In response to the second trigger instruction corresponding to the entity, the associated information is output.

Optionally, if the second area covers at least one third control, after step S14, the method further includes:

The third control receives the third trigger instruction and responds to the third trigger instruction.

The present application also provides a data processing method, which can be applied to smart terminals such as mobile phones, including the following steps:

S22, responding to the translation instruction of the target language, and obtaining the input content;

S23, using the target language to translate the input content, and determine or generate the target content;

S24, sending the target content to the communication window.

Optionally, the input content comes from an input window.

Optionally, step S23 includes:

Input the input content into the translation tool associated with the target language, and determine or generate the target content according to the output content of the translation tool.

Optionally, step S24 includes:

S241. Output second prompt information, where the second prompt information includes application controls and/or language replacement controls;

S241. Send the target content to the communication window in response to the first operation corresponding to the application control.

Optionally, in response to the second operation corresponding to changing the language control, return to step S22 after updating the target language.

The present application also provides an intelligent terminal, including: a memory and a processor, wherein a data processing program is stored in the memory, and when the data processing program is executed by the processor, the steps of any one of the methods described above are implemented.

The present application also provides a computer-readable storage medium, the storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any one of the methods described above are implemented.

As described herein, the data processing method of the present application can respond to the first display command in the target language, obtain the display content in the first area, translate the display content in the target language, and output the obtained target content in the second area, so that the target The content is displayed and/or played in the second area, which has high accuracy and display efficiency. Using the content translation model to directly translate the display content represented by pictures and other forms to obtain the required target content can simplify the acquisition process of the target content and contribute to the improvement of display efficiency. When the corresponding smart translation function is turned on, it can be configured according to specific user needs, which can improve the matching degree between the smart translation function and user needs, thereby improving the corresponding user experience.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, the Under the premise, other drawings can also be obtained based on these drawings.

FIG. 1 is a schematic diagram of a hardware structure of an intelligent terminal implementing various embodiments of the present application;

FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application;

Fig. 3 is a schematic flowchart of a data processing method according to an embodiment;

Fig. 4a, Fig. 4b, Fig. 4c, Fig. 4d and Fig. 4e are schematic diagrams of display interfaces shown according to an embodiment of the present application;

Fig. 5a, Fig. 5b, Fig. 5c, Fig. 5d and Fig. 5e are schematic diagrams of display interfaces shown according to an embodiment of the present application;

Fig. 6a, Fig. 6b, Fig. 6c and Fig. 6d are schematic configuration interface diagrams shown according to an embodiment of the present application;

Fig. 7a, Fig. 7b, Fig. 7c, Fig. 7d and Fig. 7e are schematic diagrams of the second control according to an embodiment of the present application;

Fig. 8a, Fig. 8b, Fig. 8c and Fig. 8d are schematic diagrams of communication interfaces shown according to an embodiment of the present application;

FIG. 9 is a schematic flowchart of a data processing method according to an embodiment of the present application;

Fig. 10a, Fig. 10b, Fig. 10c, Fig. 10d and Fig. 10e are schematic diagrams of communication interfaces shown according to an embodiment of the present application.

The realization, functional features and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. By means of the above drawings, specific embodiments of the present application have been shown, which will be described in more detail hereinafter. These drawings and text descriptions are not intended to limit the scope of the concept of the application in any way, but to illustrate the concept of the application for those skilled in the art by referring to specific embodiments.

Detailed ways

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the statement "comprising a..." does not exclude the presence of other identical elements in the process, method, article, or device that includes the element. In addition, different implementations of the present application Components, features, and elements with the same name in the example may have the same meaning, or may have different meanings, and the specific meaning shall be determined based on the explanation in the specific embodiment or further combined with the context in the specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination". Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not exclude one or more other features, steps, operations, The existence, occurrence or addition of an element, component, item, species, and/or group. The terms "or", "and/or", "comprising at least one of" and the like used in this application may be interpreted as inclusive, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C", another example, " A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C". Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that although the various steps in the flow chart in the embodiment of the present application are displayed sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figure may include multiple sub-steps or multiple stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential Instead, it may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" could be interpreted as "when determined" or "in response to the determination" or "when detected (the stated condition or event) )" or "in response to detection of (a stated condition or event)".

It should be noted that, in this article, step codes such as S12 and S13 are used, the purpose of which is to express the corresponding content more clearly and concisely, and does not constitute a substantive limitation on the order. Those skilled in the art may, during specific implementation, S13 will be executed first, followed by S12, etc., but these should be within the scope of protection of this application.

It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

In the following description, the use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating the description of the present application and has no specific meaning by itself. Therefore, 'module', 'part' or 'unit' may be mixedly used.

Smart terminals can be implemented in various forms. For example, the smart terminals described in this application may include mobile phones, tablet computers, notebook computers, palmtop computers, personal digital assistants (Personal Digital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, Mobile terminals such as wearable devices, smart bracelets, and pedometers, and fixed terminals such as digital TVs and desktop computers.

In the subsequent description, a smart terminal will be taken as an example for illustration, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configurations according to the embodiments of the present application can also be applied to fixed-type terminals.

Please refer to FIG. 1, which is a schematic diagram of the hardware structure of a smart terminal implementing various embodiments of the present application. The smart terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, an /V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that the smart terminal structure shown in Figure 1 does not constitute a limitation on the smart terminal, and the smart terminal may include more or less components than shown in the figure, or combine certain components, or different components layout.

The following is a specific introduction to each component of the smart terminal in conjunction with Figure 1:

The radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000 , Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency division duplex long-term evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution, time-division duplex long-term evolution) and 5G, etc.

WiFi is a short-distance wireless transmission technology. Through the WiFi module 102, the smart terminal can help users send and receive emails, browse web pages, and access streaming media, etc., and it provides users with wireless broadband Internet access. Although Fig. 1 shows the WiFi module 102, it can be understood that it is not an essential component of the smart terminal, and can be completely omitted as required without changing the essence of the invention.

The audio output unit 103 can store the information received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 when the smart terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like. The audio data is converted into an audio signal and output as sound. Moreover, the audio output unit 103 may also provide audio output related to specific functions performed by the smart terminal 100 (for example, call signal receiving sound, message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The A/V input unit 104 is used to receive audio or video signals. The A/V input unit 104 may include a graphics processing unit (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 is used for still pictures or The image data of the video is processed. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 . The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data. The processed audio (voice) data can be converted into a format transmittable to a mobile communication base station via the radio frequency unit 101 for output in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

The smart terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the smart terminal 100 moves to the ear. panel 1061 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used for applications that recognize the posture of mobile phones (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display area (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the smart terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Optionally, other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.

Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event. The corresponding visual output is provided on the display panel 1061 . Although in FIG. 1, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the smart terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated. The implementation of the input and output functions of the smart terminal is not specifically limited here.

The interface unit 108 is used as an interface through which at least one external device can be connected with the smart terminal 100 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a storage program area and a storage data area. Optionally, the storage program area can store an operating system, at least one function required application program (such as a sound playback function, an image playback function, etc.) etc.; the storage data area can be Store data (such as audio data, phone book, etc.) created according to the use of the mobile phone. In addition, the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 110 is the control center of the smart terminal, and uses various interfaces and lines to connect various parts of the whole smart terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the smart terminal and process data, so as to monitor the smart terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes operating systems, user interfaces, and application programs, etc. The demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

The smart terminal 100 can also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

Although not shown in FIG. 1 , the smart terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.

In order to facilitate understanding of the embodiments of the present application, the following describes the communication network system on which the smart terminal of the present application is based.

Please refer to FIG. 2. FIG. 2 is a structure diagram of a communication network system provided by an embodiment of the present application. The communication network system is an LTE system of general mobile communication technology. ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.

Optionally, the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.

E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on. Optionally, the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .

EPC203 may include MME (Mobility Management Entity, Mobility Management Entity) 2031, HSS (Home Subscriber Server, Home Subscriber Server) 2032, other MME2033, SGW (Serving Gate Way, Serving Gateway) 2034, PGW (PDN Gate Way, packet data Network Gateway) 2035 and PCRF (Policy and Charging Rules Function, Policy and Charging Functional Entity) 2036, etc. Optionally, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and save some user-specific information about service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide UE 201 IP address allocation and other functions, PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.

The IP service 204 may include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.

Although the LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems. The network system (such as 5G), etc., is not limited here.

Based on the above hardware structure of the smart terminal and the communication network system, various embodiments of the present application are proposed.

In the first embodiment, the present application provides a data processing method, which may include a method for displaying target content, and can be applied to smart terminals such as mobile phones and/or applications running on smart terminals; refer to FIG. 3 As shown, the data processing method includes step S12, step S13 and step S14.

S12. Obtain display content in the first area in response to the first display instruction in the target language.

Optionally, the target language is the language adopted by at least one first user currently using the smart terminal, and/or the language adopted by at least one second user associated with the smart terminal. The second user is a user who needs to know the content currently displayed by the smart terminal, such as a user who learns the content currently displayed by the smart terminal remotely, a user who remotely participates in a meeting held by the smart terminal, and/or, a user who needs to know the content currently displayed by the smart terminal afterwards etc.

Optionally, the first area is the area selected and/or collected by the first user when an intelligent display instruction (such as a second display instruction) corresponding to the target language is selected, including at least part of the area currently collected by the camera module of the smart terminal, the currently selected Select at least a partial area in the picture, the entire display area corresponding to the current display interface of the smart terminal, a partial display area, or a scrolling display area including the entire display area, and the like. The displayed content includes content such as screenshots and/or texts corresponding to the first area. The entire display area corresponding to the current display interface can refer to Figure 4a, and can be determined by means of full-screen screenshots; the partial display area of the entire display area shown in Figure 4a can be referred to as shown in Figure 4b, as shown in Figure 4c, this part shows The area can be selected through the relevant selection box on the current display interface, and the selection box can be input into the current display interface through the mouse, user's finger and/or touch screen writing pen, etc.; the scrolling display area can be acquired through scrolling acquisition operations such as scrolling screenshots.

After the smart terminal and/or application monitors the smart display instruction corresponding to the target language, it can directly generate or determine the first display instruction to ensure the generation efficiency of the first display instruction; it can also further identify whether the smart terminal and/or application is currently The smart translation function is turned on, and the first display instruction is generated or determined according to the current enabled state of the smart translation function, so that the first display instruction matches the user setting.

In one embodiment, the process of acquiring the first display instruction includes: responding to the second display instruction in the target language; if the smart terminal and/or the application program enables the smart translation function, determining or generating the first display instruction in the target language to Respond to users' current smart translation needs in a timely manner.

Optionally, if the smart translation function is not turned on, output a first prompt message for turning on the smart translation function. The first prompt information can be output through pop-up window display and/or voice playback. The first user receives the first prompt information. If the smart translation function does not need to be turned on, the confirmation information for not turning on the smart translation function can be input. to close the first prompt message. and / or,

If you need to enable the smart translation function, you can enter the confirmation information for enabling the smart translation function, so that the smart terminal and/or application program jumps to the interface for enabling the smart translation function or directly enables the smart translation function to ensure that the first user can successfully open the smart translation function. Smart translation function. Optionally, the first user may input a second activation instruction for enabling the smart translation function into the relevant control according to the first prompt information, and after the smart terminal and/or application program responds to the second activation instruction corresponding to the first prompt information, it may A first display instruction in the target language is generated, so as to acquire the display content of the first area in time and display it in the target language accordingly.

In one example, the second display instructions include at least one of the following:

The area identification instruction corresponding to the display interface; such as the instruction to identify the entire current display area of the display interface, the instruction to identify the partial area of the display interface, and/or the scrolling identification instruction corresponding to the display interface, etc.; these identification instructions (such as the area identification instruction and/or or scroll recognition instruction) can be input to the smart terminal through operations such as clicking, tapping, gesture selection and/or dragging, so that the smart terminal can receive it. Optionally, after the intelligent translation function is enabled on the smart terminal and/or the application program, an area selection control can be set on the corresponding display interface, as shown in Figure 4a, the area selection control is suspended on the display interface, and the first user can drag it to the The area selection control is used to input an area identification command to the display interface. Optionally, the smart terminal and/or the application determine the first region according to the closed figure formed by the track of the area selection control, as shown in Figure 4c, if the closed figure formed by the track of the area selection control is as shown in the selection box, then you can Enter the selection box to the display interface.

The first trigger instruction received by the first control; the first control includes a virtual control and/or a physical control. Optionally, the virtual control is set on the pull-down menu of the display screen, such as a pull-up menu, a left-hand pull-down menu and/or a drop-down menu, etc., and Fig. 4d shows the first control set in the corresponding drop-down menu of the display interface shown in Fig. 4a . Optionally, the virtual control is suspended on the display interface. At this time, the first control suspended on the display interface can be an area selection control for the first user to input an area identification instruction; Displays the first control of the interface. In Fig. 4d and Fig. 4e, the letter "T" is used to represent the first control, and in other examples, other letters and/or symbols may also be used to represent the first control. Optionally, after the first control receives the first trigger instruction, a selection box may pop up for the first user to select the first area, so that the smart terminal and/or the application program can acquire the display content in the first area.

S13, using the target language to translate the displayed content, and determine or generate the target content.

In step S13, a translation tool may be selected for translation according to features such as the representation form of the displayed content and/or the language involved. Optionally, if the display content is represented by text, the display content can be input into a translation program capable of recognizing the languages involved in the display content, and the translation program is used to translate the display content into target content to ensure translation efficiency. If the display content is represented by pictures, a large number of pictures can be used to pre-train a picture translation model that can recognize all kinds of text in the picture and translate all kinds of text into the target language. This translation model can be used to translate the display content to improve translation efficiency. On this basis, the accuracy of translation results is guaranteed.

During the research process, the inventor found that when the traditional solution translates the display content represented by pictures and other forms, the models are often trained separately in the process of text detection and text recognition, and each model is used to process the display content in order to obtain the target The target content of language representation, this process consumes a lot of resources, the translation efficiency is low, and the large program affects the user experience provided by the smart terminal.

In view of the above problems, in one embodiment, step S13 includes: inputting the display content into a preset content translation model, and obtaining the target content output by the content translation model; the content translation model is used to translate the specified content in the target language, and the specified content is passed At least one language representation. In this embodiment, the display content is input into the content translation model to obtain the required target content, which has high translation efficiency and can reduce the smart terminal resources occupied by the translation process, thereby improving the performance of the smart terminal such as the operating speed. The content translation model is also used to identify various characters in the displayed content, and translate the recognized characters into the target language respectively, so as to ensure the accuracy and comprehensiveness of the obtained target content.

In one example, the content translation model is used to translate pictures represented by at least one language; the process of obtaining the content translation model includes steps S131 and S132.

S131. Acquire at least one sample picture represented by at least one language, and a translation result corresponding to each sample picture, where the translation result is represented by a target language. In this step, at least one picture to be translated may be collected, and a class of pictures corresponding to each picture may be collected from various network platforms through a web crawler to obtain a large number of sample pictures. Optionally, this step can also preprocess the collected pictures in terms of format, text and/or language form, for example, replace part of the content in the pictures with content represented by a certain language, etc., so that after preprocessing The images of are more comprehensive and standardized, which can further improve the accuracy of the resulting content translation model.

S132. Train an initial network by using the sample picture and the translation result to obtain the content translation model. The initial network can be an end-to-end network model, such as Pgnet (a single-step text detection recognizer for multi-task learning) and the like. The content translation model has the function of recognizing characters in various languages in the input image, and it can also be called an ocr (optical character recognition) model. Optionally, step S132 can obtain model evaluation parameters such as the loss function of the initial network during the training process, and when the model evaluation parameters meet the set requirements (such as convergence and/or in an optimal state, etc.), according to when the set requirements are reached The model parameters determine the content translation model, so as to ensure the accuracy of the determined content translation model.

The content translation model provided in this example can directly translate pictures represented by at least one language, has high translation efficiency and accuracy, can improve the accuracy of the obtained target content, and plays an important role in optimizing various performances of smart terminals.

Optionally, step S13 may also include translating the displayed content in the target language, identifying each unit content in the translation result, and merging the same unit content to determine the target content and make the determined target content more concise. Optionally, unit content may include short sentences, long sentences and/or other content capable of representing independent events.

S14. Output the target content in the second area, so that the target content is displayed and/or played in the second area.

The second area can be in the same position as the first area, that is, the target content is overlaid on the original display content. For example, referring to FIG. 5a to FIG. 5d, the second area is in the same position as the first area, and FIG. After translating the entire display area of the display interface, each part of the content is displayed in its original position. Fig. 5d is for the partial area of the display interface shown in Fig. 5c (the first area in the diagram) after translation, each part of the first area The content is displayed in the original position respectively. The second area can also be other areas different from the first area, such as the area suspended near the first area, the display area corresponding to the information to be sent in the chat interface, etc.; referring to the chat interface shown in Figure 5e, the first The area includes the display content 1 represented by the first language, the display content 2 represented by the second language and the display content 3 represented by the third language. The corresponding second area can be suspended near the first area, including the corresponding display content 1 The target content 1, the target content 2 corresponding to the display content 2, and the target content 3 corresponding to the display content 3, where each target content is represented by the target language.

In one embodiment, step S14 includes:

Obtain the display characteristics of the display content in the first area;

The above display features may include background features and/or text features; background features may include background color and/or background graphics, and text features may include fonts and/or font sizes. Optionally, in this implementation manner, the second region is presented according to background features. Optionally, in this embodiment, the target content is displayed in the second area according to the text features, so that the target content displayed in the second area has a higher matching degree with the display content in the second area, and the accuracy of the target content in the second area can be improved. display effect.

In one embodiment, step S14 includes:

output the second prompt information, the second prompt information includes the application control and/or change the language control, the second prompt information can be output through a dialog box, etc., if the first user clicks the application control, the first operation corresponding to the application control can be input, If the first user clicks to change the language control, the second operation corresponding to the change of language control can be input;

In response to the first operation corresponding to the application control, output the target content in the second area, so that the target content is displayed in the second area to ensure the display efficiency of the target content; and/or, in response to the second operation corresponding to the language control, update the After the target language, return to step S12 to translate the displayed content in the updated target language, obtain new target content for display, and ensure that the language used in the display matches the current needs of the user.

The smart terminal and/or the application program can turn on the smart translation function at startup, when generating the first prompt message for turning on the smart translation function, and/or at other times when the smart translation function needs to be turned on. In one embodiment, the process of enabling the intelligent translation function includes steps S111 and S112.

S111 , output configuration information in response to the first enabling instruction of the smart translation function.

The content of the configuration information may be determined according to features such as the object using the smart translation function and/or the function of the object. If the corresponding data processing method is applied to a smart terminal, the configuration information may include the type of program that uses the smart translation function, the input method of the second display command, and/or the step settings for enabling the smart translation function according to the relevant first prompt information. If the corresponding data processing method is applied to the application program, the configuration information may include the timing of enabling the smart translation function, the input method of the second display command, and/or the step setting for enabling the smart translation function according to the relevant first prompt information. Optionally, if the smart translation function can use at least one language to translate the display content, the configuration information can also configure the language type currently required, so that the user can select the target language from the provided multiple languages; optionally , each language provided in the configuration information has a corresponding content translation model, so that the displayed content is input into the content translation model corresponding to the target language for text recognition and/or translation, so as to ensure the accuracy of the obtained target content.

The intelligent translation function of the smart terminal and/or the application program may also be called a language master or other names that can characterize the text recognition and/or translation function. If the data processing method is applied to the smart terminal, the smart translation function is represented by the language master, and the configuration interface corresponding to the configuration information can refer to Figure 6a. The configuration interface can include the switch control of the language master, the reading program (such as the news program and/or Programs, etc.) corresponding switch controls and required translation language settings, social programs (such as QQ and/or WeChat, etc.) corresponding switch controls and required translation language settings. Optionally, the configuration information may also include other settings. As shown in FIG. 6a, the corresponding configuration interface may also include other setting information such as how to use and/or experience feedback. Optionally, the configuration information may also include function triggering modes (such as the second display instruction) corresponding to various programs (such as reading programs and/or social programs); as shown in Figure 6b, the function triggering modes of the reading programs include dual Swipe down the selected area to translate, and the function trigger method of the social program includes clicking the translation control to translate. Optionally, after entering the configuration interface shown in Figure 6a and/or Figure 6b, the first user can enable at least one type of program shown; if the configuration interface does not show all associated applications, the first user triggers the language master After the corresponding switch control, the smart terminal can enter an interface including more application programs for the first user to select the program to be enabled; the above-mentioned interface including more application programs can be referred to as shown in FIG. The interface includes selection boxes corresponding to reading program, social program, type A program, type B program, type C program, type D program and various programs; the first user can select the corresponding selection box to include more application programs in the interface to select at least one type of program; in the interface shown in Figure 6d, the first user has selected the reading program, type A program, and type C program, so that when these three types of programs are working, after the first user inputs the second display instruction Then the first display command can be obtained directly, the display content can be quickly obtained, and corresponding translation and display can be performed. Optionally, as shown in FIG. 6c and FIG. 6d, the interface including more application programs may also show buttons such as direct use and/or how to use, for the first user to operate according to needs, for example, if you click direct use, then You can start the language master according to the current configuration content. If you click on how to use, you can enter the relevant operation guidance interface and so on.

S112, responding to the configuration operation corresponding to the configuration information, enabling the smart translation function.

After the first user performs the configuration operation according to the configuration information, he can click the controls such as direct use and/or the relevant confirmation button to enable the smart translation function, so that the smart terminal and/or the corresponding application program can enable the smart translation function, and translate and translate accurately and efficiently. The display content selected by the first user is displayed.

In an example, the first opening instruction includes: an opening operation received by the second control.

Optionally, the second control includes at least one of the following items:

The function control (such as the expansion control) set in the setting item; the smart translation function option set in the smart terminal setting program as shown in Figure 7a, if the expansion control of the smart translation function option receives a trigger operation, it can enter the corresponding Configuration interface; as shown in Figure 7b, the smart translation function option set in the subroutine of an application program, if the expansion control of the smart translation function option receives a trigger operation, the corresponding configuration interface can be entered.

The trigger control set on the pull-down menu on the screen, such as the pull-up menu, pull-down menu, left pull-down menu and/or right pull-down menu of the smart terminal screen, etc., the trigger control shown in FIG. 7c is set in the drop-down menu.

The trigger control suspended on the display interface, as shown in Figure 7d, the trigger control can be moved on the display interface; optionally, the trigger control suspended on the display interface can represent the enabled state of the smart translation function through features such as color and/or brightness , for example, the first color and/or first brightness indicates that the smart translation function is turned on, and the second color and/or second brightness indicates that the smart translation function is turned off.

The shortcut control set on the display desktop, as shown in Figure 7e, the shortcut control can be arranged on the display desktop of the smart terminal together with other desktop icons, and by clicking the shortcut control, the operation of opening the smart translation function can be input. In Figures 7c to 7e, the trigger controls and/or shortcut controls corresponding to the smart translation function are represented by the letter "S". In other examples, other letters and/or symbols may also be used, which are not limited here.

Optionally, the second control may also include other forms of controls such as a voice wake-up control and/or a physical control for enabling the smart translation function, so as to improve the convenience of inputting a corresponding activation operation.

Optionally, after the smart terminal and/or various second controls of the application program receive the corresponding opening operation, the corresponding configuration interface is displayed to output configuration information, so that the first user can configure according to the needs, so that the opened smart The translation function matches user needs to improve user experience.

In one embodiment, step S151 and step S152 are further included after step S14.

S151. Acquire entities in the target content and associated information of the entities. Entities may include information with specified meanings such as name, organization, time, location, communication account (such as mobile phone number, etc.) and/or network link. Associated information refers to information such as the content, processing method and/or function associated with the corresponding entity of the smart terminal, and/or information associated with the corresponding entity on each network platform, such as the profile corresponding to the person's name, communication account number, dialing path and /or short message paths, time-corresponding record paths, etc., are used to provide further introductions of corresponding entities and/or related function paths. In step S151, algorithms such as entity extraction and/or intention recognition may be used to analyze each sentence of the target content to obtain at least some entities, and the associated information of each entity may be acquired on the smart terminal and/or each network platform.

S152. Output associated information in response to the second trigger instruction corresponding to the entity.

Step S151 After the entity is acquired, each entity can be marked in the displayed target content by underlining, specifying brightness and/or specifying color, etc., so that the first user can input a second trigger instruction to the marked entity by clicking on the entity, etc. , so that the smart terminal and/or the application program outputs the associated information of the corresponding entity. Optionally, the associated information can be output in the form of dialog boxes and/or voice playback. The display position of the dialog box providing associated information may be determined according to the display position of the corresponding entity, for example, on the top, bottom, left or right side of the corresponding entity.

Optionally, for the target content of the communication interface shown in Figure 8a, "We have just answered your various questions by email. If you have any other questions, please contact Zhang San, or you can call 123456789" to obtain "Zhang San" and " 123456789", the two entities are underlined in Figure 8a. If the smart terminal stores Zhang San’s phone number and email address, when the first user clicks Zhang San, the communication interface can display the associated information shown in Figure 8b, and when the first user clicks the dial button, the corresponding phone dialing interface can be entered , when the first user clicks the SMS button, the corresponding SMS sending interface can be entered, and when the first user clicks the sending email button, the corresponding email sending interface can be entered. If the personal introduction corresponding to Zhang San can be found on Baidu and other network platforms, when the first user clicks on Zhang San, the communication interface can display the related information shown in Figure 8c, which can show the personal introduction provided by sources such as Baidu Encyclopedia . When the first user clicks 123456789, the communication interface can display the associated information shown in Figure 8d, which provides each processing path of this string of numbers, and the first user can click each processing path to enter the corresponding processing interface, such as clicking to dial , you can enter the dial interface corresponding to 123456789 and so on.

This embodiment can obtain the entity of the target content and the corresponding associated information, so that when the first user needs to obtain the associated information of the entity, he can directly click to obtain it, which improves the convenience for the first user to obtain the associated information, and can further improve the corresponding user information. experience.

In an implementation manner, if the second area covers at least one third control, after step S14, the method further includes: when the third control receives the third trigger instruction, responding to the third trigger instruction. The third control can be other controls that are always suspended on the display interface and/or display desktop, such as the floating control used to set the specified function of the smart terminal, etc. If the second area needs to cover the third control, it can be in the third control The corresponding content is displayed on the control to ensure the integrity of the displayed content. If the first user needs to input a third trigger instruction to the third control, the first user can click and operate the position of the third control at this time, and the third control can obtain the corresponding third trigger instruction to make an effective response, so as to The display of content does not affect the operation of other functions of the smart terminal.

The above data processing method can respond to the first display command in the target language, obtain the display content in the first area, translate the display content in the target language, output the target content in the second area, and display and/or play the target content, which has a relatively high performance. High accuracy and processing efficiency. Directly inputting the displayed content into the content translation model to obtain the required target content can simplify the process of obtaining the target content and contribute to improving the display efficiency. When the corresponding smart translation function is turned on, it can be configured according to specific user needs, which can improve the matching degree between the smart translation function and user needs, thereby improving the corresponding user experience. In addition, after the target content, entities in the target content and corresponding related information can also be obtained, so that users can more conveniently obtain related information and/or processing paths provided by related information, and can further simplify the information acquisition process related to entities and/or function realization process to further optimize the user experience brought by the data processing method.

On the basis of the above embodiments, the second embodiment of the present application provides a data processing system, including:

The first acquisition module is used to acquire the display content of the first area in response to the first display instruction in the target language;

a first translation module, configured to translate display content in a target language, and determine or generate target content;

The display module is used to output the target content in the second area.

For specific limitations on the data processing system, refer to the above-mentioned limitations on the data processing method, which will not be repeated here. Each module in the data processing system can be fully or partially realized by software, hardware and a combination thereof. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can call and execute the corresponding operations of the above modules.

The division of each module in the data processing system is only for illustration. In other embodiments, the data processing system may be divided into different modules as required to complete all or part of the functions of the data processing system.

On the basis of the third embodiment, the present application provides a data processing method, which may include a method for sending target content, and can be applied to smart terminals and/or applications such as social programs running on smart terminals; The programs may include instant messaging programs such as WeChat, email communication programs such as Foxmail, or other types of communication programs. Referring to Fig. 9, the data processing method includes steps S22, S23 and S24.

S22. Obtain input content in response to a translation instruction in the target language.

Optionally, the input content comes from an input window.

Optionally, the target language is the language adopted by at least one first user currently using the smart terminal, and/or the language adopted by at least one second user communicating with the social program currently running on the smart terminal. The input window may include an information collection area of a corresponding social program, and may collect input content such as text, voice and/or pictures input by the first user. The communication window may include an area for displaying communication content, and generally may display content sent by the first user and content sent by the second user to the first user. Referring to FIG. 10a, the first user can input text, voice and/or pictures into the input window to inform the second user, and send these input contents to the communication window to synchronize to the communication window corresponding to the second user.

Optionally, after the smart terminal and/or the application monitors the translation operation corresponding to the target language, it can directly determine or generate the translation instruction to ensure the efficiency of determining or generating the translation instruction; it is also possible to further identify the current Whether to enable the smart translation function, generate translation instructions according to the current enabled status of the smart translation function, so that the translation instructions match the user settings.

In one embodiment, the process of obtaining translation instructions includes: responding to translation operations corresponding to the target language; if the smart translation function is enabled, determining or generating translation instructions in the target language to respond to the user's current smart translation needs in a timely manner.

Optionally, if the smart translation function is not enabled, output the first prompt message to enable the smart translation function, and generate or determine the translation command in the target language after responding to the second enable command corresponding to the first prompt message. The first prompt information can be output through pop-up window display and/or voice playback. The first user receives the first prompt information. If the smart translation function does not need to be turned on, the confirmation information for not turning on the smart translation function can be input. to close the first prompt message, and/or, if you need to enable the smart translation function, you can enter the confirmation information for enabling the smart translation function, so that the smart terminal and/or application program jumps to the interface for enabling the smart translation function or directly opens the The smart translation function ensures that the first user can successfully open the smart translation function. Optionally, the first user may input a second activation instruction for enabling the smart translation function into the relevant control according to the first prompt information, and after the smart terminal and/or application program responds to the second activation instruction corresponding to the first prompt information, it may Generate translation instructions for the target language.

Optionally, the translation operation includes an operation received by the first control. The first controls include virtual controls and/or physical controls. Optionally, the virtual control is set at a preset position of the communication window, for example, as shown in FIG. The first control, enters the translation action to send the translated target content to the communication window. Optionally, the virtual control is suspended on the communication interface, as shown in FIG. 10b , the suspended first control can be moved on the communication interface to be dragged to a proper position by the first user. In Fig. 10a and Fig. 10b, the symbol "MOL" is used to represent the first control, and in other examples, other letters and/or symbols may also be used to represent the first control.

S23, using the target language to translate the input content to determine or generate the target content.

In step S23, a translation tool may be selected for translation according to characteristics such as the representation form of the input content and/or the language involved. Optionally, if the input content is characterized by text and/or voice, the input content can be input into a translation program that can recognize the text and/or voice of each language involved, and the translation program is used to translate the input content into target content, so as to Guaranteed translation efficiency. If the input content includes picture representations, a large number of pictures can be used to pre-train a translation model that can recognize various texts in the pictures and translate various texts into the target language, and use this translation model to translate the input content, so as to improve translation efficiency. , to ensure the accuracy of the translation results. Optionally, the target content matches the representation form of the input content; if the input content is text, the target content is text; if the input content is voice, the target content is voice; if the input content is a picture, the target content is a picture.

In one embodiment, the step S23 includes: inputting the input content into a translation tool associated with the target language, and determining or generating the target content according to the output content of the translation tool. The translation tool may include a translation program capable of translating text and/or speech in at least one language into target content, and/or a translation model capable of translating pictures in at least one language into target content. In this embodiment, translation tools are used to translate input content, which can ensure the stability and accuracy of the translation process.

Optionally, the translation tool can be pre-configured and/or trained according to the characteristics of the input content. Taking the translation model corresponding to the picture as an example, the training process may include steps S231 and S232.

S231. Acquire at least one sample picture represented by at least one language, and a translation result corresponding to each sample picture, where the translation result is represented by a target language. In this step, at least one picture to be translated may be collected, and a class of pictures corresponding to each picture may be collected from various network platforms through a web crawler to obtain a large number of sample pictures. Optionally, this step can also preprocess the collected pictures in terms of format, text and/or language form, for example, replace part of the content in the pictures with content represented by a certain language, etc., so that after preprocessing The pictures of are more comprehensive and standardized, which can further improve the accuracy of the resulting translation model.

S232. Using the sample picture as input and the translation result as output, train the initial network to obtain the required translation model. The initial network can be an end-to-end network model, such as Pgnet (a single-step text detection recognizer for multi-task learning) and the like. The translation model has the function of recognizing characters in various languages in the input image, and it can also be called an ocr (optical character recognition) model. Optionally, the step S232 can obtain model evaluation parameters such as the loss function of the initial network during the training process. The model parameters determine the translation model to ensure the accuracy of the determined translation model.

S24, sending the target content to the communication window.

Step S24 sends the target content to the communication window, so that the communication window can display corresponding text and/or pictures in the target language, and/or, use the target language to play the corresponding voice, so that the second user or other first users using the target language Users can receive target content expressed in the target language, which can improve the smoothness of the communication process, thereby improving communication efficiency and corresponding user experience.

In one embodiment, step S24 includes step S241 and step S242.

S241, output second prompt information, the second prompt information includes application controls and/or language replacement controls, as shown in Figure 11a, the second prompt information can be output through a dialog box, etc., if the first user clicks on the application control, he can input For the first operation corresponding to the application control, if the first user clicks to change the language control, he can input the second operation corresponding to the change of the language control.

S242, in response to the first operation corresponding to the application control, send the target content to the communication window, so as to realize the communication function; and/or, in response to the second operation corresponding to changing the language control, return to execute step S22 after updating the target language, to adopt Updated target language translation input.

Optionally, as shown in FIG. 10c, if the current target language is English, the first user enters the input content "good morning" into the input window, and clicks the first control to make the smart terminal and/or the application program use English Translate "good morning", and after obtaining the corresponding target content, output the second prompt message. If the first user clicks on the application control, the smart terminal and/or the application program will send the target content to the communication window, as shown in Figure 10d, and communicate with The second user communicates. Optionally, if the first user clicks the change language control, the smart terminal and/or the application program can also output a relevant input box for the first user to input the target language to be updated, and read the updated target language of the first user. After the language, translation instructions can be directly generated to retrieve the input content, translate the input content in the new target language, get the new target content, and send the new target content to the communication window to adopt the new target in the communication window Linguistic representation of input content. For example, for the second prompt message shown in Figure 10c, if the first user clicks the change language control to change the target language to French, the smart terminal and/or the application program can use French as the new target language to regain a new The target content, and then send the new target content to the communication window. At this time, the target content output by the communication window can refer to Figure 10e.

The smart terminal and/or the application program can turn on the smart translation function at startup, when generating the first prompt message for turning on the smart translation function, and/or at other times when the smart translation function needs to be turned on. In one embodiment, the process of enabling the smart translation function includes: responding to a first activation instruction of the smart translation function, outputting configuration information; responding to a configuration operation corresponding to the configuration information, enabling the smart translation function. The content of the configuration information may be determined according to features such as the object using the smart translation function and/or the function of the object. If the corresponding data processing method is applied to a smart terminal, the configuration information may include a specified program for using the smart translation function and/or a step setting for enabling the smart translation function according to the relevant first prompt information. If the corresponding data processing method is applied to the application program, the configuration information may include the timing of enabling the smart translation function, the input method of the translation instruction, and/or the step setting for enabling the smart translation function according to the relevant first prompt information. Optionally, if the intelligent translation function can use at least one language to translate the input content, the configuration information can also configure the current required language type, so that the user can select the target language from the provided multiple languages; optionally , each language provided in the configuration information has a corresponding translation tool, so that the input content can be input into the translation tool corresponding to the target language for translation to ensure the accuracy of the obtained target content. Optionally, after the first user performs the configuration operation according to the configuration information, he can click the exit control and/or the relevant confirmation button to enable the smart translation function, so that the smart terminal and/or the corresponding application program can enable the smart translation function.

In an example, the first opening instruction includes: an opening operation received by the second control. Optionally, the second control includes at least one of the following items:

The trigger control set on the pull-down menu on the screen, such as the pull-up menu, pull-down menu, left-pull menu and/or right-pull menu, etc. of the smart terminal screen, the trigger control shown in FIG. 7c is set in the pull-down menu.

The above data processing method can respond to the translation command of the target language, obtain the input content, translate the input content in the target language, and send the obtained target content to the communication window, so that relevant communication users can directly obtain the target language in the communication window Characterized input content can improve communication efficiency and communication experience. After the target content is determined or generated, the second prompt information can also be input for the user to choose between directly adopting the target content or changing the language. On the basis of ensuring the transmission efficiency of the communication content, the user is also provided with the opportunity to change the language , which can improve the flexibility of the corresponding data processing method and further enhance the user experience. When the corresponding smart translation function is turned on, it can be configured according to specific user needs, which can improve the matching degree between the smart translation function and user needs.

On the basis of the above embodiments, the fourth embodiment of the present application provides a data processing system, including:

The second obtaining module is used to respond to the translation instruction of the target language and obtain the input content;

The second translation module is used for translating the input content in the target language, and determining or generating the target content;

The sending module is used to send the target content to the communication window.

The embodiment of the present application also provides a smart terminal, the smart terminal includes a memory and a processor, and a data processing program is stored in the memory, and when the data processing program is executed by the processor, the steps of the data processing method described in any of the above embodiments are implemented.

Optionally, the data processing program includes a display program and/or a sending program. When the display program is executed by the processor, the steps of the method for displaying the target content in any of the above-mentioned embodiments are realized, and/or when the sending program is executed by the processor, the steps of the method for displaying the target content are realized. The steps of the method for sending target content in any of the above-mentioned embodiments.

An embodiment of the present application further provides a computer-readable storage medium, on which a data processing program is stored, and when the data processing program is executed by a processor, the steps of the data processing method described in any of the foregoing embodiments are implemented.

In the embodiments of the smart terminal and the computer-readable storage medium provided in this application, all the technical features of any of the above-mentioned data processing method embodiments may be included. Do not repeat them.

An embodiment of the present application further provides a computer program, the computer program includes computer program code, and when the computer program code is run on the computer, the computer is made to execute the methods in the above various possible implementation manners.

The embodiment of the present application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device installed with the chip executes the above various possible implementation modes. Methods.

It can be understood that the above scenario is only an example, and does not constitute a limitation on the application scenario of the technical solution provided by the embodiment of the present application, and the technical solution of the present application can also be applied to other scenarios. For example, those skilled in the art know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The steps in the methods of the embodiments of the present application can be adjusted, combined and deleted according to actual needs.

Units in the device in the embodiment of the present application may be combined, divided and deleted according to actual needs.

In this application, descriptions of the same or similar terms, concepts, technical solutions and/or application scenarios are generally only described in detail when they appear for the first time, and when they appear repeatedly later, for the sake of brevity, they are generally not repeated. When understanding the technical solutions and other contents of the present application, for the same or similar term concepts, technical solutions and/or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

In this application, the description of each embodiment has its own emphasis. For the parts that are not detailed or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

The various technical features of the technical solution of the present application can be combined arbitrarily. For the sake of concise description, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, all It should be regarded as the scope described in this application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in one of the above storage media (such as ROM/RAM, magnetic CD, CD), including several instructions to make a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) execute the method of each embodiment of the present application.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. Coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Usable media may be magnetic media, (eg, floppy disk, memory disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent protection scope of the present application in the same way.

Claims

A data processing method is characterized in that, comprising the following steps:

S12. Responding to the first display instruction in the target language, acquire the display content of the first area;

S13, using the target language to translate the display content, and determine or generate target content;

S14. Output the target content in the second area.
The method according to claim 1, wherein the acquiring process of the first display instruction comprises:

responding to a second display command in the target language;

Turn on the smart translation function, determine or generate the first display instruction in the target language;

And/or, if the smart translation function is not turned on, the first prompt message for turning on the smart translation function is output.
The method according to claim 2, wherein the second display instruction includes at least one of the following:

Display the area identification command corresponding to the interface;

The first trigger instruction received by the first control.
The method according to any one of claims 1 to 3, wherein the step S13 includes:

The display content is input into a preset content translation model, and the content translation model outputs the target content; the content translation model is used to translate specified content in a target language, and the specified content is represented by at least one language.
The method according to claim 4, wherein the content translation model is used to translate pictures represented by at least one language; the acquisition process of the content translation model includes:

Obtaining at least one sample picture represented by at least one language, and a translation result corresponding to at least one sample picture;

The initial network is trained by using the sample picture and the translation result to obtain the content translation model.
The method according to any one of claims 1 to 3, wherein the step S14 includes:

acquiring display features of the display content in the first area;

Outputting the target content in the second area according to the display characteristics.
The method according to any one of claims 1 to 3, wherein the opening process of the intelligent translation function includes:

Responding to the first start instruction of the smart translation function, outputting configuration information;

In response to the configuration operation corresponding to the configuration information, enable the intelligent translation function.
The method according to claim 7, wherein the first opening instruction includes: an opening operation received by the second control; and/or, the second control includes at least one of the following items:

The function control set in the setting item;

Trigger controls located on screen pull menus;

Trigger controls suspended on the display interface;

Shortcut controls located on the display desktop;

Voice wake-up control;

And a physical control for enabling the intelligent translation function.
The method according to any one of claims 1 to 3, characterized in that, after the step S14, the method further comprises:

Acquiring entities in the target content and associated information of the entities;

Outputting the association information in response to a second trigger instruction corresponding to the entity.
The method according to any one of claims 1 to 3, wherein if the second area covers at least one third control, after step S14, the method further includes:

The third control receives a third trigger instruction and responds to the third trigger instruction.
A data processing method is characterized in that, comprising the following steps:

S22, responding to the translation instruction of the target language, and obtaining the input content;

S23, using the target language to translate the input content to determine or generate target content;

S24. Send the target content to the communication window.
The method according to claim 11, wherein the step S23 includes:

The input content is input into a translation tool associated with the target language, and the target content is determined or generated according to the output content of the translation tool.
The method according to claim 11 or 12, wherein the step S24 includes:

S241. Output second prompt information, where the second prompt information includes an application control and/or a language replacement control;

S241. In response to the first operation corresponding to the application control, send the target content to the communication window, and/or in response to the second operation corresponding to the change language control, return to step S22 after updating the target language.
An intelligent terminal, characterized in that the intelligent terminal comprises: a memory and a processor, wherein a data processing program is stored in the memory, and when the data processing program is executed by the processor, the following claims 1 to 1 are implemented. Steps of the data processing method described in any one of 13.
A computer-readable storage medium, characterized in that a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the data processing method according to any one of claims 1 to 13 are implemented .