WO2021139711A1

WO2021139711A1 - Processing method and apparatus, and device and machine-readable medium

Info

Publication number: WO2021139711A1
Application number: PCT/CN2021/070602
Authority: WO
Inventors: 李洁; 胡雪梅; 方视菁; 葛妮瑜; 刘欢; 朱世艾
Original assignee: 阿里巴巴集团控股有限公司
Priority date: 2020-01-08
Filing date: 2021-01-07
Publication date: 2021-07-15
Also published as: CN113095898A

Abstract

Embodiments of the present application provide a processing method and apparatus, and a device and a machine-readable medium. The method comprises: receiving multimedia data input by a user, the multimedia data comprising: at least one image frame; determining whether the location of the user matches the location of a preset geographic area; if the location of the user does not match the location of the preset geographic area, determining at least one first commodity corresponding to the at least one image frame according to a first currency category corresponding to the preset geographic area, the commodity information corresponding to the first commodity comprising: a link and first price information, the first price information matching the first currency category; and displaying a comparison interface, the comparison interface comprising: a translation image corresponding to the at least one image frame, and commodity information corresponding to the at least one first commodity. The embodiments of the present application can improve the efficiency of overseas shopping.

Description

Processing method, device, equipment and machine readable medium

This application claims the priority of a Chinese patent application filed on January 8, 2020 with the application number 202010019663.3 and the invention title "a processing method, device, equipment and machine-readable medium", the entire content of which is incorporated herein by reference Applying.

Technical field

This application relates to the field of communication technology, in particular to a method for processing multimedia data, a method for processing voice data, a method for communication processing, a processing device based on multimedia data, a device, and a machine readable medium.

Background technique

With the development of economy and technology, users' living standards have gradually improved, and outbound travel and overseas shopping have become more and more common.

At present, in the process of overseas shopping, the price of commodities is usually an important factor for users to purchase overseas commodities. For example, some users will consider the price difference between overseas commodities and domestic commodities. At present, users often obtain the prices of overseas commodities and the prices of domestic commodities on the spot, and then determine whether to purchase overseas commodities based on the price difference between overseas commodities and domestic commodities.

In the process of implementing the embodiments of this application, the inventor found that users obtain the prices of domestic products through other users, or users search the prices of domestic products through the Internet. The above method of obtaining the prices of domestic products is time-consuming and laborious, which will lead to the efficiency of overseas shopping. Lower.

Summary of the invention

The technical problem to be solved by the embodiments of the present application is to provide a processing method based on multimedia data, which can improve the efficiency of overseas shopping.

Correspondingly, the embodiments of the present application also provide a voice data processing method, a communication processing method, a multimedia data processing device, a device, and a machine-readable medium to ensure the implementation of the above method And application.

In order to solve the foregoing problem, an embodiment of the present application discloses a method for processing multimedia data, including:

Receiving multimedia data input by a user; the multimedia data includes: at least one frame of image;

Determine whether the location of the user matches the location of the preset geographic area;

If the location of the user does not match the location of the preset geographic area, at least one first commodity corresponding to the at least one frame of image is determined according to the first currency type corresponding to the preset geographic area; The commodity information corresponding to the commodity includes: a link and first price information; the first price information matches the first currency category;

A comparison interface is displayed; the comparison interface includes: a translated image corresponding to the at least one frame of image, and product information corresponding to the at least one first product.

The embodiment of the application discloses a method for processing voice data, including:

Receive voice data input by the user;

Acquiring the second product and location information from the voice data;

If the location information does not match the preset geographic area, at least one first commodity corresponding to the second commodity is determined according to the first currency type corresponding to the preset geographic area; the commodity corresponding to the first commodity The information includes: a link and/or first price information; the first price information matches the first currency category;

The product information corresponding to the at least one first product is output.

The embodiment of the application discloses a communication processing method, including:

Receive the message sent by the correspondent end;

Acquiring the second commodity and location information from the message;

Sending the commodity information corresponding to the at least one first commodity to the communication peer.

On the other hand, the embodiment of the present application also discloses a multimedia data processing device, which includes:

The receiving module is configured to receive multimedia data input by the user; the multimedia data includes: at least one frame of image;

The judging module is used to judge whether the location of the user matches the location of the preset geographic area;

The commodity determination module is configured to determine at least one first currency corresponding to the at least one frame of image according to the first currency type corresponding to the preset geographic area if the location of the user does not match the location of the preset geographic area. Commodity; the commodity information corresponding to the first commodity includes: a link and first price information; the first price information matches the first currency category; and

The display module is configured to display a comparison interface; the comparison interface includes: a translated image corresponding to the at least one frame of image and product information corresponding to the at least one first product.

On the other hand, an embodiment of the present application also discloses a device, including:

One or more processors; and

One or more machine-readable media on which instructions are stored, when executed by the one or more processors, cause the device to perform one or more of the aforementioned methods.

In another aspect, the embodiments of the present application disclose one or more machine-readable media on which instructions are stored, which when executed by one or more processors, cause the device to execute one or more of the aforementioned methods.

The embodiments of the present application include the following advantages:

After receiving the multimedia data input by the user, the embodiment of the application will determine whether the location of the user matches the location of the preset geographic area. If not, the user is considered to be outside the preset geographic area, for example, if the preset The geographic area is the country to which the user belongs. If the user is outside the preset geographic area, the user can be considered to be in an overseas scene. In this case, the embodiment of the present application determines at least one first commodity corresponding to at least one frame of image in the multimedia data according to the first currency type corresponding to the above-mentioned preset geographic area, and provides a comparison interface, which may include : The translation image corresponding to the at least one frame of image and the product information corresponding to the at least one first product.

The first commodity in the embodiment of this application may originate from the Internet, and the second commodity in at least one frame of the image in the multimedia data may be an offline physical commodity. The comparison interface of the embodiment of this application can help users understand the first commodity on the Internet. Compare with offline physical products. In particular, the first price information of the first commodity in the comparison interface of the embodiment of the present application corresponds to the first currency type. The first currency type may be a currency type matching the preset geographic area. The first price information that matches the geographic area can meet the user's price comparison needs in overseas scenarios, that is, meet the user's need for price comparison between the second product in the multimedia data and the first product in the Internet.

In the case of meeting the user's price comparison needs in overseas scenarios, the above-mentioned first price information can help users quickly determine whether to purchase overseas commodities, so that the efficiency of overseas shopping can be improved, and the user experience can be improved.

Description of the drawings

FIG. 1 is a flowchart of the steps of Embodiment 1 of a method for processing multimedia data according to the present application;

FIG. 2 is a flowchart of steps of an embodiment of a method for determining a translation image according to the present application;

FIG. 3 is a flowchart of steps in Embodiment 2 of a multimedia data processing method according to the present application;

4A is a schematic diagram of an interface of an example of an image-based processing method according to an embodiment of the present application;

4B is another interface schematic diagram of an example of an image-based processing method according to an embodiment of the present application;

4C is another interface schematic diagram of an example of an image-based processing method according to an embodiment of the present application;

4D is another interface schematic diagram of an example of an image-based processing method according to an embodiment of the present application;

4E is another interface schematic diagram of an example of an image-based processing method according to an embodiment of the present application;

4F is another interface schematic diagram of an example of an image-based processing method according to an embodiment of the present application;

FIG. 5 is a flowchart of steps of an embodiment of a method for processing voice data according to the present application;

FIG. 6 is a flowchart of steps of an embodiment of a communication processing method of the present application;

Fig. 7 is a structural block diagram of an embodiment of an image-based processing device of the present application; and

Fig. 8 is a schematic structural diagram of a device provided by an embodiment of the present application.

Detailed ways

In order to make the above objectives, features, and advantages of the application more obvious and understandable, the application will be further described in detail below with reference to the accompanying drawings and specific implementations.

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art fall within the protection scope of this application.

The concept of the present application is easy to make various modifications and alternative forms, and its specific embodiments have been shown in the form of drawings and will be described in detail here. However, it should be understood that the above content is not used to limit the concept of the application to the specific form disclosed. On the contrary, the specification and appended claims of the application are intended to cover all modifications, equivalents, and alternative forms.

In this specification, "one embodiment", "an embodiment", "a specific embodiment", etc., mean that the described embodiment may include specific features, structures, or characteristics, but each embodiment may or may not necessarily include The specific feature, structure, or characteristic. Furthermore, such phrases do not necessarily refer to the same embodiment. In addition, when a specific feature, structure, or characteristic is described in connection with an embodiment, whether or not it is explicitly described, it can be considered that such a feature, structure, or characteristic is also related to other embodiments within the scope known to those skilled in the art. In addition, it should be understood that the items in the list included in the form "at least one of A, B and C" may include the following possible items: (A); (B); (C); ( A and B); (A and C); (B and C); or (A, B and C). Similarly, items listed in the form of "at least one of A, B or C" may mean (A); (B); (C); (A and B); (A and C); (B and C); or (A, B and C).

In some cases, the disclosed embodiments may be implemented as hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored in one or more temporary or non-transitory machine-readable (for example, computer-readable) storage media, and the instructions may be executed by one or more processors. A machine-readable storage medium can be implemented as a storage device, mechanism, or other physical structure (such as volatile or nonvolatile memory, media disk, or other media) for storing or transmitting information in a form that can be read by a machine. Physical structure device).

In the drawings, some structural or method features may be shown in a specific arrangement and/or order. However, preferably, such specific arrangement and/or ordering are not necessary. Conversely, in some embodiments, such features may be arranged in a different manner and/or order, rather than as shown in the drawings. In addition, the content contained in the structural or method features in a particular drawing is not meant to imply that such features are necessary in all embodiments, and in some embodiments, these features may not be included, or may be changed These features are combined with other features.

In view of the technical problem of low efficiency of overseas shopping, the embodiment of the present application provides an image-based processing solution, which specifically includes: receiving multimedia data input by a user; the above multimedia data includes: at least one frame of image; Whether the location of the location matches the location of the preset geographic area; if the location of the user does not match the location of the preset geographic area, the at least one frame of image is determined according to the first currency type corresponding to the preset geographic area Corresponding to at least one first product; the product information corresponding to the first product may include: link and first price information; the first price information matches the first currency category; and the comparison interface is displayed; in the comparison interface It may include: the translation image corresponding to the at least one frame of image and the product information corresponding to the at least one first product.

The method provided in the embodiments of the present application can be applied to the application environment corresponding to the client and the server. The client and the server are located in a wired or wireless network, and the client and the server exchange data through the wired or wireless network.

Optionally, the client can run on a terminal. The above-mentioned terminals include but are not limited to: smartphones, tablets, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III) Players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptop portable computers, car computers, desktop computers, set-top boxes, smart TVs, wearable devices, etc.

Optionally, the terminal of the embodiment of the present application may have a multimedia collection function, and accordingly, a multimedia collection device such as a camera may be provided in the terminal.

In the embodiment of the present application, the client can correspond to any APP (application, Application). For example, the APP corresponding to the client terminal may include: a payment APP, an image processing APP, an instant messaging APP, or a voice interaction APP, etc.

Method embodiment one

1, there is shown a step flowchart of Embodiment 1 of an image-based processing method of the present application. The method may specifically include the following steps:

Step 101: Receive multimedia data input by a user; the foregoing multimedia data may include: at least one frame of image;

Step 102: Determine whether the location of the user matches the location of the preset geographic area;

Step 103: If the location of the user does not match the location of the preset geographic area, determine at least one first commodity corresponding to the at least one frame of image according to the first currency type corresponding to the preset geographic area; The commodity information corresponding to the commodity may include: link and first price information; the first price information matches the first currency category;

Step 104: Display a comparison interface; the comparison interface may include: the translation image corresponding to the at least one frame of image and the product information corresponding to the at least one first product.

At least one step included in the method in the embodiment of the present application may be executed by the client, and it can be understood that the embodiment of the present application does not limit the specific execution subject of the steps included in the method.

In step 101, the multimedia data may include: image or video.

In practical applications, multimedia data can be obtained by shooting with a multimedia collection device. For example, a scan interface or a translation interface can be provided, and the collection of multimedia data can be triggered in response to a trigger operation on the scan interface or the translation interface. It can be understood that the embodiment of the present application does not impose restrictions on the specific acquisition method of the multimedia data.

In the embodiment of the present application, optionally, the second commodity may be included in at least one frame of the multimedia data. For example, in the case of offline shopping, the user can take a picture of the offline second product to obtain an image containing the second product.

In step 102, it is judged whether the location of the user matches the location of the preset geographic area, and it can be judged whether the user is within or outside the preset geographic area. For example, if the preset geographic area is the country to which the user belongs, if the user is outside the preset geographic area, the user may be considered to be in an overseas scene.

In the embodiment of the present application, optionally, the foregoing preset geographic area can be obtained according to user settings. For example, a setting interface for a preset geographic area may be provided to receive a preset geographic area input by the user through the setting interface.

In the embodiment of the present application, optionally, the above-mentioned preset geographic area can be obtained according to the location of the user in the historical time period. The historical time period may be the longest time period or the time period in which the time period exceeds the duration threshold, so that the location information of the user during the historical time period can be used to characterize the place of residence.

In step 103, the first currency type may be a currency circulating in a preset geographic area. For example, the currency in circulation in China is Renminbi, etc.

For example, user A's habitual residence is China and occasionally travels abroad, so it can be determined that the first currency type corresponding to user A is RMB corresponding to China. It can be understood that the embodiment of the present application does not limit the specific first currency type.

In the embodiment of the present application, optionally, the name of the first product is the same as the name of the second product in the image of the multimedia data, or the category of the first product is the same as the category of the second product in the image of the multimedia data.

In an optional embodiment of the present application, the foregoing determining at least one first commodity corresponding to the at least one frame of image may specifically include: determining information of the second commodity in the image; based on the information of the second commodity and the foregoing For the first currency category, at least one first commodity corresponding to the image is determined from the commodity database.

According to an embodiment, the foregoing determining at least one first commodity corresponding to the image from the commodity database may specifically include: searching the commodity database according to the information of the second commodity to obtain the candidate commodity; Get the first commodity that matches the above-mentioned first currency category. In this embodiment, the fields of the commodity database may include: commodity information, and therefore, candidate commodities may be obtained first based on the matching of commodity information. The attributes of the candidate commodities may include: currency type attributes. Therefore, the candidate commodities may be screened based on the matching of the currency type attributes to obtain the first commodity matching the first currency type.

According to another embodiment, the foregoing determining at least one first commodity corresponding to the image from the commodity database may specifically include: searching the commodity database corresponding to the first currency type according to the information of the second commodity to obtain the first commodity database. One commodity. In this embodiment, the commodity database can be classified according to currency types, and when searching, the commodity database corresponding to the first currency type can be used for searching. For example, the commodity database may include: a commodity database corresponding to RMB, or a commodity database corresponding to the US dollar, or a commodity database corresponding to the Euro.

The commodity database of the embodiment of the present application may be provided by an e-commerce platform, and it can be understood that the embodiment of the present application does not impose restrictions on a specific e-commerce platform.

According to an embodiment, the foregoing process of determining the second commodity in the image of the multimedia data may include: using image recognition technology to determine the second commodity in the image of the multimedia data.

Image recognition refers to the use of machines to process, analyze, and understand images to identify various image targets in different modes. Specific to the embodiments of the present application, a machine can be used to process, analyze, and understand images of multimedia data to identify various image targets in different modes. Generally, an image target may correspond to a certain image area in the image, and the image target may include: an object, a person, a space, etc., and the image target in the embodiment of the present application may be an object.

According to another embodiment, the foregoing process of determining the second commodity in the image of the multimedia data may include: using OCR (Optical Character Recognition) technology to recognize the characters in the image of the multimedia data, and obtain the result according to the recognized characters Information such as the name of the second product.

In another optional embodiment of the present application, the similarity between the image of the multimedia data and the commodity image of the candidate commodity may be determined first, and then the first commodity may be determined from the candidate commodities according to the similarity. For example, a candidate product whose similarity exceeds the similarity threshold can be selected as the first product.

In the embodiment of the present application, the quantity of the first commodity may be one or more. In the case where there are multiple first commodities, the multiple first commodities may be sorted according to the sorting characteristics, and a preset number of first commodities may be selected according to the sorting result. The ranking characteristics may include, but are not limited to: price information, sales characteristics, seller's trustworthiness characteristics, and so on. The preset number can be determined by those skilled in the art according to actual application requirements, for example, the preset number can be 2 or the like.

The above embodiments for determining at least one first product corresponding to the image of the above multimedia data have been described in detail. It can be understood that those skilled in the art can adopt any one or a combination of the above embodiments according to actual application requirements, and this application implements For example, the specific process of determining at least one first commodity corresponding to the image of the multimedia data is not limited.

In this embodiment of the application, after the first commodity is determined, the link of the first commodity and the first price information can be obtained. The link can be used to point to the page corresponding to the first product. Optionally, the link may include information such as the title of the first commodity.

The first price information may correspond to the first currency category. The first currency type may be a currency type that matches the preset geographic area, so that the first price information conforms to the habits of the preset geographic area to which the user belongs.

In step 104, the comparison interface can be used to compare the second product and the first product in the image of the multimedia data. The translation image in the comparison interface may include the information of the second commodity, and the comparison interface may include the first price information of the first commodity. Therefore, the information in the comparison interface can be used as a basis for comparing the second commodity with the first commodity.

The translated image can be obtained by translating the image of the multimedia data. In an overseas scenario, if the description language corresponding to the offline second product is different from the user's native language, language barriers are likely to occur, that is, it is difficult for the user to understand the description text of the product. For example, if the user's native language is the second language and the description language corresponding to the second product is the first language, assuming that the second language is Chinese and the first language is English or French, it may be difficult for the user to understand the description text of the product. The embodiment of the present application can use image translation technology to translate the image of the multimedia data into the translated image, and the characters corresponding to the translated image can be the first language, so as to improve the convenience for users to understand the description text of the product.

In an optional embodiment of the present application, the translation image may be obtained by replacing the source character image in the image of the multimedia data by using the translation character image; the parameters corresponding to the translation character image are those corresponding to the source character image. The parameters match; the above-mentioned parameters may include: position parameters and appearance parameters.

The translated character image can represent the image corresponding to the translated character. The source character image can represent the image corresponding to the source character. The images of multimedia data can include: background images, source character images, or non-character images (images corresponding to patterns, etc.),

The embodiment of the application uses the translated character image to replace the source character image in the image of the multimedia data, wherein the parameter corresponding to the translated character image matches the parameter corresponding to the source character image described above, so that the translation character image in the translated image can be improved. The degree of matching between the foreground and the background can in turn improve the appearance quality of the translated image.

In the embodiment of the present application, optionally, the comparison interface may include: an image area and a commodity area. The image is used to display the translated image. The commodity area is used to display the commodity information corresponding to the first commodity.

The image area and the merchandise area can be set up and down, for example, the image area is located in the upper area and the merchandise area is located in the lower area. Alternatively, the image area and the product area can be set left and right, for example, the image area is located in the left area, and the product area is located in the right area.

Alternatively, the image area and the commodity area may be located on different interface layers. For example, the image area is located in the first interface layer, the commodity area is located in the second interface layer, and the second interface layer is located above the first interface layer. The second interface layer can be a masking layer, and the masking layer can be a floating layer with adjustable transparency.

In an optional embodiment of the present application, the original interface may include a comparison trigger control, and the comparison interface may be displayed in response to a trigger operation on the comparison trigger control.

Optionally, the upper part of the original interface displays a translated image, and the lower part of the original interface displays a comparison trigger control, then in response to a sliding operation for the comparison trigger control, a floating layer is displayed on the original interface, and at least a floating layer is displayed in the floating layer. Information about a first product. The sliding operation may be a sliding operation from bottom to top.

In an optional embodiment of the present application, the above method may further include: obtaining the second currency type according to the location of the user; providing an input control in the above comparison interface for inputting the second price corresponding to the second commodity Information, the second price information corresponds to the second currency type.

Optionally, the above-mentioned second currency type may be obtained according to the location information of the user in the first time period. The first time period may be the most recent time period, and the end time of the first time period may be machine time. For example, the first time period may be the last day or the last two days. According to the first time period, the nearest temporary place where the user is located can be obtained, and the second currency type can be obtained according to the currency type of the nearest temporary place. Of course, the second currency type can be set by the user, or the second currency type can be obtained from the image of the multimedia data. For example, the image of the multimedia data may contain the information of the second currency type.

In an optional embodiment of the present application, the foregoing method may further include: in response to a user triggering operation on the foregoing input control, displaying exchange rate information between the first currency category and the second currency category.

The trigger operation for the aforementioned input control may be a click operation for the input control, etc., and in response to the click operation, the input focus may be displayed in the input control and exchange rate information may be displayed. For example, if the first currency type is Renminbi and the second currency type is US dollars, the exchange rate information may be "×7.5", etc., for the user's reference.

In an optional embodiment of the present application, the above method may further include: receiving second price information input by the user through the above input control; according to the conversion parameter between the first currency type and the second currency type, converting the second price The information is converted into third price information; the third price information corresponds to the first currency type; the third price information corresponding to the second price information is displayed in the comparison interface. The embodiment of the application can convert the second price information of the second currency type according to the exchange rate information to obtain the third price information.

After displaying the third price information corresponding to the above-mentioned second price information, the comparison interface may include: the translated image, the third price information, and the product information corresponding to the first product, so that the user can price the second product and the first product Compare.

In the embodiment of this application, it is optional that the above method is applied to the first program, and the link corresponding to the first product originates from the internal module of the first program, or the link corresponding to the first product originates from the second program. One program can display links in accordance with the rules of the second program.

In the case that the link corresponding to the first product originates from the internal module of the above-mentioned program, if a trigger operation for the link is received, the internal module can be used to load the page corresponding to the first product, and the program can be loaded without jumping to the program. The page corresponding to the first product is loaded, so the loading speed of the page corresponding to the first product can be increased, and the user experience can be improved.

Mini programs are applications that can be delivered from the server and executed in the application environment without installation. Mini programs generally cannot exist independently, relying on the application environment.

In this embodiment of the application, optionally, the applet can provide links and pages corresponding to the first product. The program corresponding to the client can provide an application environment for the applet so that the applet can be executed in the application environment. Then, if a trigger operation for the link is received, the applet can be called to load the page corresponding to the first product. Since the page corresponding to the first product can be loaded without jumping to the program, the loading speed of the page corresponding to the first product can be improved, and the user experience can be improved.

In summary, in the image-based processing method of the embodiment of this application, the first product can originate from the Internet, and the second product in at least one frame of image in the multimedia data can be an offline physical product. The comparison interface of the embodiment of this application can be Help users compare the first product on the Internet with offline physical products. In particular, the first price information of the first commodity in the comparison interface of the embodiment of the present application corresponds to the first currency type. The first currency type may be a currency type matching the preset geographic area. The first price information that matches the geographic area can meet the user's price comparison needs in overseas scenarios, that is, meet the user's need for price comparison between the second product in the multimedia data and the first product in the Internet.

Method embodiment two

Referring to FIG. 2, a flow chart of the steps of a method for determining a translation image according to an embodiment of the present application is shown, which may specifically include the following steps:

Step 201: Identify the source characters in the image of the multimedia data; the source characters correspond to the first language;

Step 202: Determine the translated character corresponding to the source character; the translated character corresponds to a second language;

Step 203: Replace the source character image in the image of the multimedia data with the translated character image to obtain the translation image; wherein the parameter corresponding to the translated character image matches the parameter corresponding to the source character image; the parameter may include : Position parameters and appearance parameters.

In step 201, OCR technology can be used to identify the source characters in the image of the multimedia data.

In step 202, machine translation technology can be used to determine the translated character corresponding to the source character; the translated character corresponds to the second language.

The second language can be set by the user, or the second language can be obtained based on the location information of the user during the second time period. Optionally, the user's frequently used location can be obtained according to the location information of the user in the second time period, and the second language can be obtained according to the language type corresponding to the frequently used location.

In an optional embodiment of the present application, the foregoing determining the translation character corresponding to the source character specifically includes: performing error correction on the source character; and determining the translation character corresponding to the source character after the error correction. The above-mentioned error correction can correct errors generated in the OCR process to improve the accuracy of machine translation, that is, the accuracy of translated characters can be improved.

In the embodiment of the present application, optionally, the error correction type may include: segmentation error correction, text error correction, or grammatical error correction, etc. It can be understood that the embodiment of the present application does not limit the error correction type of spinous processes.

In step 203, optionally, replacing the source character image in the image of the multimedia data with a translated character image may specifically include: removing the source character image from the image of the multimedia data to obtain an intermediate image; The position parameter corresponding to the source character image determines the position parameter corresponding to the translated character image; according to the position parameter corresponding to the translated character image, the intermediate image and the translated character image are synthesized to obtain the translated image.

The embodiment of the present application can remove the source character image from the image of the multimedia data. Assuming that the source character image corresponds to a location area in the image of the multimedia data, the location area of the multimedia data image includes the source character, the location area in the intermediate image may not include any characters, and the location area in the translation image may include Translation characters.

In the embodiment of the present application, optionally, the aforementioned appearance parameters may include: font parameters and background parameters. Font parameters can include: font type, font size, and font color. The background parameters may include: background color, etc. The font parameters can characterize the foreground of the translated character image, and the background parameters can characterize the background of the translated character image; therefore, the matching degree between the foreground and the background of the translated character image in the translated image can be improved.

The embodiment of the present application may determine the position parameter corresponding to the translated character image according to the position parameter corresponding to the source character image. Referring to Table 1, there is shown a schematic diagram of the mapping relationship between position parameters, source characters, and translated characters in an embodiment of the present application, where the position parameters can be represented by coordinates (x, y).

Table 1

位置参数Location parameter	源字符Source character	翻译字符Translate characters
x1，y1x1, y1	SwisseSwisse	瑞思Reith
x2，y2x2, y2	HAIR SKIN NAILS+HAIR SKIN NAILS+	头发皮肤指甲+Hair Skin Nails+

…

The embodiment of the application can synthesize the intermediate image and the translated character image according to the position parameter corresponding to the translated character image. Specifically, the translated character image can be placed at the position corresponding to the position parameter, and the image in the synthesized translation image The source character image can be included in the location area.

In summary, the method of the embodiment of the present application uses a translated character image to replace the source character image in the image of the multimedia data, wherein the parameters corresponding to the translated character image match the parameters corresponding to the source character image, so the translation can be improved. The matching degree between the foreground and background of the translated character image in the image can further improve the appearance quality of the translated image.

Method Example Three

Referring to FIG. 3, there is shown a step flow chart of Embodiment 2 of a multimedia data processing method according to the present application. The method may specifically include the following steps:

Step 301: Receive multimedia data input by a user; the above-mentioned multimedia data may include: at least one frame of image;

Step 302: Determine the translation image corresponding to the image of the multimedia data;

Step 303: Display the translated image and compare the trigger control;

Step 304: In response to the trigger operation for the comparison trigger control, determine at least one first product corresponding to the image of the multimedia data, and display a comparison interface; the comparison interface may include: the translation image and the at least one first product. Commodity information corresponding to the commodity;

The commodity information corresponding to the first commodity may specifically include: a link and first price information; the first price information may correspond to a first currency type.

In step 301, in response to a triggering operation for the scan interface, the shooting of the image of the multimedia data may be triggered, and the image of the multimedia data obtained by the shooting may be obtained.

In step 302, the image translation technology may be used to determine the translation image corresponding to the image of the multimedia data. For details, refer to the method embodiment described in FIG.

In step 303, the comparison trigger control may be located below the translated image. Optionally, the translation direction corresponding to the translated image, such as the translation direction from the first language to the second language, can also be displayed.

In step 304, at least one first commodity corresponding to the image of the multimedia data may be determined in response to the trigger operation of the comparison trigger control. For details, refer to the method embodiment 1, which will not be repeated here.

In step 304, a floating layer may be displayed on the translated image, and the floating layer includes commodity information corresponding to at least one first commodity.

Optionally, step 304 may be executed when the location of the user does not match the location of the preset geographic area, and a trigger operation for the above comparison trigger control is received.

In an optional embodiment of the present application, the foregoing comparison interface may further include: an input control, and the foregoing method may further include: in response to a user triggering operation on the foregoing input control, displaying the first currency type and the second currency type Exchange rate information between the two; the above-mentioned second currency type can be obtained based on the location information of the user in the first time period.

In an optional embodiment of the present application, the aforementioned method may further include: in response to the second price information input by the user through the aforementioned input control, displaying third price information corresponding to the aforementioned second price information; the aforementioned third price information Can correspond to the first currency type. The embodiment of the application can convert the second price information of the second currency type according to the exchange rate information to obtain the third price information.

After displaying the third price information corresponding to the second price information, the comparison interface may include: multimedia data images or translated images, the third price information, and the product information corresponding to the first product, so that the user can compare the second product with The price of the first commodity is compared.

In summary, the method of the embodiments of the present application, using image translation as the entry point, can help users understand non-native language text in outbound travel scenes; and can automatically identify the second product in the image of the multimedia data, relying on the data of the e-commerce platform Information, providing the first price information of the first commodity related to the second commodity, thereby satisfying the user's price comparison needs.

In addition, the embodiment of the present application may also perform exchange rate conversion on the second price information input by the user, so as to improve the convenience of price comparison between different currency types. Therefore, the embodiments of the present application can improve the affordability of outbound shopping and increase the user experience in the scenario of outbound shopping; and, during the implementation of the method, it is not necessary to jump to the page of the third-party program to improve the consistency of the method execution. Performance, which in turn can improve the operating efficiency of the method.

In order to enable those skilled in the art to better understand the embodiments of the present application, specific examples are used to illustrate the image-based processing methods of the embodiments of the present application. Referring to FIGS. 4A-4F, the image-based processing methods of the embodiments of the present application are shown. A schematic diagram of the interface of an example of an image processing method. The example may specifically include the following steps:

Step S1: Provide an image acquisition interface in response to a trigger operation for the translation interface. As shown in FIG. 4A, the image collection interface may include: previewed multimedia data image 401 and shooting controls 402; the translation direction may be the direction from English to Chinese;

Step S2: In response to the trigger operation on the shooting control 402, the translation interface is displayed. As shown in FIG. 4B, the image acquisition interface may include: a translation image 403, a refresh control 404, a download control 405, and a comparison trigger control 406. The refresh control 404 is used to trigger the display of the image acquisition interface, that is, to trigger a new shooting or a new scan.

Step S3: In response to the trigger operation of the comparison trigger control 406, a floating layer 407 is displayed on at least a part of the translated image 403, and the floating layer 407 may include: information of at least one first commodity. As shown in FIG. 4C, the floating layer 407 includes a first product A and a first product B. The floating layer 407 may also include: an input control 471.

Step S4: In response to the user's triggering operation on the input control 471, the keyboard 472 and the exchange rate information between the first currency type and the second currency type are displayed. As shown in FIG. 4D, the exchange rate information may be "×7.5". Optionally, the address information where the user is located can also be displayed, such as "Los Angeles" in the figure.

Step S5: Receive the second price information input by the user in the input control 471, and convert the second price information into third price information, such as "¥120" in FIG. 4E.

Step S6: Receive the second price information input by the user in the input control 471, and convert the second price information into third price information, such as "¥120" in FIG. 4E.

Step S7: In response to the operation of closing the keyboard, display the translated image, the second price information of the second commodity, and the information of the first commodity in the comparison interface, so that the user can compare prices corresponding to the first commodity and the second commodity.

Method embodiment four

Referring to FIG. 5, there is shown a step flowchart of an embodiment of a voice data processing method of the present application. The method may specifically include the following steps:

Step 501: Receive voice data input by the user;

Step 502: Obtain the second product and location information from the aforementioned voice data;

Step 503: If the location information does not match the preset geographic area, determine at least one first commodity corresponding to the second commodity according to the first currency type corresponding to the preset geographic area; commodity information corresponding to the first commodity It may include: link and/or first price information; the above-mentioned first price information matches the above-mentioned first currency type;

Step 504: Output the commodity information corresponding to the at least one first commodity.

The embodiment of the present application can provide the product information corresponding to the first product associated with the voice data for the voice data input by the user, thereby improving the convenience for the user to obtain the product information.

In the embodiment of the present application, the commodity information corresponding to the at least one first commodity can be played, so that information services can be realized through voice interaction. Of course, the commodity information corresponding to the at least one first commodity can also be displayed on the screen.

The embodiments of the present application may be applied to application scenarios of intelligent interaction. For example, an intelligent interaction portal may be provided to receive voice data input by a user through the portal, and provide corresponding feedback information to the user. Optionally, a chat robot can be used to interact intelligently with the user.

The embodiment of the present application can support the user to carry the second product and location information in the voice data, and the embodiment of the present application can perform semantic recognition on the voice data to obtain the second product and location information from the voice data. For example, the voice data can be: "A piece of ice hockey equipment in Toronto M Canadian dollars", "A 500ml bottle of Bordeaux red wine from a supermarket in Paris, France, N Euro" and so on.

The embodiments of the present application may use natural language processing methods to perform semantic recognition on speech data. The natural language processing method may include: entity word recognition method, syntactic analysis method, etc. It can be understood that the embodiment of the present application does not limit the specific natural language processing method.

Step 503: If the location information does not match the preset geographic area, it can be considered that the user is outside the preset geographic area, so at least one first product corresponding to the second product can be determined.

Optionally, the name of the first commodity is the same as the name of the second commodity, or the category of the first commodity is the same as the category of the second commodity.

In step 504, natural language may be used to play the commodity information corresponding to the at least one first commodity, such as: "500ml Bordeaux red wine in Tmall supermarket X yuan RMB" and so on. That is, the product information of the embodiment of the present application may include: information of the e-commerce platform where the first product is located, and information such as the specifications of the first product. Of course, the embodiment of the application can display the link and the first price information.

Method embodiment five

Referring to FIG. 6, there is shown a step flow chart of an embodiment of a communication processing method of the present application, and the method may specifically include the following steps:

Step 601: Receive a message sent by a communication peer;

Step 602: Obtain the second product and location information from the above message.

Step 603: If the location information does not match the preset geographic area, determine at least one first commodity corresponding to the second commodity according to the first currency type corresponding to the preset geographic area; commodity information corresponding to the first commodity It may include: link and/or first price information; the above-mentioned first price information matches the above-mentioned first currency type;

Step 604: Send the commodity information corresponding to the at least one first commodity to the communication peer.

The embodiment of the present application may reply to the message sent by the communication peer, and the reply content may include: the commodity information corresponding to the at least one first commodity mentioned above.

The embodiments of the present application may be applicable to situations where the communication peer is in an overseas scenario, and the user of the communication peer obtains the information and location information of the second commodity on the spot, and sends inquiry information to the communication local end to obtain reply information from the communication peer. For example, the message sent by the correspondent may be "I saw a coat in Paris, P Euro, is it expensive?" and so on.

The embodiment of the present application may use a natural language processing method to obtain the second product and location information from the above message, and determine at least one first product corresponding to the above second product when the location information does not match the preset geographic area. Commodities, such as the first commodity comes from a Tmall supermarket, etc.; and the commodity information corresponding to the at least one first commodity is automatically sent to the communication peer, thereby improving the convenience and intelligence of message reply.

For example, the message sent by the correspondent can be "I saw a coat in Paris, P Euro, is it expensive?", the corresponding reply content can be "This coat is sold for Q yuan in Tmall supermarket?" "Wait.

It should be noted that for the method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present application are not limited by the described sequence of actions, because According to the embodiments of the present application, some steps may be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

The embodiment of the application also provides a multimedia data processing device.

Referring to FIG. 7, there is shown a structural block diagram of an embodiment of a multimedia data processing apparatus according to the present application. The foregoing apparatus may specifically include the following modules:

The receiving module 701 is configured to receive multimedia data input by a user; the above-mentioned multimedia data includes: at least one frame of image;

The judging module 702 is used to judge whether the location of the user matches the location of the preset geographic area;

The commodity determination module 703 is configured to determine at least one first commodity corresponding to the at least one frame of image according to the first currency type corresponding to the preset geographic area if the location of the user does not match the location of the preset geographic area The commodity information corresponding to the first commodity includes: a link and first price information; the first price information matches the first currency category; and

The display module 704 is configured to display a comparison interface; the comparison interface includes: the translation image corresponding to the at least one frame of image and the product information corresponding to the at least one first product.

Optionally, the foregoing device may further include:

The second currency type determining module is used to obtain the second currency type according to the location of the user;

The input control providing module is configured to provide an input control in the comparison interface for inputting second price information corresponding to a second commodity, and the second price information corresponds to the second currency type.

Optionally, the foregoing device may further include:

The exchange rate information display module is used to display exchange rate information between the first currency type and the second currency type in response to the user's triggering operation on the aforementioned input control.

Optionally, the foregoing device may further include:

The second price display module is used to receive the second price information input by the user through the above-mentioned input control;

The price conversion module is configured to convert the second price information into third price information according to the conversion parameters between the first currency type and the second currency type; the third price information corresponds to the first currency type;

The third price display module is used to display the third price information corresponding to the second price information in the comparison interface.

Optionally, the foregoing device may further include:

The first area determining module is configured to obtain the foregoing preset geographic area according to user settings;

The second area determination module is used to obtain the aforementioned preset geographic area according to the location of the user in the historical time period.

Optionally, the foregoing device may further include:

The recognition module is used to recognize the source characters in the image; the above source characters correspond to the first language;

The translation character determination module is used to determine the translation character corresponding to the source character; the translation character corresponds to the second language;

The image replacement module is used to replace the source character image in the image with the translated character image to obtain the translated image; wherein the parameters corresponding to the translated character image match the parameters corresponding to the source character image; the parameters may include : Position parameters and appearance parameters.

Optionally, the above-mentioned image replacement module may include:

The removal module is used to remove the source character image from the above image to obtain an intermediate image;

The position parameter determination module is used to determine the position parameter corresponding to the translated character image according to the position parameter corresponding to the source character image;

The image synthesis module is used to synthesize the intermediate image and the translated character image according to the position parameter corresponding to the translated character image to obtain the translated image.

Optionally, the aforementioned translation character determination module may include:

Error correction module, used to correct the above source characters;

The translation module is used to determine the translation character corresponding to the source character after error correction.

Optionally, the aforementioned appearance parameters may include: font parameters and background parameters.

Optionally, the aforementioned commodity determining module 703 may include:

The second product information determining module is used to determine the information of the second product in the above-mentioned image;

The first commodity determining module is configured to determine at least one first commodity corresponding to the image from the commodity database based on the information of the second commodity and the first currency type.

Optionally, the above-mentioned first commodity determination module may include:

The first searching module is used to search the commodity database according to the information of the second commodity mentioned above to obtain candidate commodities;

The screening module is used to obtain the first commodity matching the above-mentioned first currency category from the above-mentioned candidate commodities.

The second searching module is used for searching the commodity database corresponding to the first currency type according to the information of the second commodity to obtain the first commodity.

As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.

The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other.

Regarding the device in the foregoing embodiment, the specific manner in which each module performs operation has been described in detail in the embodiment of the method, and detailed description will not be given here.

The embodiments of the embodiments of the present application can be implemented as a system or device that uses any appropriate hardware and/or software to perform a desired configuration. FIG. 8 schematically shows an exemplary device 1300 that can be used to implement the various embodiments described above in this application.

For one embodiment, FIG. 8 shows an exemplary device 1300. The device 1300 may include: one or more processors 1302, a system control module (chipset) 1304 coupled with at least one of the processors 1302, and a system The system memory 1306 coupled to the control module 1304, the non-volatile memory (NVM)/storage device 1308 coupled to the system control module 1304, one or more input/output devices 1310 coupled to the system control module 1304, and the system memory 1306 is coupled to the network interface 1312. The system memory 1306 may include instructions 1362, and the instructions 1362 may be executed by one or more processors 1302.

The processor 1302 may include one or more single-core or multi-core processors, and the processor 1302 may include any combination of a general-purpose processor or a special-purpose processor (such as a graphics processor, an application processor, a baseband processor, etc.). In some embodiments, the device 1300 can serve as the above-mentioned server, target device, wireless device, etc. in the embodiments of the present application.

In some embodiments, the device 1300 may include one or more machine-readable media with instructions (for example, the system memory 1306 or the NVM/storage device 1308) and be configured to be combined with the one or more machine-readable media One or more processors 1302 that execute instructions to implement the modules included in the foregoing device, so as to perform the foregoing actions in the embodiments of the present application.

The system control module 1304 of an embodiment may include any suitable interface controller for providing any suitable interface to at least one of the processors 1302 and/or any suitable device or component communicating with the system control module 1304.

The system control module 1304 of an embodiment may include one or more memory controllers for providing an interface to the system memory 1306. The memory controller may be a hardware module, a software module, and/or a firmware module.

The system memory 1306 of an embodiment may be used to load and store data and/or instructions 1362. For one embodiment, the system memory 1306 may include any suitable volatile memory, for example, a suitable DRAM (Dynamic Random Access Memory). In some embodiments, the system memory 1306 may include: a double data rate type quad synchronous dynamic random access memory (DDR4 SDRAM).

The system control module 1304 of an embodiment may include one or more input/output controllers to provide interfaces to the NVM/storage device 1308 and the input/output device(s) 1310.

The NVM/storage device 1308 of an embodiment may be used to store data and/or instructions 1382. The NVM/storage device 1308 may include any suitable non-volatile memory (such as flash memory, etc.) and/or may include any suitable non-volatile storage device(s), such as one or more hard disk drives ( HDD), one or more compact disc (CD) drives, and/or one or more digital versatile disc (DVD) drives, etc.

The NVM/storage device 1308 may include storage resources that are physically a part of the device on which the device 1300 is installed, or it may be accessed by the device and not necessarily be a part of the device. For example, the NVM/storage device 1308 may be accessed through the network and/or through the input/output device 1310 via the network interface 1312.

The input/output device(s) 1310 of an embodiment may provide an interface for the device 1300 to communicate with any other suitable devices. The input/output device 1310 may include communication components, audio components, sensor components, and the like.

The network interface 1312 of an embodiment may provide an interface for the device 1300 to communicate with any other suitable device through one or more networks, and the device 1300 may be based on one or more wireless network standards and/or any of the protocols. And/or protocols to wirelessly communicate with one or more components of the wireless network, such as accessing wireless networks based on communication standards, such as WiFi (Wireless Fidelity), 2G or 3G or 4G or 5G, or their Combine for wireless communication.

For one embodiment, at least one of the processors 1302 may be packaged with the logic of one or more controllers (eg, memory controllers) of the system control module 1304. For one embodiment, at least one of the processors 1302 may be packaged with the logic of one or more controllers of the system control module 1304 to form a system-in-package (SiP). For an embodiment, at least one of the processors 1302 may be integrated with the logic of one or more controllers of the system control module 1304 on the same new product. For one embodiment, at least one of the processors 1302 may be integrated with the logic of one or more controllers of the system control module 1304 on the same chip to form a system on chip (SoC).

In various embodiments, the device 1300 may include, but is not limited to, a computing device such as a desktop computing device or a mobile computing device (for example, a laptop computing device, a handheld computing device, a tablet computer, a netbook, etc.). In various embodiments, the device 1300 may have more or fewer components and/or different architectures. For example, in some embodiments, the device 1300 may include one or more cameras, keyboards, liquid crystal display (LCD) screens (including touch screen displays), non-volatile memory ports, multiple antennas, graphics chips, application specific integrated circuits (ASIC) and speakers.

Wherein, if the display includes a touch panel, the display screen can be implemented as a touch screen display to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.

The embodiment of the present application also provides a non-volatile readable storage medium. The storage medium stores one or more modules (programs). When the one or more modules are applied to a device, the device can execute Instructions for each method in the embodiment of this application.

In one example, a device is provided, including: one or more processors; and, instructions in one or more machine-readable media stored thereon, when executed by the one or more processors, cause The device executes the method in the embodiment of the present application, and the method may include: the method shown in FIG. 1 to FIG. 3.

In an example, one or more machine-readable media are also provided, on which instructions are stored, which when executed by one or more processors, cause the device to perform the method in the embodiment of the present application, and the method may include: The method shown in Figure 1 to Figure 3.

Regarding the device in the above-mentioned embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment of the method, which will not be elaborated here. For related parts, please refer to the part of the description of the method embodiment. can.

The embodiments of the present application are described with reference to the flowcharts and/or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable image-based processing device to produce a machine for execution by the processor of the computer or other programmable image-based processing device The instructions generate means for realizing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable image-based processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device, The instruction device realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable image-based processing device, so that a series of operation steps are executed on the computer or other programmable device to produce computer-implemented processing, so that the computer or other programmable device The executed instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Although the preferred embodiments of the embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.

Finally, it should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. Or there is any such actual relationship or sequence between operations. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or device. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other same elements in the process, method, article, or device that includes the element.

In the above, a method for processing multimedia data, a method for processing voice data, a method for communication processing, a device for processing multimedia data, a device, and a machine-readable medium provided by this application are performed In this article, specific examples are used to illustrate the principles and implementation of the application. The descriptions of the above examples are only used to help understand the methods and core ideas of the application; at the same time, for those skilled in the art According to the idea of this application, there will be changes in the specific implementation and the scope of application. In summary, the content of this specification should not be construed as a limitation to this application.

Claims

A method for processing multimedia data, characterized in that the method includes:

Receiving multimedia data input by a user; the multimedia data includes: at least one frame of image;

Determine whether the location of the user matches the location of the preset geographic area;

If the location of the user does not match the location of the preset geographic area, at least one first commodity corresponding to the at least one frame of image is determined according to the first currency type corresponding to the preset geographic area; The commodity information corresponding to the commodity includes: a link and first price information; the first price information matches the first currency category;

A comparison interface is displayed; the comparison interface includes: a translated image corresponding to the at least one frame of image, and product information corresponding to the at least one first product.
The method according to claim 1, wherein the method further comprises:

Obtain the second currency type according to the user's location;

An input control is provided in the comparison interface for inputting second price information corresponding to a second commodity, and the second price information corresponds to the second currency type.
The method according to claim 2, wherein the method further comprises:

In response to the user's triggering operation on the input control, the exchange rate information between the first currency category and the second currency category is displayed.
The method according to claim 2 or 3, wherein the method further comprises:

Receiving second price information input by the user through the input control;

Converting the second price information into third price information according to the conversion parameters of the first currency type and the second currency type; the third price information corresponds to the first currency type;

The third price information corresponding to the second price information is displayed in the comparison interface.
The method according to claim 1, wherein the method further comprises:

Obtaining the preset geographic area according to user settings;

According to the location of the user in the historical time period, the preset geographic area is obtained.
The method according to claim 1, wherein the method further comprises:

Identify the source characters in the image; the source characters correspond to the first language;

Determine the translated character corresponding to the source character; the translated character corresponds to a second language;

Replace the source character image in the image with a translated character image to obtain the translated image; wherein the parameters corresponding to the translated character image match the parameters corresponding to the source character image; the parameters include: position Parameters and appearance parameters.
The method according to claim 6, wherein the replacing the source character image in the image with a translated character image comprises:

Removing the source character image from the image to obtain an intermediate image;

Determine the position parameter corresponding to the translated character image according to the position parameter corresponding to the source character image;

According to the position parameter corresponding to the translated character image, the intermediate image and the translated character image are synthesized to obtain the translated image.
The method according to claim 6 or 7, wherein the determining the translation character corresponding to the source character comprises:

Perform error correction on the source character;

Determine the translation character corresponding to the source character after error correction.
The method according to claim 6 or 7, wherein the appearance parameters include: font parameters and background parameters.
The method according to claim 1 or 2 or 3 or 5 or 6 or 7, wherein said determining at least one first commodity corresponding to said at least one frame of image comprises:

Determine the information of the second commodity in the image;

According to the information of the second commodity and the first currency type, at least one first commodity corresponding to the image is determined from the commodity database.
The method according to claim 10, wherein the determining at least one first commodity corresponding to the image from a commodity database comprises:

According to the information of the second commodity, search the commodity database to obtain candidate commodities;

Obtain a first commodity matching the first currency category from the candidate commodities.
The method according to claim 10, wherein the determining at least one first commodity corresponding to the image from a commodity database comprises:

According to the information of the second commodity, the commodity database corresponding to the first currency category is searched to obtain the first commodity.
The method according to claim 10, wherein the name of the first product is the same as the name of the second product, or the category of the first product is the same as the category of the second product.
A method for processing voice data, which is characterized in that it comprises:

Receive voice data input by the user;

Acquiring the second product and location information from the voice data;

If the location information does not match the preset geographic area, at least one first commodity corresponding to the second commodity is determined according to the first currency type corresponding to the preset geographic area; the commodity corresponding to the first commodity The information includes: a link and/or first price information; the first price information matches the first currency category;

The product information corresponding to the at least one first product is output.
A communication processing method, characterized in that it comprises:

Receive the message sent by the correspondent end;

Acquiring the second commodity and location information from the message;

If the location information does not match the preset geographic area, at least one first commodity corresponding to the second commodity is determined according to the first currency type corresponding to the preset geographic area; the commodity corresponding to the first commodity The information includes: a link and/or first price information; the first price information matches the first currency category;

Sending the commodity information corresponding to the at least one first commodity to the communication peer.
A multimedia data processing device, characterized in that the device includes:

The receiving module is configured to receive multimedia data input by the user; the multimedia data includes: at least one frame of image;

The judging module is used to judge whether the location of the user matches the location of the preset geographic area;

The commodity determination module is configured to determine at least one first currency corresponding to the at least one frame of image according to the first currency type corresponding to the preset geographic area if the location of the user does not match the location of the preset geographic area. Commodity; the commodity information corresponding to the first commodity includes: a link and first price information; the first price information matches the first currency category; and

The display module is configured to display a comparison interface; the comparison interface includes: a translated image corresponding to the at least one frame of image and product information corresponding to the at least one first product.
A processing device, characterized in that it comprises:

One or more processors; and

One or more machine-readable media on which instructions are stored, when executed by the one or more processors, cause the device to perform the method according to one or more of claims 1-13.
One or more machine-readable media having instructions stored thereon, when executed by one or more processors, cause the device to execute the method according to one or more of claims 1-13.