CN109300177B - Picture processing method and device - Google Patents

Picture processing method and device Download PDF

Info

Publication number
CN109300177B
CN109300177B CN201710608259.8A CN201710608259A CN109300177B CN 109300177 B CN109300177 B CN 109300177B CN 201710608259 A CN201710608259 A CN 201710608259A CN 109300177 B CN109300177 B CN 109300177B
Authority
CN
China
Prior art keywords
additional information
information
picture
media
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710608259.8A
Other languages
Chinese (zh)
Other versions
CN109300177A (en
Inventor
孔伟
李超
邓思兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201710608259.8A priority Critical patent/CN109300177B/en
Priority to PCT/CN2018/096819 priority patent/WO2019020012A1/en
Publication of CN109300177A publication Critical patent/CN109300177A/en
Application granted granted Critical
Publication of CN109300177B publication Critical patent/CN109300177B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Television Signal Processing For Recording (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses a picture processing method and device. The picture processing method in the embodiment of the invention comprises the following steps: reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information; displaying the image information of the media picture and displaying the additional information in the expansion area; wherein presenting the additional information includes presenting one or more of: and playing the voice information and displaying the text information. The embodiment of the invention solves the problem that the information recording mode in the prior art cannot meet the requirement of users on diversified information in a recording scene because the content of the information is single and simplified.

Description

Picture processing method and device
Technical Field
The present invention relates to the field of, but not limited to, wireless communications, and in particular, to a method and apparatus for processing a picture.
Background
With the rapid development of wireless communication technology and the great popularization of mobile terminals, people can initiate communication requests and information interaction with other people in many scenes, for example, information interaction is performed through Application programs (APP) such as QQ, weChat or Facebook (Facebook).
In the current communication mode, on one hand, in the content of information interaction, the voice, the text and the picture are usually a plane information, the expression form is single and simplified, and the richer background or content information cannot be expressed. On the other hand, the voice, text and picture information are independently stored, so that inherent links of the voice, text and picture information in a specific scene are lost; for example, the user records a wonderful happy moment by taking pictures during a journey, but the pictures can only record visual information such as scenery, figures and the like, but cannot record the current moods of the user and the scenes of taking the pictures, and the user can record the place, time and current moods through voices or texts, but the voices or texts lack vivid image expressive force. That is, in the present day, the user's requirement for diversified information requiring to memorize or record scenes cannot be satisfied only by recording the scenes worth collecting through pictures or voices or texts whose expression forms are relatively single and simplified.
In summary, in the information recording manner in the prior art, the content of the information is single and simplified, so that the requirement of the user on the diversified information in the recording scene cannot be met.
Disclosure of Invention
In order to solve the technical problems, the embodiment of the invention provides a picture processing method and a picture processing device, which are used for solving the problem that the requirement of a user on diversified information in a recorded scene cannot be met because the content of information is single and simplified in the information recording mode in the prior art.
In a first aspect, an embodiment of the present invention provides a method for processing a picture, including:
reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
displaying the image information of the media picture and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: and playing the voice information and displaying the text information.
In a first possible implementation manner of the first aspect, before the reading the media picture, the method further includes:
and adding the additional information in the extension area of the picture to generate the media picture.
In a first possible implementation manner of the first aspect, in a second possible implementation manner, the adding the additional information in the extended area of the picture generates the media picture, including:
Forming the additional information;
and carrying out coding processing on the additional information, writing the coded additional information into an expansion area of the picture to generate the media picture, and adding identification information for indicating whether the additional information is included in the expansion area.
In a third possible implementation manner of the first aspect, the displaying the image information of the media picture and displaying the additional information in the extended area includes:
displaying the image information of the media picture and judging whether additional information exists in the expansion area of the media picture or not;
when judging that the additional information exists, displaying an icon corresponding to the additional information on the media picture;
upon receiving an operation to click on the icon, one or more of the following are presented: and playing the voice information and displaying the text information.
In a fourth possible implementation manner according to the first aspect, any one of the first to third possible implementation manners of the first aspect, the method further includes:
modifying the additional information of the media picture, the modifying comprising performing one or more of the following operations: and adding, modifying and deleting the additional information.
In a fifth possible implementation manner according to any one of the first to third possible implementation manners of the first aspect, the media picture includes a data area and an extension area, the extension area includes an identification area of additional information and a data area, the identification area of the additional information is used for recording whether the media picture includes the additional information and a type of the additional information, and the data area of the additional information is used for recording content of the additional information.
In a second aspect, an embodiment of the present invention provides a picture processing apparatus, including:
the reading module is used for reading the media picture, and the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
the display module is used for displaying the image information of the media picture read by the reading module and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: and playing the voice information and displaying the text information.
In a first possible implementation manner of the second aspect, the apparatus further includes:
And the generation module is used for adding the additional information in the extension area of the picture before the reading module reads the media picture to generate the media picture.
According to a first possible implementation manner of the second aspect, in a second possible implementation manner, the generating module includes:
a forming unit configured to form the additional information;
and the generation unit is used for carrying out coding processing on the additional information formed by the forming unit, writing the coded additional information into an extension area of the picture to generate the media picture, and adding identification information for indicating whether the additional information is included in the extension area.
In a third possible implementation manner of the second aspect, the display module includes:
the image display unit is used for displaying the image information of the media image read by the reading module;
the judging unit is used for judging whether additional information exists in the extension area of the media picture read by the reading module;
an icon display unit, configured to display an icon corresponding to additional information on the media picture when the determination unit determines that the additional information exists;
The picture display unit is also used for displaying one or more of the following contents when receiving the operation of clicking the icon: and playing the voice information and displaying the text information.
In a fourth possible implementation manner according to any one of the second aspect, the first to third possible implementation manners of the second aspect, the apparatus further includes:
a modification module for modifying the additional information of the media picture, the modification comprising performing one or more of the following operations: and adding, modifying and deleting the additional information.
In a fifth possible implementation manner according to any one of the second aspect and the first to third possible implementation manners of the second aspect, the media picture includes a data area and an extension area, the extension area includes an identification area of additional information and a data area, the identification area of additional information is used for recording whether the media picture includes additional information and a type of the additional information, and the data area of the additional information is used for recording content of the additional information.
In a third aspect, an embodiment of the present invention provides a picture processing apparatus, including: a memory and a processor;
The memory is used for storing executable instructions;
the processor is configured to execute the executable instructions stored in the memory, and perform the following operations:
reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
displaying the image information of the media picture and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: and playing the voice information and displaying the text information.
In a first possible implementation manner of the third aspect, when the processor executes the executable instruction, the following operations are further performed:
and adding the additional information in the extension area of the picture to generate the media picture.
In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium, where computer executable instructions are stored, and when the processor executes the computer executable instructions, the following operations are performed:
reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
Displaying the image information of the media picture and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: and playing the voice information and displaying the text information.
According to the picture processing method and device provided by the embodiment of the invention, by reading the media picture, the additional information in the expansion area of the media picture can be obtained, and when the media picture is displayed, the content of the additional information is displayed, and as the additional information comprises one or more of voice information and text information, the mode of displaying the additional information can correspondingly comprise: one or more of playing the voice information and displaying the text information; according to the method provided by the embodiment of the invention, through the media picture recorded with the image information and the additional information, various information in the media picture is displayed in various dimensions, the form and the content of an information recording mode are enriched, and the problem that the information recording mode in the prior art cannot meet the requirement of a user on the multiple information in a recorded scene due to single and simplified information content is solved.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate and do not limit the invention.
Fig. 1 is a flowchart of a picture processing method according to an embodiment of the present invention;
fig. 2 is a flowchart of another picture processing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a format of a media picture in a picture processing method according to an embodiment of the present invention;
fig. 4 is a flowchart of another picture processing method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of an encoding process in a picture processing method according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a picture processing device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of another image processing apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of another image processing apparatus according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail hereinafter with reference to the accompanying drawings. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be arbitrarily combined with each other.
The steps illustrated in the flowchart of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, while a logical order is depicted in the flowchart, in some cases, the steps depicted or described may be performed in a different order than presented herein.
With the development of communication technology and terminal equipment, users use a wireless communication mode to perform information interaction, so that a wider communication and exchange mode is achieved at present. On the one hand, due to the endless layering of social networks and systems, the system is as large as the APP of QQ, weChat, facebook and the like, and is as small as an instant messaging system (Instant Messenger, abbreviated as IM) system of one unit, intelligent positioning equipment, various internet products and the like, and information interaction is not involved, and the information interaction comprises the sending and sharing of information such as text, pictures, voice, video and the like. On the other hand, users can enjoy communication technology to bring more convenience and rapidness to the communication between people, and meanwhile, the user needs to record happiness, anger, fun and happiness of daily life; both the current visual information (e.g., pictures) and the current background and connotation information need to be recorded in order to share happiness, and each valuable, memorable scene instant in life needs to be recorded.
For example, the user records a number of wonderful moments during the journey, but wants to supplement each wonderful moment with more background information or express the happiness mood activated at the time, so that after a period of time, the user can browse the pictures, voice and text information of the recorded wonderful moment again, and can pass through the space and reproduce the situation. However, in the information recording mode in the prior art, the content of the information is single and simplified, so that the requirement of a user on diversified information in a recording scene cannot be met.
The following detailed description of the technical solution of the present invention is provided by specific embodiments, where the execution body in each of the following embodiments of the present invention may be a terminal device, for example, a mobile terminal, where the mobile terminal may be a transmitting end in an information interaction scene, may be a receiving end in an information interaction scene, or may be a terminal device that independently executes a display browsing operation. The following specific embodiments may be combined with each other, and some embodiments may not be repeated for the same or similar concepts or processes.
Fig. 1 is a flowchart of a picture processing method according to an embodiment of the present invention. The image processing method provided by the embodiment of the invention is suitable for the situation that the diversified information is displayed in the image, the method can be executed by an image processing device, the image processing device is realized by combining hardware and software, and the device can be integrated in a processor of the terminal equipment for calling by the processor. As shown in fig. 1, the method according to the embodiment of the present invention may include the following steps:
S110, reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information.
The image processing method provided by the embodiment of the invention is a processing mode for displaying diversified information in the image. The media picture described in the embodiment of the present invention is different from a picture only including image information in the prior art, in which the image information of the picture is recorded in a data-only area in a common picture, the media picture includes not only the data area but also an extended area, and the extended area has additional information therein, where the additional information is other information than the image information, for example, voice information, text information, etc., where the voice information may be a section of voice added by a terminal device when the media picture is formed, and the text information may be a section of text description added when the media picture is formed, and these additional information are used to explain or illustrate contents such as a moving scene, a background, and meaning information of the corresponding image information.
In practical application, as the pictures can generate direct and rich-content recording effects, the effect of recording scenes has higher advantages compared with voice information and text information; therefore, when a user records a scene worth collecting and memorizing, a shooting concept is generally selected, for example, a terminal device is generally used to shoot a picture, and the embodiment of the invention adopts a form of a media picture based on the picture, so that the content for recording mood, background and connotation information in a specific scene is represented by means of voice information and/or text information, thereby realizing a media picture different from the information recording mode in the prior art.
In the embodiment of the invention, after the terminal device reads the media picture, the terminal device can know that the media picture is a picture type different from a common picture, for example, after the terminal device reads the media picture, the terminal device can know according to the information in the expansion area of the media picture, and the media picture comprises voice information and/or text information, so that a display preview mode different from the existing picture is adopted in subsequent processing. It should be noted that, the format of the media picture in the embodiment of the present invention may be the same as that of the picture in the prior art, for example, the format is BMP, GIF, JPEG, that is, the extension area of the pictures in these formats includes additional information; the format of the media picture may also be a redefined picture format.
S120, displaying the image information of the media picture and displaying the additional information in the expansion area; wherein presenting the additional information includes presenting one or more of: and playing the voice information and displaying the text information.
In the embodiment of the invention, after the terminal device reads the media picture and acquires that the extension area of the media picture comprises the additional information, the media picture can be displayed in a display mode different from the existing picture. The information of the media picture comprises image information and additional information, the information is effective information of a recorded scene, diversified contents of the recorded scene of a user can be reflected, the image information which can be displayed on the basis that the media picture comprises various information can be displayed, in addition, the additional information in the display expansion area can be also included, and the content of the additional information is determined to comprise the voice information and/or the text information when the media picture is generated, so that the additional information is displayed, namely, the voice information and/or the text information is displayed, and in practical application, according to different contents in the additional information, a section of voice information can be played, a section of text information can be displayed, and the voice information and the text information can be simultaneously played.
It should be noted that, in the embodiment of the present invention, the execution body for reading and displaying the media picture is a terminal device. On the one hand, the application scene can be that a user plays back the stored media picture through the terminal equipment, and the playback process is to read and display the media picture, so that the user can see the image of the recorded scene and review the mood, background, connotation and the like during recording through the display of the media picture; on the other hand, the application scene can also be a transmitting end or a receiving end which carries out information interaction through social software, a media picture can be generated by the transmitting end, the content of the media picture and the content of the display additional information can be read and browsed at the local end and sent to the receiving end, and then after the receiving end receives the media picture, the receiving end can browse the media picture and play voice information or browsing text information in the media picture.
The image processing method provided by the embodiment of the invention aims at the problem that in the existing information recording mode, only single information such as images, voices or texts can be recorded, so that the expression form of the information is single and simplified.
According to the picture processing method provided by the embodiment of the invention, by reading the media picture, the additional information in the expansion area of the media picture can be obtained, and when the media picture is displayed, the content of the additional information is displayed, and because the additional information comprises one or more of voice information and text information, the mode of displaying the additional information can correspondingly comprise: one or more of playing the voice information and displaying the text information; according to the method provided by the embodiment of the invention, through the media picture recorded with the image information and the additional information, various information in the media picture is displayed in various dimensions, the form and the content of an information recording mode are enriched, and the problem that the information recording mode in the prior art cannot meet the requirement of a user on the multiple information in a recorded scene due to single and simplified information content is solved.
Optionally, fig. 2 is a flowchart of another picture processing method according to an embodiment of the present invention. On the basis of the above embodiment, the embodiment of the present invention may further include, before S110:
and S100, adding additional information in the extension area of the picture to generate a media picture.
The implementation manner of S100 in the embodiment of the present invention may include: forming additional information; and carrying out coding processing on the additional information, writing the coded additional information into an extension area of the picture to generate the media picture, and adding identification information for indicating whether the additional information is included in the extension area.
In the embodiment of the invention, the additional information is formed, a section of voice information can be recorded and/or a section of text information can be input for a selected picture or a shot picture, and the voice information and/or the text information can be encoded, and because the picture can comprise a data area and an expansion area, the voice information and/or the text information after the encoding process can be filled into the expansion area of the picture, and at the moment, the media picture in the embodiment of the invention is generated on the basis of a common picture; in addition, identification information may be added to the extension area so that it can be recognized which types of information are included in the additional information when the browsed media picture is subsequently displayed.
In practical applications, the additional information may be encoded in the following manner: if the additional information only comprises voice information or text information, the voice information or the text information can be encoded, and the encoded information is written into the expansion area; if the additional information includes voice information and text information, the voice information can be read first and positioned to the self-data area of the voice file, the identification of the text information is stored in the self-data area first, then the text information is filled in the self-data area of the voice file, and then the voice file is encoded and written in the expansion area of the picture.
The application scenario of the embodiment shown in fig. 2 may be: on the one hand, when a user uses the terminal equipment to shoot a picture, or when the user browses the existing picture in the terminal equipment, the user is prompted to add accessory information to the shot picture or the selected picture according to the operation of the terminal equipment so as to generate a media picture; on the other hand, the sending end which carries out information interaction through the social software prompts a user to add additional information to the picture according to the operation of the terminal equipment after shooting or selecting the picture and before sending the picture so as to generate the media picture.
Optionally, fig. 3 is a schematic diagram of a format of a media picture in the picture processing method according to the embodiment of the present invention. As can be seen from the manner of generating the media picture in the above embodiment, the media picture may include a data area 210 and an extension area 220, wherein the data area 210 has image information recorded therein, the extension area 220 includes an identification area 221 and a data area 222 of additional information, the identification area 221 of the additional information is used for recording whether the media picture contains the additional information and the type of the additional information, and the data area 222 of the additional information is used for recording the content of the additional information. When the terminal device reads the media picture, it can read the data area 210 of the media picture and locate the data area to the expansion area 220, and the identification information is recorded in the identification area 221 of the expansion area 220, for example, if the identification information is 0, it indicates that there is no additional information, if the identification information is 1, it indicates that the additional information is voice information, if the identification information is 2, it indicates that the additional information is text information, if the identification information is 3, it indicates that the additional information is voice information and text information; when the identification information is read, the type of the additional information may be added, and the content of the additional information may be read in the corresponding data area 222, thereby performing presentation.
Optionally, in an embodiment of the present invention, the implementation manner of S120 may include:
s121, displaying image information of a media picture and judging whether additional information exists in an expansion area of the media picture;
s122, when the existence of the additional information is judged, displaying an icon corresponding to the additional information on the media picture;
s123, when an operation of clicking on the icon is received, one or more of the following are presented: and playing the voice information and displaying the text information.
In the embodiment of the invention, when the existence of the additional information is judged, the type of the additional information can be determined according to the identification information in the expansion area, namely, a corresponding icon can be displayed on the media picture, for example, the identification information is 3, the additional information comprises voice information and text information, the icon can comprise voice icon and text icon, when the operation of clicking the voice icon by a user is received, the corresponding voice is played, and when the operation of clicking the text icon by the user is received, the corresponding text content is displayed; the icon may be, for example, a virtual key displayed on a picture. On the other hand, when it is determined that the additional information does not exist, the media picture may be displayed in a manner in the related art, that is, only the image information is displayed.
Further, the image processing method provided by the embodiment of the invention further may include:
s130, modifying the additional information of the media picture, the modifying comprising performing one or more of the following operations: and adding, modifying and deleting the additional information.
In the embodiment of the invention, the application scene is a terminal device used independently, or a transmitting end and a receiving end for information interaction, and the media picture can be modified on the basis of reading and displaying the generated media picture, and the modification is actually carried out on the additional information in the expansion area, including the operations of adding, modifying, deleting and the like on voice information and/or text information.
The picture processing method provided by the embodiment of the invention solves the problem that the expression forms of pictures, voices and texts are single and simplified in the existing information recording mode through a novel media picture, and is used for explaining the scene, background and connotation information corresponding to the recorded pictures by enhancing the internal connection of the pictures, voices and texts, so that the terminal equipment and social software can effectively improve, promote and enhance the user experience and the enthusiasm degree of the user on the processing mode after the picture processing method provided by the embodiment of the invention is used.
An implementation example is taken as an example to describe an implementation manner of the picture processing method provided by the embodiment of the present invention. As shown in fig. 4, which is a flowchart of another picture processing method according to an embodiment of the present invention, the method shown in fig. 4 is shown by taking an application scenario of information interaction through social software as an example, an execution body includes a sending end and a receiving end, and the sending end and the receiving end have established a network connection, and this implementation example includes the following steps:
s301, starting social software by a sending end and a receiving end; for example, QQ, weChat, facebook, etc.
S302, a transmitting end and a receiving end select a chat interface; the chat interface is related to the type of social software that is launched.
S303, the sender selects the media picture type in the chat interface.
S304, the sending end selects pictures; for example, the method can select to take the picture by adopting the local camera, browse and select the existing picture of the local terminal, and generate the picture through screenshot software.
S305, the sending end prompts the user whether to record voice information or not; if the recording of the voice information is selected, S306 is executed, and if the recording of the voice information is not selected, S307 is executed.
S306, recording voice information by a transmitting end; recording the required voice information according to the actual requirement.
S307, the sending end prompts the user whether to input text information; if the text information is selected to be input, S308 is executed, and if the text information is selected not to be input, S309 is executed.
S308, the transmitting end inputs text information.
S309, the transmitting end judges whether the recorded voice information exists; if yes, executing S310; if not, S315 is performed.
S310, the transmitting end encodes the recorded voice information and the input text information to generate additional information.
S311, the sending end writes the additional information into the expansion area of the selected picture to generate a media picture; the processing mode for generating the media pictures is convenient for sharing, storing and transmitting.
S312, the sending end sends the media picture to the receiving end through social software.
S313, after the receiving end reads the received media picture, judging whether additional information exists in the expansion area of the media picture; since the additional information has been added to the media picture in S310 and S311, it is determined here that the additional information exists.
S314, the receiving end displays the image information of the media picture, and plays the voice information and the display text information.
S315, the sending end sends the common picture to the receiving end through social software.
S316, after the receiving end reads the received common picture, the picture is displayed in a common mode.
In this embodiment, the steps S310 to S314 and S315 to S316 are parallel embodiments, and S310 to S314 are display modes after the receiving end receives the media picture in the embodiment of the present invention, and S315 to S316 are display modes after the receiving end receives the normal picture.
Optionally, the present embodiment may further include the following steps after S314:
s317, the receiving end performs an adding, modifying or deleting operation on the additional information (including the voice information and/or the text information) in the media picture.
S318, the receiving end updates the additional information of the expansion area in the media picture, and saves the editing of the voice information and/or the text information.
In this embodiment, the transmitting end may execute the steps S317 to S318 to modify the media picture generated by itself.
Optionally, fig. 5 is a schematic diagram of an encoding process in the picture processing method according to the embodiment of the present invention. The execution body of the embodiment may be a terminal device that performs an operation independently, or may be a transmitting end in an interaction scenario, and the embodiment may include the following steps:
s401, selecting a target picture;
s402, judging whether voice information is recorded or not; if the voice information is recorded, S403 is executed, and if the voice information is not recorded, S406 is executed;
S403, judging whether text information is input; if text information is input, S404 is executed, and if text information is not input, S405 is executed;
s404, reading the voice information, positioning the voice information to a self-data area of the voice file, storing the identification of the text information in the self-data area, and filling the text information into the self-data area of the voice file;
s405, coding the voice file, and writing the coding result into an expansion area of the picture; ending the flow;
s406, judging whether text information is input; if text information is input, S407 is executed, and if text information is not input, the flow is ended;
s407, coding the text information, and writing the coding result into an expansion area of the picture; the flow is then ended.
Fig. 6 is a schematic structural diagram of a picture processing device according to an embodiment of the present invention. The image processing device provided by the embodiment of the invention is suitable for the situation that the diversified information is displayed in the image, the image processing device is realized in a mode of combining hardware and software, and the device can be integrated in a processor of the terminal equipment for calling by the processor. As shown in fig. 6, the picture processing apparatus 10 of the present embodiment may include: a reading module 11 and a display module 12.
The reading module 11 is configured to read a media picture, where an extension area of the media picture includes additional information; the additional information includes one or more of voice information and text information.
The image processing device 10 provided by the embodiment of the invention is used for executing a processing mode for displaying diversified information in an image. The media picture described in the embodiment of the present invention is different from a picture only including image information in the prior art, in which the image information of the picture is recorded in a data-only area in a common picture, the media picture includes not only the data area but also an extended area, and the extended area has additional information therein, where the additional information is other information than the image information, for example, voice information, text information, etc., where the voice information may be a section of voice added by a terminal device when the media picture is formed, and the text information may be a section of text description added when the media picture is formed, and these additional information are used to explain or illustrate contents such as a moving scene, a background, and meaning information of the corresponding image information.
In practical application, as the pictures can generate direct and rich-content recording effects, the effect of recording scenes has higher advantages compared with voice information and text information; therefore, when a user records a scene worth collecting and memorizing, a shooting concept is generally selected, for example, a terminal device is generally used to shoot a picture, and the embodiment of the invention adopts a form of a media picture based on the picture, so that the content for recording mood, background and connotation information in a specific scene is represented by means of voice information and/or text information, thereby realizing a media picture different from the information recording mode in the prior art.
In the embodiment of the present invention, after the reading module 11 reads the media picture, it may be known that the media picture is a picture type different from a common picture, for example, after the reading module 11 reads the media picture, it may be known that the media picture includes voice information and/or text information according to information in an extension area of the media picture, so that a display preview manner different from that of an existing picture is adopted in subsequent processing. It should be noted that, the format of the media picture in the embodiment of the present invention may be the same as that of the picture in the prior art, for example, the format is BMP, GIF, JPEG, that is, the extension area of the pictures in these formats includes additional information; the format of the media picture may also be a redefined picture format.
The display module 12 is used for displaying the image information of the media picture read by the reading module 11 and displaying the additional information in the expansion area; wherein presenting the additional information includes presenting one or more of: and playing the voice information and displaying the text information.
In the embodiment of the present invention, after the reading module 11 reads the media picture and obtains that the extension area of the media picture includes additional information, the display module 12 may display the media picture in a display manner different from that of the existing picture. Since the information of the media picture includes image information and additional information, the information is effective information of the recording scene, and can represent diversified contents when the user records the scene, on the basis that the media picture includes various information, the display operation performed by the display module 12 can include displaying the image information of the media picture, and in addition, can include displaying the additional information in the expansion area, and since the content of the additional information is determined when the media picture is generated, for example, the additional information includes the voice information and/or the text information, the display module 12 displays the additional information, that is, displays the voice information and/or the text information, and in practical application, can display a piece of voice information, a piece of text information, or both the voice information and the text information according to different contents in the additional information.
It should be noted that, in the embodiment of the present invention, the execution body for reading and displaying the media picture is a terminal device. On the one hand, the application scene can be that a user plays back the stored media picture through the terminal equipment, and the playback process is to read and display the media picture, so that the user can see the image of the recorded scene and review the mood, background, connotation and the like during recording through the display of the media picture; on the other hand, the application scene can also be a transmitting end or a receiving end which carries out information interaction through social software, a media picture can be generated by the transmitting end, the content of the media picture and the content of the display additional information can be read and browsed at the local end and sent to the receiving end, and then after the receiving end receives the media picture, the receiving end can browse the media picture and play voice information or browsing text information in the media picture.
The image processing device 10 provided in the embodiment of the invention aims at the problem that in the existing information recording mode, only single information such as a picture, voice or text can be recorded, so that the expression form of the information is single and simplified.
The image processing apparatus 10 provided in the embodiment of the present invention is used for executing the image processing method provided in the embodiment shown in fig. 1, and has corresponding functional modules, and its implementation principle and technical effects are similar, and will not be described herein again.
Optionally, fig. 7 is a schematic structural diagram of another image processing apparatus according to an embodiment of the present invention. Based on the structure of the apparatus shown in fig. 6, the image processing apparatus 10 provided in the embodiment of the present invention may further include:
a generating module 13, configured to add additional information in the extended area of the picture before the media picture read by the reading module 11, and generate a media picture.
The generating module 13 in the embodiment of the present invention may include:
a forming unit 131 for forming additional information;
a generating unit 132 for performing encoding processing on the additional information formed by the forming unit 131, writing the encoded additional information into an extension area of the picture to generate a media picture, and adding identification information indicating whether the additional information is included in the extension area.
In the embodiment of the present invention, the forming unit 131 forms additional information, which may be recording a piece of voice information and/or inputting a piece of text information for a selected picture or a photographed picture, and the generating unit 132 performs encoding processing on the voice information and/or text information, and since the picture may include a data area and an extension area, the encoded voice information and/or text information may be filled into the extension area of the picture, so that the media picture in the embodiment of the present invention is generated on the basis of a common picture; in addition, identification information may be added to the extension area so that it can be recognized which types of information are included in the additional information when the browsed media picture is subsequently displayed.
In practical applications, the additional information may be encoded in the following manner: if the additional information only comprises voice information or text information, the voice information or the text information can be encoded, and the encoded information is written into the expansion area; if the additional information includes voice information and text information, the voice information can be read first and positioned to the self-data area of the voice file, the identification of the text information is stored in the self-data area first, then the text information is filled in the self-data area of the voice file, and then the voice file is encoded and written in the expansion area of the picture.
The application scenario of the embodiment shown in fig. 7 may be: on the one hand, when a user uses the terminal equipment to shoot a picture, or when the user browses the existing picture in the terminal equipment, the user is prompted to add accessory information to the shot picture or the selected picture according to the operation of the terminal equipment so as to generate a media picture; on the other hand, the sending end which carries out information interaction through the social software prompts a user to add additional information to the picture according to the operation of the terminal equipment after shooting or selecting the picture and before sending the picture so as to generate the media picture.
Referring to the format of the media picture shown in fig. 3, the media picture in the embodiment of the present invention may include a data area 210 and an extension area 220, wherein image information is recorded in the data area 210, the extension area 220 includes an identification area 221 and a data area 222 of additional information, the identification area 221 of the additional information is used for recording whether the media picture contains the additional information and the type of the additional information, and the data area 222 of the additional information is used for recording the content of the additional information.
Alternatively, in an embodiment of the present invention, the display module 12 may include:
a picture display unit for displaying the image information of the media picture read by the reading module 11;
a judging unit for judging whether the additional information exists in the extended area of the media picture read by the reading module 11;
an icon display unit, configured to display an icon corresponding to the additional information on the media picture when the judging unit judges that the additional information exists;
the picture display unit is further used for displaying one or more of the following contents when an operation of clicking the icon is received: and playing the voice information and displaying the text information.
In the embodiment of the invention, when the judging unit judges that the additional information exists, the type of the additional information can be determined according to the identification information in the expansion area, namely, a corresponding icon can be displayed on the media picture, for example, the identification information is 3, the additional information comprises voice information and text information, the icon can comprise voice icon and text icon, when the operation of clicking the voice icon by a user is received, the corresponding voice is played, and when the operation of clicking the text icon by the user is received, the corresponding text content is displayed. On the other hand, when the judging unit judges that the additional information is not present, the picture displaying unit may display the media picture in a manner in the related art, that is, only the image information.
Further, the image processing apparatus 10 provided in the embodiment of the present invention may further include:
a modification module 14 for modifying the additional information of the media picture, the modification comprising performing one or more of the following operations: and adding, modifying and deleting the additional information.
In the embodiment of the invention, the application scene is a terminal device used independently, or a transmitting end and a receiving end for information interaction, and the media picture can be modified on the basis of reading and displaying the generated media picture, and the modification is actually carried out on the additional information in the expansion area, including the operations of adding, modifying, deleting and the like on voice information and/or text information.
The image processing apparatus 10 provided in the embodiment of the present invention is used for executing the image processing method provided in the embodiment shown in fig. 2, and has corresponding functional modules, and its implementation principle and technical effects are similar, and will not be described herein again.
Fig. 8 is a schematic structural diagram of another image processing apparatus according to an embodiment of the present invention. The image processing apparatus 20 provided in the embodiment of the present invention may include: a memory 21 and a processor 22.
Wherein the memory 21 is used for storing executable instructions;
The processor 22 is configured to execute the executable instructions stored in the memory 21, and perform the following operations:
s51, reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
s52, displaying the image information of the media picture and displaying the additional information in the expansion area; wherein presenting the additional information includes presenting one or more of: and playing the voice information and displaying the text information.
Optionally, in the embodiment of the present invention, when the processor 22 executes the executable instruction, the following operations are further performed before S51:
and S50, adding additional information in the extension area of the picture to generate the media picture.
Optionally, in an embodiment of the present invention, when the processor 22 executes the executable instructions, executing the implementation of S50 may include:
s501, forming additional information;
s502, carrying out coding processing on the additional information, writing the coded additional information into an expansion area of the picture to generate a media picture, and adding identification information for indicating whether the additional information is included in the expansion area.
Optionally, in an embodiment of the present invention, when the processor 22 executes the executable instructions, executing the implementation of S52 may include:
S521, displaying the image information of the media picture and judging whether additional information exists in the expansion area of the media picture;
s522, when judging that the additional information exists, displaying an icon corresponding to the additional information on the media picture;
s523, when an operation of clicking on the icon is received, one or more of the following is presented: and playing the voice information and displaying the text information.
Optionally, in an embodiment of the present invention, when the processor 22 executes the executable instructions, the following operations are further performed:
s53, modifying the additional information of the media picture, the modifying comprising performing one or more of the following operations: and adding, modifying and deleting the additional information.
The embodiment of the invention also provides a computer readable storage medium, which stores computer executable instructions, and when the processor executes the computer executable instructions, the following operations are performed:
s61, reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
s62, displaying image information of the media picture and displaying additional information in the expansion area; wherein presenting the additional information includes presenting one or more of: and playing the voice information and displaying the text information.
Optionally, in an embodiment of the present invention, when the processor executes the computer executable instructions, the following operations are further performed before S61:
and S60, adding additional information in the extension area of the picture to generate a media picture.
Optionally, in an embodiment of the present invention, when the processor executes the computer executable instructions, executing the implementation of S60 may include:
s601, forming additional information;
s602, carrying out coding processing on the additional information, writing the coded additional information into an extension area of the picture to generate a media picture, and adding identification information for indicating whether the additional information is included in the extension area.
Optionally, in an embodiment of the present invention, when the processor executes the computer executable instructions, executing the implementation of S62 may include:
s621, displaying image information of the media picture and judging whether additional information exists in an expansion area of the media picture;
s622, when the existence of the additional information is judged, displaying an icon corresponding to the additional information on the media picture;
s623, when an operation of clicking on the icon is received, one or more of the following is presented: and playing the voice information and displaying the text information.
Optionally, in an embodiment of the present invention, when the processor executes the computer executable instructions, the following operations are further performed:
s63, modifying the additional information of the media picture, the modifying comprising performing one or more of the following operations: and adding, modifying and deleting the additional information.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of the methods described above may be performed by a program that instructs associated hardware (e.g., a processor) to perform the steps, and that the program may be stored on a computer readable storage medium such as a read only memory, a magnetic or optical disk, etc. Alternatively, all or part of the steps of the above embodiments may be implemented using one or more integrated circuits. Accordingly, each module/unit in the above embodiments may be implemented in the form of hardware, for example, by an integrated circuit, or may be implemented in the form of a software functional module, for example, by a processor executing a program/instruction stored in a memory to implement its corresponding function. Embodiments of the invention are not limited to any specific form of combination of hardware and software.
Although the embodiments of the present invention are described above, the embodiments are only used for facilitating understanding of the present invention, and are not intended to limit the present invention. Any person skilled in the art can make any modification and variation in form and detail without departing from the spirit and scope of the present disclosure, but the scope of the present disclosure is to be determined by the appended claims.

Claims (13)

1. A picture processing method, comprising:
reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
displaying the image information of the media picture and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: playing the voice information and displaying the text information; wherein,
the media picture comprises a data area and an extension area, wherein the extension area comprises an identification area and a data area of additional information, the identification area of the additional information is used for recording whether the media picture contains the additional information and the type of the additional information, and the data area of the additional information is used for recording the content of the additional information.
2. The picture processing method as claimed in claim 1, wherein before the reading of the media picture, the method further comprises:
and adding the additional information in the extension area of the picture to generate the media picture.
3. The picture processing method according to claim 2, wherein the adding the additional information in the extended area of the picture generates the media picture, comprising:
Forming the additional information;
and carrying out coding processing on the additional information, writing the coded additional information into an expansion area of the picture to generate the media picture, and adding identification information for indicating whether the additional information is included in the expansion area.
4. The picture processing method according to claim 1, wherein displaying the image information of the media picture and displaying the additional information in the extended area includes:
displaying the image information of the media picture and judging whether additional information exists in the expansion area of the media picture or not;
when judging that the additional information exists, displaying an icon corresponding to the additional information on the media picture;
upon receiving an operation to click on the icon, one or more of the following are presented: and playing the voice information and displaying the text information.
5. The picture processing method according to any one of claims 1 to 4, characterized by further comprising:
modifying the additional information of the media picture, the modifying comprising performing one or more of the following operations: and adding and deleting the additional information.
6. A picture processing apparatus, characterized by comprising:
the reading module is used for reading the media picture, and the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
the display module is used for displaying the image information of the media picture read by the reading module and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: playing the voice information and displaying the text information; wherein,
the media picture comprises a data area and an extension area, wherein the extension area comprises an identification area and a data area of additional information, the identification area of the additional information is used for recording whether the media picture contains the additional information and the type of the additional information, and the data area of the additional information is used for recording the content of the additional information.
7. The picture processing apparatus according to claim 6, further comprising:
and the generation module is used for adding the additional information in the extension area of the picture before the reading module reads the media picture to generate the media picture.
8. The picture processing device as claimed in claim 7, wherein the generating module comprises:
a forming unit configured to form the additional information;
and the generation unit is used for carrying out coding processing on the additional information formed by the forming unit, writing the coded additional information into an extension area of the picture to generate the media picture, and adding identification information for indicating whether the additional information is included in the extension area.
9. The picture processing device as claimed in claim 6, wherein the display module comprises:
the image display unit is used for displaying the image information of the media image read by the reading module;
the judging unit is used for judging whether additional information exists in the extension area of the media picture read by the reading module;
an icon display unit, configured to display an icon corresponding to additional information on the media picture when the determination unit determines that the additional information exists;
the picture display unit is also used for displaying one or more of the following contents when receiving the operation of clicking the icon: and playing the voice information and displaying the text information.
10. The picture processing apparatus according to any one of claims 6 to 9, further comprising:
a modification module for modifying the additional information of the media picture, the modification comprising performing one or more of the following operations: and adding and deleting the additional information.
11. A picture processing apparatus, characterized by comprising: a memory and a processor;
the memory is used for storing executable instructions;
the processor is configured to execute the executable instructions stored in the memory, and perform the following operations:
reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
displaying the image information of the media picture and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: playing the voice information, displaying the text information, wherein,
the media picture comprises a data area and an extension area, wherein the extension area comprises an identification area and a data area of additional information, the identification area of the additional information is used for recording whether the media picture contains the additional information and the type of the additional information, and the data area of the additional information is used for recording the content of the additional information.
12. The picture processing device of claim 11, wherein the processor, when executing the executable instructions, further performs the following:
and adding the additional information in the extension area of the picture to generate the media picture.
13. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, perform operations comprising:
reading a media picture, wherein the extension area of the media picture comprises additional information; the additional information includes one or more of voice information and text information;
displaying the image information of the media picture and displaying the additional information in the expansion area; wherein said presenting said additional information comprises presenting one or more of: playing the voice information and displaying the text information; wherein,
the media picture comprises a data area and an extension area, wherein the extension area comprises an identification area and a data area of additional information, the identification area of the additional information is used for recording whether the media picture contains the additional information and the type of the additional information, and the data area of the additional information is used for recording the content of the additional information.
CN201710608259.8A 2017-07-24 2017-07-24 Picture processing method and device Active CN109300177B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201710608259.8A CN109300177B (en) 2017-07-24 2017-07-24 Picture processing method and device
PCT/CN2018/096819 WO2019020012A1 (en) 2017-07-24 2018-07-24 Picture processing method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710608259.8A CN109300177B (en) 2017-07-24 2017-07-24 Picture processing method and device

Publications (2)

Publication Number Publication Date
CN109300177A CN109300177A (en) 2019-02-01
CN109300177B true CN109300177B (en) 2024-01-23

Family

ID=65040964

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710608259.8A Active CN109300177B (en) 2017-07-24 2017-07-24 Picture processing method and device

Country Status (2)

Country Link
CN (1) CN109300177B (en)
WO (1) WO2019020012A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021227580A1 (en) * 2020-05-15 2021-11-18 Oppo广东移动通信有限公司 Information processing method, encoder, decoder, and storage medium device
CN112711366A (en) * 2020-12-23 2021-04-27 维沃移动通信（杭州）有限公司 Image generation method and device and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533248A (en) * 2013-10-24 2014-01-22 腾讯科技（上海）有限公司 Image processing method, terminal and system
CN104022942A (en) * 2014-06-26 2014-09-03 北京奇虎科技有限公司 Method for processing interactive message, client, electronic device and system
CN104022943A (en) * 2014-06-26 2014-09-03 北京奇虎科技有限公司 Method, device and system for processing interactive type massages

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6080248B2 (en) * 2012-09-13 2017-02-15 富士フイルム株式会社 Three-dimensional image display apparatus and method, and program
CN104683677B (en) * 2013-11-26 2019-06-18 深圳富泰宏精密工业有限公司 Increase the system and method for voice description for photo
CN106844780A (en) * 2017-03-10 2017-06-13 珠海市魅族科技有限公司 Picture sending method and picture send system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103533248A (en) * 2013-10-24 2014-01-22 腾讯科技（上海）有限公司 Image processing method, terminal and system
CN104022942A (en) * 2014-06-26 2014-09-03 北京奇虎科技有限公司 Method for processing interactive message, client, electronic device and system
CN104022943A (en) * 2014-06-26 2014-09-03 北京奇虎科技有限公司 Method, device and system for processing interactive type massages

Also Published As

Publication number Publication date
CN109300177A (en) 2019-02-01
WO2019020012A1 (en) 2019-01-31

Similar Documents

Publication Publication Date Title
CN109618177B (en) Video processing method and device, electronic equipment and computer readable storage medium
CN108924464B (en) Video file generation method and device and storage medium
US9965878B2 (en) Mobile communication terminal and data input method
CN109474844B (en) Video information processing method and device and computer equipment
JP5887123B2 (en) Information processing system, first electronic device, second electronic device, image file reproducing method and providing method
KR20140131863A (en) Terminal device and method for displaying an associated window thereof
CN110601959B (en) Session message display method, device, terminal and storage medium
CN111526411A (en) Video processing method, device, equipment and medium
EP2544437A1 (en) Apparatus and method for transmitting message in mobile terminal
WO2023134419A1 (en) Information interaction method and apparatus, and device and storage medium
CN113076048A (en) Video display method and device, electronic equipment and storage medium
US11103795B1 (en) Game drawer
WO2023246852A1 (en) Virtual image publishing method and apparatus, electronic device, and storage medium
US10965629B1 (en) Method for generating imitated mobile messages on a chat writer server
CN112417180A (en) Method, apparatus, device and medium for generating album video
CN109300177B (en) Picture processing method and device
CN114880062A (en) Chat expression display method and device, electronic device and storage medium
CN116136876A (en) Video recommendation processing method and device and electronic equipment
CN113031781A (en) Augmented reality resource display method and device, electronic equipment and storage medium
CN116016817A (en) Video editing method, device, electronic equipment and storage medium
CN116112617A (en) Method and device for processing performance picture, electronic equipment and storage medium
CN117319340A (en) Voice message playing method, device, terminal and storage medium
CN115098099A (en) Method and device for generating media content, electronic equipment and storage medium
JP2017192071A (en) Information processing method, information processing device, and program
JP6266671B2 (en) Electronic device and image file playback method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant