CN115022268B - Session identification method and device, readable storage medium and computer equipment - Google Patents

Session identification method and device, readable storage medium and computer equipment Download PDF

Info

Publication number
CN115022268B
CN115022268B CN202210725349.6A CN202210725349A CN115022268B CN 115022268 B CN115022268 B CN 115022268B CN 202210725349 A CN202210725349 A CN 202210725349A CN 115022268 B CN115022268 B CN 115022268B
Authority
CN
China
Prior art keywords
picture
message
session
screenshot
receiver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210725349.6A
Other languages
Chinese (zh)
Other versions
CN115022268A (en
Inventor
张星亮
吴剑文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Workec Technology Co ltd
Original Assignee
Shenzhen Workec Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Workec Technology Co ltd filed Critical Shenzhen Workec Technology Co ltd
Priority to CN202210725349.6A priority Critical patent/CN115022268B/en
Publication of CN115022268A publication Critical patent/CN115022268A/en
Application granted granted Critical
Publication of CN115022268B publication Critical patent/CN115022268B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H04L51/043Real-time or near real-time messaging, e.g. instant messaging [IM] using or handling presence information
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/24Character recognition characterised by the processing or recognition method
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40Document-oriented image-based pattern recognition
    • G06V30/41Analysis of document content
    • G06V30/416Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors

Abstract

The invention is applicable to the technical field of computers, and provides a session identification method and device, a readable storage medium and computer equipment, wherein the method comprises the following steps: acquiring a conversation interface screenshot to be identified; according to the preset title bar position of the session interface, capturing a title bar picture of the screenshot of the session interface to be identified, obtaining the rest part of the screenshot of the session interface to be identified as a session picture, and removing the background of the session picture according to the background color RGB value of the session interface to obtain a target session picture; performing character recognition on the title bar picture to determine a conversation receiver; and respectively identifying a receiver message area and a sender message area in the target session picture to obtain a receiver message picture and a sender message picture, and identifying a receiver message in the receiver message picture and a sender message in the sender message picture. The invention solves the problem of unchanged content of the session shared by the screenshot at present.

Description

Session identification method and device, readable storage medium and computer equipment
Technical Field
The invention belongs to the technical field of computers, and particularly relates to a session identification method and device, a readable storage medium and computer equipment.
Background
Social instant messaging (Instant Messaging) is currently the most popular way of communicating over the Internet. In China, instant messaging software represented by WeChat and QQ is used by people for a long time than other types of software. Taking QQ and WeChat as examples, most chat interfaces of chat software conform to the same style, the left side is a guest view angle, the right side is a host view angle, each message is associated with a head portrait, and the top is a conversation name.
Users of social instant messaging software typically share chat content with others by way of screen shots. The sharing process has the following inconveniences: 1. other pictures are often doped in the album, and chat screenshot are needed to be found manually from the album for resolution; 2. the device can only identify the chat record screenshot, can not distinguish the chat record screenshot of different people, can not be identified quickly by a user, and particularly under the condition of thumbnail, the user needs to repeatedly switch to a large image for viewing, so that the processing efficiency of the user is reduced; 3. when the dialogue is longer, a plurality of screen shots are needed to cover the dialogue content, all the screen shots of the same section of dialogue are accurately found from the album, and the sequence of the screen shots is restored and also needs to be confirmed by a plurality of point-to-large images (the user can cut from front to back and from back to front), so that the efficiency is low due to manual operation.
Disclosure of Invention
The embodiment of the invention provides a session identification method, which aims to solve the problem of safely and effectively identifying session messages in a client.
The embodiment of the invention is realized in such a way that a session identification method comprises the following steps:
acquiring a conversation interface screenshot to be identified;
according to the preset title bar position of the session interface, capturing a title bar picture of the screenshot of the session interface to be identified, obtaining the rest part of the screenshot of the session interface to be identified as a session picture, and removing the background of the session picture according to the background color RGB value of the session interface to obtain a target session picture;
performing character recognition on the title bar picture to determine a conversation receiver;
and respectively identifying a receiver message area and a sender message area in the target session picture to obtain a receiver message picture and a sender message picture, and identifying a receiver message in the receiver message picture and a sender message in the sender message picture.
Still further, after the identifying the receiver message in the receiver message picture and the sender message in the sender message picture, the method further includes:
determining respective orders of each receiver message and each sender message according to respective positions of each receiver message picture and each sender message picture;
and generating a session message containing the receiver message and the sender message according to the respective sequence of each receiver message and each sender message, and associating the session receiver into the session message.
Further, after the text recognition is performed on the title bar picture and the conversation receiver is determined, the method further includes:
acquiring a time element region in the target session picture, and identifying session time corresponding to the time element region, wherein the time element region is symmetrical relative to a transverse central axis of the target session picture, the distance between the time element region and the left and right sides of the target session picture is equal, and the distance is larger than a preset distance;
accordingly, after the associating the session receiver into the session message, the method further comprises:
and associating the session time into the session message.
Further, the identifying the receiving message area and the sending message area in the target session picture respectively to obtain a receiving message picture and a sending message picture specifically includes:
identifying a message area of each message in the target session picture to obtain message pictures, wherein the height of a transparent color area of any two continuous message pictures is a preset height;
and respectively carrying out head portrait position identification on each message picture, and determining that the message picture is the receiver message picture or the sender message picture based on the head portrait position.
Further, the preset title bar position includes a preset title bar height; the capturing the title bar picture of the screenshot of the conversation interface to be identified according to the preset title bar position of the conversation interface specifically comprises the following steps:
and intercepting a part from the uppermost part to the preset title bar height in the conversation interface screenshot to be identified as the title bar picture.
Further, the obtaining a screenshot of the session interface to be identified specifically includes:
reading album pictures of the client; and/or, collecting manual screenshot pictures in the client; and/or, automatically capturing the screenshot of the client to obtain an automatic screenshot picture;
detecting whether the album picture and/or the manual screenshot picture and/or the automatic screenshot picture contain preset session interface characteristics corresponding to the session interface;
if the user interface picture is included, determining the user interface picture to be identified, executing the preset title bar position according to the user interface, and intercepting the title bar picture of the user interface screenshot to be identified;
if not, the identification is ended.
Still further, the method further comprises:
and sending the session message to a session backup terminal corresponding to the client.
The embodiment of the invention also provides a session identification device, which comprises:
the picture acquisition module is used for acquiring a conversation interface screenshot to be identified;
the picture segmentation module is used for intercepting a title bar picture of the screenshot of the conversation interface to be identified according to a preset title bar position of the conversation interface, acquiring the rest part of the screenshot of the conversation interface to be identified as a conversation picture, and removing the background of the conversation picture according to a background color RGB value of the conversation interface to obtain a target conversation picture;
the recognition module is used for carrying out character recognition on the title bar picture and determining a conversation receiver; and respectively identifying a receiver message area and a sender message area in the target session picture to obtain a receiver message picture and a sender message picture, and identifying a receiver message in the receiver message picture and a sender message in the sender message picture.
Still further, the apparatus further comprises:
the session generation module is used for determining the respective sequence of each receiver message and each sender message according to the respective positions of each receiver message picture and each sender message picture after the receiver message in the receiver message picture and the sender message in the sender message picture are identified; and generating a session message containing the receiver message and the sender message according to the respective sequence of each receiver message and each sender message, and associating the session receiver into the session message.
Still further, the method further comprises:
the identification module is further configured to: after a conversation receiver is determined, a time element area in the target conversation picture is acquired, and conversation time corresponding to the time element area is identified, wherein the time element area is symmetrical relative to a transverse central axis of the target conversation picture, the distances between the time element area and the left side and the right side of the target conversation picture are equal, and the distances are larger than a preset distance;
correspondingly, the session generation module is further configured to: and associating the session time into the session message.
Still further, the identification module is further configured to:
identifying a message area of each message in the target session picture to obtain message pictures, wherein the height of a transparent color area of any two continuous message pictures is a preset height;
and respectively carrying out head portrait position identification on each message picture, and determining that the message picture is the receiver message picture or the sender message picture based on the head portrait position.
Further, the preset title bar position includes a preset title bar height; the picture segmentation module is specifically configured to: and intercepting a part from the uppermost part to the preset title bar height in the conversation interface screenshot to be identified as the title bar picture.
Further, the image acquisition module is specifically configured to:
reading album pictures of the client; and/or, collecting manual screenshot pictures in the client; and/or, automatically capturing the screenshot of the client to obtain an automatic screenshot picture;
detecting whether the album picture and/or the manual screenshot picture and/or the automatic screenshot picture contain preset session interface characteristics corresponding to the session interface;
if the user interface picture is included, determining the user interface picture to be identified, executing the preset title bar position according to the user interface, and intercepting the title bar picture of the user interface screenshot to be identified;
if not, the identification is ended.
Still further, the apparatus further comprises:
and the message sending module is used for sending the session message to the session backup terminal corresponding to the client.
The embodiment of the invention also provides a readable storage medium, on which a computer program is stored, characterized in that the program, when executed by a processor, implements the session identification method described above.
The embodiment of the invention also provides a computer device, which comprises a readable storage medium, a processor and a computer program stored on the readable storage medium and capable of running on the processor, and is characterized in that the processor realizes the session identification method when executing the program.
By applying the technical scheme of the embodiment of the invention, the screenshot of the conversation interface to be identified is divided into the title bar picture and the conversation picture according to the preset title bar position, so that on one hand, the title bar picture is subjected to character identification to determine the conversation receiver, and on the other hand, the background in the conversation interface is removed to obtain the target conversation picture, the receiver message picture and the sender message picture are identified in the target conversation picture, and the receiver message and the sender message are respectively identified from the receiver message picture and the sender message picture. According to the invention, the conversation effective information in the conversation interface screenshot is extracted by carrying out picture segmentation and text recognition on the conversation interface screenshot so as to convert the conversation interface screenshot into text content for sharing, thereby solving the problem of invariance caused by sharing the conversation content through the screenshot at present.
Drawings
Fig. 1 is a schematic flow chart of a session identification method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of another session identification method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a session interface screenshot provided by an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a session identification apparatus according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
According to the method and the device, the conversation content of the conversation screenshot is obtained in a conversation content identification mode, and the inconvenience caused by storing and sharing the chat content through the screenshot at present is solved.
Example 1
In this embodiment, a session identification method is provided, as shown in fig. 1, and the method includes:
step 101, acquiring a conversation interface screenshot to be identified;
step 102, capturing a title bar picture of the screenshot of the conversation interface to be identified according to a preset title bar position of the conversation interface, obtaining the rest of the screenshot of the conversation interface to be identified as a conversation picture, and removing the background of the conversation picture according to a background color RGB value of the conversation interface to obtain a target conversation picture;
step 103, performing character recognition on the title bar picture to determine a conversation receiver;
step 104, identifying a receiver message area and a sender message area in the target session picture respectively, obtaining a receiver message picture and a sender message picture, and identifying a receiver message in the receiver message picture and a sender message in the sender message picture.
In the embodiment of the invention, firstly, a conversation interface screenshot to be identified is obtained, wherein the conversation interface screenshot to be identified is, for example, a WeChat chat interface screenshot, a QQ chat interface screenshot and the like. According to the conversation interface category of the conversation interface screenshot to be identified, determining a preset title bar position corresponding to the conversation interface, and dividing the conversation interface screenshot to be identified into a title bar picture and a conversation picture according to the preset title bar position, wherein the title bar picture is a part of the preset title bar position in the conversation interface screenshot, and the conversation picture is the rest part. Next, text recognition, such as OCR (Optical Character Recognition ), is performed on the title bar picture to determine the name of the conversation recipient of the conversation interface screenshot to be recognized. Finally, for the session picture part, generally speaking, the session contents of the message sender and the message receiver in the session interface screenshot are displayed in respective session bubbles, and in order to clearly display the session contents, the color of the session bubble in the session software is different from the background color of the session interface, so in the embodiment of the invention, the background color in the session interface is firstly removed, so that the background color part becomes transparent, only the effective information in the session picture is reserved, and the effective information extraction is carried out on the target session picture obtained after the background color is removed. Specifically, based on the position characteristics of the receiving party message area and the position characteristics of the sending party message area, the receiving party message area and the sending party message area in the target session picture are identified to respectively obtain a receiving party message picture and a sending party message picture, so that the receiving party message picture and the sending party message picture are respectively subjected to text recognition to obtain receiving party messages and sending party messages, and session contents of both parties of the session are obtained.
By applying the technical scheme of the embodiment of the invention, the screenshot of the conversation interface to be identified is divided into the title bar picture and the conversation picture according to the preset title bar position, so that on one hand, the title bar picture is subjected to character identification to determine the conversation receiver, and on the other hand, the background in the conversation interface is removed to obtain the target conversation picture, the receiver message picture and the sender message picture are identified in the target conversation picture, and the receiver message and the sender message are respectively identified from the receiver message picture and the sender message picture. According to the invention, the conversation effective information in the conversation interface screenshot is extracted by carrying out picture segmentation and text recognition on the conversation interface screenshot so as to convert the conversation interface screenshot into text content for sharing, thereby solving the problem of invariance caused by sharing the conversation content through the screenshot at present.
Example two
Further, as a refinement and extension of the foregoing embodiment, in order to fully describe a specific implementation procedure of the present embodiment, another session identification method is provided, as shown in fig. 2, where the method includes:
step 201, obtaining a conversation interface screenshot to be identified.
In the embodiment of the present invention, optionally, step 201 specifically includes:
step 201-1, reading album pictures of the client; and/or, collecting manual screenshot pictures in the client; and/or, automatically capturing the screenshot of the client to obtain an automatic screenshot picture;
step 201-2, detecting whether the album picture and/or the manual screenshot picture and/or the automatic screenshot picture contain preset session interface features corresponding to the session interface;
step 201-3, if so, determining the session interface picture to be identified, and executing step 202;
if not, step 201-4 ends the identification.
In this embodiment, under the condition of user authorization, the album picture can be read from the client album, the manual screenshot picture obtained by manually capturing the user, and the automatic screenshot picture automatically captured by the program of the embodiment. And detecting each picture, and judging whether the album picture, the manual screenshot picture and the automatic screenshot picture contain preset session interface characteristics matched with a preset session interface. As shown in fig. 3, taking a WeChat session interface as an example, features 1, 2 and 3 in the session interface can be identified, if the picture contains the features, the picture is determined to be a screenshot of the session interface to be identified, otherwise, the identification of the picture is ended.
Step 202, intercepting a part from the uppermost part to the preset title bar height in the conversation interface screenshot to be identified as a title bar picture, acquiring the rest part of the conversation interface screenshot to be identified as a conversation picture, and removing the background of the conversation picture according to the background color RGB value of the conversation interface to obtain a target conversation picture.
In this embodiment, for example, the upper left corner in the screenshot is the origin of coordinates, the title bar height is 50, the picture of the Y-coordinate (0, 50) X-coordinate (0-screen width) portion is taken as the title bar picture, and the remaining portion is the session picture. Taking the WeChat conversation interface as an example, the background color RGB value is #EDED, and the residual target conversation picture is obtained by performing RBG #EDED color value inversion on the conversation picture.
And 203, performing text recognition on the title bar picture to determine a conversation receiver.
In the embodiment, the title bar picture is subjected to OCR text recognition, so that the names of the friends of the conversation can be accurately obtained, and the names of the conversation receiver can be added when the chat record is reported.
Step 204, obtaining a time element region in the target session picture, and identifying a session time corresponding to the time element region, wherein the time element region is symmetrical with respect to a transverse central axis of the target session picture, and distances between the time element region and the left and right sides of the target session picture are equal and greater than a preset distance.
In the embodiment of the invention, the time element is increased to two sides by taking the x coordinate as the central axis, if the distances of the two sides are equal, and the distance of the two sides is larger than the display width of the head portrait corresponding to the session software; when the above two conditions are met, the time element screenshot can be obtained after the screenshot by the x coordinate (0, screen width) and the y coordinate (0, 30), and the time information of the plaintext can be obtained by OCR recognition.
Step 205, identifying a message area of each message in the target session picture to obtain a message picture, wherein the height of a transparent color area of any two continuous message pictures is a preset height; respectively carrying out head portrait position identification on each message picture, and determining that the message picture is the receiver message picture or the sender message picture based on the head portrait position; and identifying the receiver message in the receiver message picture and the sender message in the sender message picture.
In this embodiment, the basis for judging the bubble information (i.e., the message area) is to take the background color as the transparent color as the space between bubbles (since the background color RGB value #edded has been obtained by inverting as described above). The background color (transparent color) between two adjacent rows is determined, so that the bubble picture of each row can be cut out. And then respectively identifying whether each bubble picture is a message receiving party picture or a message sending party picture. Taking a WeChat session interface as an example, the judgment mode of the receiver is as follows: increasing by x coordinate 0, finding the beginning position of the head portrait when the non-color value is #EDEDED, and finding the ending position of the head portrait when the color value is #EDED; the height is directly a fixed value: 50, which is configurable to vary according to the WeChat interface variation; the judgment mode of the sender is as follows: beginning to decrease by taking the x coordinate as the screen width, finding the beginning position of the head portrait when the non-color value is #EDED, and ending the head portrait when the color value is #EDED; the height is directly a fixed value: 50, which is configurable to vary according to the WeChat interface variation. When the head portrait is obtained, the head portrait can be removed from the complete message picture of each piece of information, so that the complete bubble information containing the conversation content can be obtained. And further performing character recognition on the bubble information to obtain a sender message and a receiver message.
Step 206, determining respective orders of each receiver message and each sender message according to respective positions of each receiver message picture and each sender message picture; and generating a session message containing the receiver message and the sender message according to the respective sequence of each receiver message and each sender message.
In this embodiment, the order of the messages may also be identified, so that the sender message and the receiver message may be assembled into a session message with an order, specifically, the order of the messages may be determined according to the up-down position of each receiver message picture and the sender message picture in the screenshot, so that the identified sender message and receiver message may be assembled into a session message according to the respective order, and the sender or receiver may be noted for each message.
Step 207, associating the session receiver with the session message, and associating the session time with the session message.
And step 208, the session message is sent to the session backup terminal corresponding to the client.
In this embodiment, the identified session time and the identified session receiver may be associated with a session message, and after the session message is obtained, the session message may be sent to the session backup terminal for backup.
Example III
Further, as a specific implementation of the method of fig. 1, an embodiment of the present invention provides a session identification apparatus, as shown in fig. 4, where the apparatus includes:
the picture acquisition module is used for acquiring a conversation interface screenshot to be identified;
the picture segmentation module is used for intercepting a title bar picture of the screenshot of the conversation interface to be identified according to a preset title bar position of the conversation interface, acquiring the rest part of the screenshot of the conversation interface to be identified as a conversation picture, and removing the background of the conversation picture according to a background color RGB value of the conversation interface to obtain a target conversation picture;
the recognition module is used for carrying out character recognition on the title bar picture and determining a conversation receiver; and respectively identifying a receiver message area and a sender message area in the target session picture to obtain a receiver message picture and a sender message picture, and identifying a receiver message in the receiver message picture and a sender message in the sender message picture.
Still further, the apparatus further comprises:
the session generation module is used for determining the respective sequence of each receiver message and each sender message according to the respective positions of each receiver message picture and each sender message picture after the receiver message in the receiver message picture and the sender message in the sender message picture are identified; and generating a session message containing the receiver message and the sender message according to the respective sequence of each receiver message and each sender message, and associating the session receiver into the session message.
Still further, the method further comprises:
the identification module is further configured to: after a conversation receiver is determined, a time element area in the target conversation picture is acquired, and conversation time corresponding to the time element area is identified, wherein the time element area is symmetrical relative to a transverse central axis of the target conversation picture, the distances between the time element area and the left side and the right side of the target conversation picture are equal, and the distances are larger than a preset distance;
correspondingly, the session generation module is further configured to: and associating the session time into the session message.
Still further, the identification module is further configured to:
identifying a message area of each message in the target session picture to obtain message pictures, wherein the height of a transparent color area of any two continuous message pictures is a preset height;
and respectively carrying out head portrait position identification on each message picture, and determining that the message picture is the receiver message picture or the sender message picture based on the head portrait position.
Further, the preset title bar position includes a preset title bar height; the picture segmentation module is specifically configured to: and intercepting a part from the uppermost part to the preset title bar height in the conversation interface screenshot to be identified as the title bar picture.
Further, the image acquisition module is specifically configured to:
reading album pictures of the client; and/or, collecting manual screenshot pictures in the client; and/or, automatically capturing the screenshot of the client to obtain an automatic screenshot picture;
detecting whether the album picture and/or the manual screenshot picture and/or the automatic screenshot picture contain preset session interface characteristics corresponding to the session interface;
if the user interface picture is included, determining the user interface picture to be identified, executing the preset title bar position according to the user interface, and intercepting the title bar picture of the user interface screenshot to be identified;
if not, the identification is ended.
Still further, the apparatus further comprises:
and the message sending module is used for sending the session message to the session backup terminal corresponding to the client.
It should be noted that, for other corresponding descriptions of each functional unit related to the session identification apparatus provided by the embodiment of the present invention, reference may be made to corresponding descriptions in the methods of fig. 1 to fig. 2, and no further description is given here.
Based on the above-mentioned methods shown in fig. 1 to 2, correspondingly, the embodiment of the present invention further provides a storage medium, on which a computer program is stored, which when executed by a processor, implements the above-mentioned session identification method shown in fig. 1 to 2.
Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.), and includes several instructions for causing a computer device (may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective implementation scenario of the present invention.
Based on the method shown in fig. 1 to fig. 2 and the virtual device embodiment shown in fig. 4, in order to achieve the above object, the embodiment of the present invention further provides a computer device, which may specifically be a personal computer, a server, a network device, etc., where the computer device includes a storage medium and a processor; a storage medium storing a computer program; a processor for executing a computer program to implement the session identification method as shown in fig. 1 to 2 described above.
Optionally, the computer device may also include a user interface, a network interface, a camera, radio Frequency (RF) circuitry, sensors, audio circuitry, WI-FI modules, and the like. The user interface may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (e.g., bluetooth interface, WI-FI interface), etc.
It will be appreciated by those skilled in the art that the architecture of a computer device provided in the present embodiment is not limited to the computer device, and may include more or fewer components, or may combine certain components, or may be arranged in different components.
The storage medium may also include an operating system, a network communication module. An operating system is a program that manages and saves computer device hardware and software resources, supporting the execution of information handling programs and other software and/or programs. The network communication module is used for realizing communication among all components in the storage medium and communication with other hardware and software in the entity equipment.
Through the description of the above embodiments, it can be clearly understood by those skilled in the art that the present invention may be implemented by adding necessary general hardware platform to software, or may be implemented by hardware to divide the screenshot of the session interface to be identified into a title bar picture and a session picture according to a preset title bar position, so as to perform text recognition on the title bar picture on one hand, determine the session receiver, and remove the background in the session interface to obtain a target session picture, identify a receiver message picture and a sender message picture in the target session picture, and identify a receiver message and a sender message from the receiver message picture and the sender message picture, respectively. According to the invention, the conversation effective information in the conversation interface screenshot is extracted by carrying out picture segmentation and text recognition on the conversation interface screenshot so as to convert the conversation interface screenshot into text content for sharing, thereby solving the problem of invariance caused by sharing the conversation content through the screenshot at present.
Those skilled in the art will appreciate that the drawing is merely a schematic illustration of a preferred implementation scenario and that the modules or flows in the drawing are not necessarily required to practice the invention. Those skilled in the art will appreciate that modules in an apparatus in an implementation scenario may be distributed in an apparatus in an implementation scenario according to an implementation scenario description, or that corresponding changes may be located in one or more apparatuses different from the implementation scenario. The modules of the implementation scenario may be combined into one module, or may be further split into a plurality of sub-modules.
The above-mentioned inventive sequence numbers are merely for description and do not represent advantages or disadvantages of the implementation scenario. The foregoing disclosure is merely illustrative of some embodiments of the invention, and the invention is not limited thereto, as modifications may be made by those skilled in the art without departing from the scope of the invention.

Claims (9)

1. A method of session identification, the method comprising:
acquiring a conversation interface screenshot to be identified;
according to the preset title bar position of the session interface, capturing a title bar picture of the screenshot of the session interface to be identified, obtaining the rest part of the screenshot of the session interface to be identified as a session picture, and removing the background of the session picture according to the background color RGB value of the session interface to obtain a target session picture;
performing character recognition on the title bar picture to determine a conversation receiver;
identifying a message area of each message in the target session picture to obtain message pictures, wherein the height of a transparent color area of any two continuous message pictures is a preset height; respectively carrying out head portrait position identification on each message picture, and determining that the message picture is a receiver message picture or a sender message picture based on the head portrait position;
and identifying the receiver message in the receiver message picture and the sender message in the sender message picture.
2. The method of claim 1, wherein after the identifying the recipient message in the recipient message picture and the sender message in the sender message picture, the method further comprises:
determining respective orders of each receiver message and each sender message according to respective positions of each receiver message picture and each sender message picture;
and generating a session message containing the receiver message and the sender message according to the respective sequence of each receiver message and each sender message, and associating the session receiver into the session message.
3. The method of claim 2, wherein after the text recognition of the title bar picture and the determination of the session receiver, the method further comprises:
acquiring a time element region in the target session picture, and identifying session time corresponding to the time element region, wherein the time element region is symmetrical relative to a transverse central axis of the target session picture, the distance between the time element region and the left and right sides of the target session picture is equal, and the distance is larger than a preset distance;
accordingly, after the associating the session receiver into the session message, the method further comprises:
and associating the session time into the session message.
4. The method of claim 1, wherein the preset title bar position comprises a preset title bar height; the capturing the title bar picture of the screenshot of the conversation interface to be identified according to the preset title bar position of the conversation interface specifically comprises the following steps:
and intercepting a part from the uppermost part to the preset title bar height in the conversation interface screenshot to be identified as the title bar picture.
5. The method according to any one of claims 1 to 4, wherein the obtaining a session interface screenshot to be identified specifically comprises:
reading album pictures of the client; and/or, collecting manual screenshot pictures in the client; and/or, automatically capturing the screenshot of the client to obtain an automatic screenshot picture;
detecting whether the album picture and/or the manual screenshot picture and/or the automatic screenshot picture contain preset session interface characteristics corresponding to the session interface;
if the user interface picture is included, determining the user interface picture to be identified, executing the preset title bar position according to the user interface, and intercepting the title bar picture of the user interface screenshot to be identified;
if not, the identification is ended.
6. A method according to claim 2 or 3, characterized in that the method further comprises:
and sending the session message to a session backup terminal corresponding to the client.
7. A session identification apparatus, comprising:
the picture acquisition module is used for acquiring a conversation interface screenshot to be identified;
the picture segmentation module is used for intercepting a title bar picture of the screenshot of the conversation interface to be identified according to a preset title bar position of the conversation interface, acquiring the rest part of the screenshot of the conversation interface to be identified as a conversation picture, and removing the background of the conversation picture according to a background color RGB value of the conversation interface to obtain a target conversation picture;
the recognition module is used for carrying out character recognition on the title bar picture and determining a conversation receiver; identifying a message area of each message in the target session picture to obtain message pictures, wherein the height of a transparent color area of any two continuous message pictures is a preset height; respectively carrying out head portrait position identification on each message picture, and determining that the message picture is a receiver message picture or a sender message picture based on the head portrait position; and identifying the receiver message in the receiver message picture and the sender message in the sender message picture.
8. A readable storage medium having stored thereon a computer program, wherein the program when executed by a processor implements the session identification method of any of claims 1 to 6.
9. A computer device comprising a readable storage medium, a processor and a computer program stored on the readable storage medium and executable on the processor, characterized in that the processor implements the session identification method according to any one of claims 1 to 6 when executing the program.
CN202210725349.6A 2022-06-24 2022-06-24 Session identification method and device, readable storage medium and computer equipment Active CN115022268B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210725349.6A CN115022268B (en) 2022-06-24 2022-06-24 Session identification method and device, readable storage medium and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210725349.6A CN115022268B (en) 2022-06-24 2022-06-24 Session identification method and device, readable storage medium and computer equipment

Publications (2)

Publication Number Publication Date
CN115022268A CN115022268A (en) 2022-09-06
CN115022268B true CN115022268B (en) 2023-05-12

Family

ID=83077130

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210725349.6A Active CN115022268B (en) 2022-06-24 2022-06-24 Session identification method and device, readable storage medium and computer equipment

Country Status (1)

Country Link
CN (1) CN115022268B (en)

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107145800A (en) * 2017-05-31 2017-09-08 北京小米移动软件有限公司 Method for protecting privacy and device, terminal and storage medium
CN107277244A (en) * 2017-06-14 2017-10-20 深圳天珑无线科技有限公司 Screenshot processing method and device
CN107832397A (en) * 2017-10-30 2018-03-23 努比亚技术有限公司 A kind of image processing method, device and computer-readable recording medium
WO2018072459A1 (en) * 2016-10-18 2018-04-26 华为技术有限公司 Screenshot and reading method and terminal
CN108629200A (en) * 2018-03-15 2018-10-09 青岛海信移动通信技术股份有限公司 A kind of image processing method and device
CN109032726A (en) * 2018-06-29 2018-12-18 北京明朝万达科技股份有限公司 The acquisition methods and device of chat message
WO2019029409A1 (en) * 2017-08-11 2019-02-14 腾讯科技(深圳)有限公司 Instant messaging-based information pushing method and apparatus, terminal and storage medium
CN109993075A (en) * 2019-03-14 2019-07-09 深圳市六度人和科技有限公司 Chat application session content storage method, system and device
CN110456956A (en) * 2019-08-05 2019-11-15 腾讯科技(深圳)有限公司 Screenshot method, device, computer equipment and storage medium
CN110532412A (en) * 2019-08-28 2019-12-03 维沃移动通信有限公司 A kind of document handling method and mobile terminal
CN111666940A (en) * 2020-06-05 2020-09-15 厦门美图之家科技有限公司 Chat screenshot content processing method and device, electronic equipment and readable storage medium
CN111967430A (en) * 2020-08-28 2020-11-20 维沃移动通信有限公司 Message processing method and device, electronic equipment and readable storage medium
CN112347948A (en) * 2020-11-10 2021-02-09 腾讯科技(深圳)有限公司 Picture searching method, device, equipment and computer program product
WO2021042904A1 (en) * 2019-09-06 2021-03-11 平安国际智慧城市科技股份有限公司 Conversation intention recognition method, apparatus, computer device, and storage medium
CN113438526A (en) * 2021-06-25 2021-09-24 维沃移动通信有限公司 Screen content sharing method, screen content display device, screen content equipment and storage medium
CN113905001A (en) * 2021-09-15 2022-01-07 深圳市六度人和科技有限公司 Automatic reply method and device, computer equipment and readable storage medium
CN114373186A (en) * 2022-01-11 2022-04-19 北京新学堂网络科技有限公司 Social software information interaction method, device and medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140218385A1 (en) * 2012-09-10 2014-08-07 Applitools Ltd. System and method for visual segmentation of application screenshots
US10984140B2 (en) * 2017-12-21 2021-04-20 Disappears.Com Holdings (Canada) Ltd. Method for detecting the possible taking of screenshots

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018072459A1 (en) * 2016-10-18 2018-04-26 华为技术有限公司 Screenshot and reading method and terminal
CN107145800A (en) * 2017-05-31 2017-09-08 北京小米移动软件有限公司 Method for protecting privacy and device, terminal and storage medium
CN107277244A (en) * 2017-06-14 2017-10-20 深圳天珑无线科技有限公司 Screenshot processing method and device
WO2019029409A1 (en) * 2017-08-11 2019-02-14 腾讯科技(深圳)有限公司 Instant messaging-based information pushing method and apparatus, terminal and storage medium
CN107832397A (en) * 2017-10-30 2018-03-23 努比亚技术有限公司 A kind of image processing method, device and computer-readable recording medium
CN108629200A (en) * 2018-03-15 2018-10-09 青岛海信移动通信技术股份有限公司 A kind of image processing method and device
CN109032726A (en) * 2018-06-29 2018-12-18 北京明朝万达科技股份有限公司 The acquisition methods and device of chat message
CN109993075A (en) * 2019-03-14 2019-07-09 深圳市六度人和科技有限公司 Chat application session content storage method, system and device
CN110456956A (en) * 2019-08-05 2019-11-15 腾讯科技(深圳)有限公司 Screenshot method, device, computer equipment and storage medium
CN110532412A (en) * 2019-08-28 2019-12-03 维沃移动通信有限公司 A kind of document handling method and mobile terminal
WO2021042904A1 (en) * 2019-09-06 2021-03-11 平安国际智慧城市科技股份有限公司 Conversation intention recognition method, apparatus, computer device, and storage medium
CN111666940A (en) * 2020-06-05 2020-09-15 厦门美图之家科技有限公司 Chat screenshot content processing method and device, electronic equipment and readable storage medium
CN111967430A (en) * 2020-08-28 2020-11-20 维沃移动通信有限公司 Message processing method and device, electronic equipment and readable storage medium
CN112347948A (en) * 2020-11-10 2021-02-09 腾讯科技(深圳)有限公司 Picture searching method, device, equipment and computer program product
CN113438526A (en) * 2021-06-25 2021-09-24 维沃移动通信有限公司 Screen content sharing method, screen content display device, screen content equipment and storage medium
CN113905001A (en) * 2021-09-15 2022-01-07 深圳市六度人和科技有限公司 Automatic reply method and device, computer equipment and readable storage medium
CN114373186A (en) * 2022-01-11 2022-04-19 北京新学堂网络科技有限公司 Social software information interaction method, device and medium

Also Published As

Publication number Publication date
CN115022268A (en) 2022-09-06

Similar Documents

Publication Publication Date Title
US10127471B2 (en) Method, device, and computer-readable storage medium for area extraction
JP7381775B2 (en) Unique identifier based on signature
US9805511B2 (en) Interacting with data fields on a page using augmented reality
CN116342622A (en) Image segmentation and modification of video streams
US20190222806A1 (en) Communication system and method
CN104850213B (en) Wearable electronic device and information processing method for wearable electronic device
US20130182959A1 (en) Systems and methods for mobile image capture and processing
US10325372B2 (en) Intelligent auto-cropping of images
US20190332804A1 (en) Method for information processing, device, server and storage medium
JP2014504400A (en) How to crop a text image
US20140321770A1 (en) System, method, and computer program product for generating an image thumbnail
WO2015039575A1 (en) Method and system for performing image identification
EP4191513A1 (en) Image processing method and apparatus, device and storage medium
CN103237165A (en) Method and electronic equipment for checking extended name card information in real time
CN115022268B (en) Session identification method and device, readable storage medium and computer equipment
CN109587035B (en) Head portrait display method and device of session interface, electronic equipment and storage medium
US8380006B2 (en) System and method for merging separated pixel blocks into an integral image of an object
CN108924624A (en) Information processing method and device
CN114937188A (en) Information identification method, device, equipment and medium for sharing screenshot by user
WO2017016073A1 (en) Picture processing method, device, terminal and storage medium
CN109558876B (en) Character recognition processing method and device
US10586366B2 (en) System and method for display object bitmap caching
JP5105440B2 (en) Information processing apparatus, character recognition method, character recognition program, and computer-readable recording medium on which character recognition program is recorded
CN112422301A (en) Communication method for intelligent office and related product
CN115237523A (en) Mobile phone bank screenshot method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant