CN108959887B - Group control method applied to instant communication client - Google Patents
Group control method applied to instant communication client Download PDFInfo
- Publication number
- CN108959887B CN108959887B CN201810718503.0A CN201810718503A CN108959887B CN 108959887 B CN108959887 B CN 108959887B CN 201810718503 A CN201810718503 A CN 201810718503A CN 108959887 B CN108959887 B CN 108959887B
- Authority
- CN
- China
- Prior art keywords
- sound signal
- group
- instant messaging
- messaging client
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
- G06F21/82—Protecting input, output or interconnection devices
- G06F21/84—Protecting input, output or interconnection devices output devices, e.g. displays or monitors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Telephonic Communication Services (AREA)
- Telephone Function (AREA)
Abstract
A group control method applied to an instant messaging client comprises the following steps: detecting a gesture input for any target image published on a first group conversation interface of a first group, wherein the gesture is used for triggering the target image to be covered; prompting to select one user which distributes the sound signals on the first group conversation interface from the first group and prompting to select another user which distributes the sound signals on the second group conversation interface of the second group from the second group according to the gesture so as to form a first user pair; and associating the first user pair with the target image, and covering the target image by using a preset non-privacy image on the first group session interface, wherein the first user pair is used as a first basis for removing the non-privacy image covered with the target image. By implementing the embodiment of the invention, the images published on the group conversation interface of a certain group can be prevented from being peeped by other people.
Description
Technical Field
The invention relates to the technical field of social contact, in particular to a group control method applied to an instant messaging client.
At present, a plurality of groups are usually created on various instant messaging clients including WeChat and QQ, and group members in a certain group sometimes publish some images (such as privacy images) on the group session interface. In practice, it is found that when an image (e.g., a privacy image) is published on a group session interface of a group of instant messaging clients, if a user device (e.g., a mobile phone) where the instant messaging client is located is unlocked, the image (e.g., the privacy image) published on the group session interface is easily peeped by other people.
Disclosure of Invention
The embodiment of the invention discloses a group control method applied to an instant messaging client, which can prevent an image published on a group session interface of a certain group from being peeped by other personnel.
A group control method applied to an instant messaging client, a first group and a second group are established in the instant messaging client, the first group is associated with the second group, and the method comprises the following steps:
the instant messaging client detects a gesture which is input by a current user aiming at any target image published on a first group session interface of the first group and is used for triggering the target image to be covered;
the instant messaging client prompts one user who issues the sound signal on the first group conversation interface to be selected from the first group according to the gesture, and prompts the other user who issues the sound signal on the second group conversation interface of the second group to be selected from the second group, so that a first user pair is formed;
the instant messaging client associates the first user pair with the target image and covers the target image with a preset non-private image on the first group session interface; wherein the first user pair is used as a first basis for removing the non-private image which covers the target image.
As an optional implementation manner, in an embodiment of the present invention, after the instant messaging client overlays the target image with a preset non-private image on the first group session interface, the method further includes:
the instant messaging client detects a removal instruction for the non-private image on the first group session interface which covers the target image;
the instant messaging client prompts any one user to be selected from the first group and the second group respectively according to the removing instruction so as to form a second user pair;
the instant messaging client judges whether the selected second user pair is the same as the first user pair serving as a first basis for removing the non-private image covering the target image or not;
if the target image is the same as the original image, the instant messaging client removes the non-privacy image which is covered by the target image on the first group session interface so as to redisplay the target image.
As an optional implementation manner, in an embodiment of the present invention, after the instant messaging client associates the first user pair with the target image and before the target image is covered by a preset non-private image on the first group session interface, the method further includes:
the instant messaging client prompts to select a first sound signal issued by one user included in the first user pair from the first group conversation interface and prompts to select a second sound signal issued by the other user included in the first user pair from the second group conversation interface;
the instant messaging client synthesizes the selected first sound signal and the second sound signal to obtain a verification sound signal;
the instant messaging client associates the verification sound signal with the target image and executes the step of covering the target image with a preset non-privacy image on the first group session interface; wherein the verification sound signal serves as a second basis for removing the non-private image that has covered the target image;
after the instant messaging client determines that the second user pair is the same as the first user pair serving as a first basis for removing the non-private image covering the target image, and before the instant messaging client removes the non-private image covering the target image on the first group session interface to redisplay the target image, the method further includes:
the instant messaging client prompts to select a third sound signal issued by one user included in the second user pair from the first group session interface and prompts to select a fourth sound signal issued by another user included in the second user pair from the second group session interface;
the instant messaging client synthesizes the selected third sound signal and the selected fourth sound signal to obtain a synthesized sound signal;
the instant messaging client determines whether the synthesized sound signal matches the verification sound signal as a second basis for removing the non-private image that has covered the target image, and if so, performs the step of removing the non-private image that has covered the target image on the first group session interface to redisplay the target image.
As an optional implementation manner, in an embodiment of the present invention, the synthesizing, by the instant messaging client, the selected first sound signal and the second sound signal to obtain a verification sound signal includes:
the instant messaging client determines an alignment point between the selected first sound signal and the selected second sound signal; wherein the alignment point refers to a starting position of the synthesis of the first sound signal and the second sound signal;
and the instant messaging client synthesizes the first sound signal and the second sound signal into a verification sound signal according to the alignment point.
As an optional implementation manner, in an embodiment of the present invention, the determining, by the instant messaging client, an alignment point between the first sound signal and the second sound signal includes:
the instant messaging client calculates a first time length of the selected first sound signal and a second time length of the selected second sound signal; wherein the first duration represents a duration of sound of the first sound signal; the second time duration represents a time duration of sound of the second sound signal;
the instant messaging client calculates the difference between the first time length and the second time length;
and the instant messaging client judges whether the difference value is smaller than or equal to a preset value, if so, any one of the first sound signal and the second sound signal is subjected to periodic scaling so as to obtain the first sound signal and the second sound signal with the same final duration, and then the first audio frame of the first sound signal and the first audio frame of the second sound signal with the same final duration are taken as an alignment point.
As an optional implementation manner, in an embodiment of the present invention, the periodically scaling, by the instant messaging client, any one of the first sound signal and the second sound signal includes:
if the first time length of the first sound signal is shorter than the second time length of the second sound signal, the instant messaging client determines the proportion X of the difference value in the first time length of the first sound signal according to the difference value;
the instant communication client calculates the audio frame number Y of the first sound signal;
the instant communication client calculates an amplification factor Z, wherein Z is X (Y/(Y-1));
and the instant messaging client amplifies other audio frames except the first audio frame in the first sound signal in an equal proportion according to the amplification factor, so that the final duration of the amplified first sound signal is the same as the second duration of the second sound signal.
As an optional implementation manner, in an embodiment of the present invention, if the difference is greater than the preset value, the method further includes:
the instant messaging client uses the same default sampling frequency to respectively sample the first sound signal and the second sound signal to obtain a first sampling group and a second sampling group;
the instant communication client generates a cross-correlation group according to the default sampling frequency, the first sampling group, the second sampling group and the cross-correlation weight; wherein the cross-correlation weight is positively correlated with the difference, and the cross-correlation group comprises a plurality of values;
the instant communication client compares a plurality of values in the cross-correlation group to find out the maximum value;
and the instant messaging client uses the audio frame position corresponding to the maximum numerical value as an alignment point.
As an optional implementation manner, in an embodiment of the present invention, the generating, by the instant messaging client, a cross-correlation group according to the default sampling frequency, the first sampling group, the second sampling group, and a cross-correlation weight includes:
wherein S isn[t]Representing a set of cross-correlations, x [ m ]]Representing the mth sample data in the first sample group, y [ m-t ]]Represents the (m-t) th sampling data in the second sampling group, t represents the offset of time, t is an integer and takes the value from 0 to m, WtAnd representing a window function, wherein n is l f, l is a cross-correlation weight, and f is the default sampling frequency.
As an optional implementation manner, in an embodiment of the present invention, the determining, by the instant messaging client, whether the synthesized sound signal matches the verification sound signal as a second basis for removing the non-privacy image that covers the target image includes:
the instant messaging client determining whether the alignment point between the synthesized sound signal and the verification sound signal as a second basis for removing the non-privacy image that has overlaid the target image is the same;
if the two multi-dimensional vectors are the same, the instant messaging client judges whether the first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with the second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the two multi-dimensional vectors are matched, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal does not match the verification voice signal;
the first multi-dimensional vector corresponding to the voiceprint feature of the synthetic sound signal is composed of a mel-frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the mel-frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, energy, a first order difference of the energy and a Gammatone filter cepstrum coefficient.
In the embodiment of the invention, the instant messaging client can detect the gesture which is input by the current user aiming at any target image published on the first group conversation interface of the first group and is used for triggering the target image to be covered; prompting to select one user which has the sound signal on the first group conversation interface from the first group, and prompting to select another user which has the sound signal on the second group conversation interface of the second group from the second group, so as to form a first user pair; the instant messaging client can associate the first user pair with the target image, and cover the target image with a preset non-privacy image on the first group session interface, wherein the first user pair is used as a first basis for removing the non-privacy image covered with the target image. Therefore, by implementing the embodiment of the invention, even under the condition that the user equipment (such as a mobile phone) where the instant messaging client is located is not locked, the image published on the group session interface of a certain group can be prevented from being peeped by other people.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a group control method applied to an instant messaging client according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of another group control method applied to an instant messaging client according to an embodiment of the present disclosure;
fig. 3 is a flowchart illustrating another group control method applied to an instant messaging client according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a group control method applied to an instant messaging client, which can prevent an image published on a group session interface of a certain group from being peeped by other personnel. The following detailed description is made with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 is a schematic flowchart illustrating a group control method applied to an instant messaging client according to an embodiment of the present invention. In the group control method applied to the instant messenger client shown in fig. 1, a first group and a second group associated with the first group are created in the instant messenger client, which may include, but is not limited to, WeChat, QQ; the instant messaging client can be installed on user equipment such as a mobile phone and a tablet personal computer. The mapping relationship between the group identifier of the first group and the group identifier of the second group can be established in advance on a group mapping setting interface provided by the instant messaging client, and the mapping relationship is used for representing that the first group is associated with the second group. As shown in fig. 1, the group control method applied to the instant messaging client may include the following steps:
101. the instant messaging client detects a gesture which is input by a current user aiming at any target image published on a first group conversation interface of a first group and is used for triggering the target image to be covered.
In the embodiment of the present invention, the current user may use a certain hand (e.g., the right hand) to hold the user equipment (e.g., the mobile phone) where the instant messaging client (e.g., the WeChat) is located, and the current user may use a certain finger (e.g., the thumb) of the hand to press any target image published on the first group session interface of the first group of the instant messaging client displayed on the user equipment where the instant messaging client is located; in the process that a current user presses a target image, the user equipment where the instant messaging client is located can be controlled by the hand to generate a preset gesture for triggering the target image to be covered, so that the instant messaging client can detect a gesture which is input by the current user aiming at any target image published on a first group session interface of a first group and is used for triggering the target image to be covered.
As an alternative embodiment, after the instant messaging client performs step 101, and before the instant messaging client performs step 102, the following steps may be performed:
the instant communication client verifies whether the current user belongs to a legal user of the instant communication client, if so, step 102 is executed; if not, the flow is ended.
As an optional implementation manner, the instant messaging client verifying whether the current user belongs to a valid user of the instant messaging client may include the following steps:
the method comprises the steps that an instant communication client acquires color information of a face image of a current user of the instant communication client;
the instant communication client carries out binarization processing on the color information of the face image of the current user;
the instant communication client divides the face image of the current user after binarization processing into a plurality of pixel blocks, and performs OR operation on pixel values corresponding to all pixels in each pixel block to obtain an OR operation result of each pixel block to form a down-sampling image of the face image of the current user;
the instant communication client divides the obtained down-sampling image into a plurality of pixel areas, and obtains the characteristic information of each pixel area forming the face image of the current user by summing the OR operation results of all pixel points in each pixel area;
the instant communication client judges whether the face image of the current user is matched with the face image of a legal user stored in the instant communication client in advance according to the characteristic information of each pixel region of the face image of the current user, and if the face image of the current user is matched with the face image of the legal user, the instant communication client determines that the current user belongs to the legal user of the instant communication client; if not, the instant communication client determines that the current user does not belong to the legal user of the instant communication client. According to the embodiment, the subsequent image covering can be executed when the current user of the instant messaging client is accurately identified to be a legal user stored in the instant messaging client in advance, the situation that the illegal user triggers the instant messaging client to cover any target image published on the first group session interface of the first group is prevented, and therefore the legality and reliability of the image covering can be improved.
As another optional implementation manner, after the instant messaging client determines that the face image of the current user matches with the face image of the legal user stored in the instant messaging client in advance according to the feature information of each pixel region of the face image of the current user, the instant messaging client may further perform the following steps:
the instant messaging client preprocesses a corresponding touched fingerprint image when a target image is pressed, wherein the preprocessing comprises image segmentation, image enhancement, image binaryzation and thinning processing of the touched fingerprint image respectively to obtain an input thinned fingerprint image;
the instant messaging client extracts fingerprint minutiae from an input refined fingerprint image, tracks the input refined fingerprint image, extracts sampling points on ridge lines in the input refined fingerprint image, extracts convex hulls of the sampling points of the input refined fingerprint image, and generates input fingerprint characteristics containing the fingerprint minutiae, all the sampling points on the ridge lines and the convex hulls of the sampling points;
the instant communication client identifies whether the input fingerprint characteristics are matched with the fingerprint characteristics of the legal user pre-stored by the instant communication client, if so, the instant communication client determines that the current user belongs to the legal user of the instant communication client; if not, the instant communication client end determines that the current user does not belong to the legal user of the instant communication client end. According to the embodiment, the subsequent image covering can be executed when the current user of the instant messaging client is identified to be a legal user stored in the instant messaging client in advance more accurately, the illegal user is prevented from accidentally triggering the instant messaging client to cover any target image published on the group session interface of the group, and therefore the legality and reliability of the image covering can be improved.
102. And the instant messaging client prompts one user who issues the sound signal on the first group conversation interface to be selected from the first group according to the gesture, and prompts the other user who issues the sound signal on the second group conversation interface to be selected from the second group, so as to form a first user pair.
The user who issues the sound signal on the first group conversation interface refers to the user who issues the sound signal and can be observed on the first group conversation interface at present; the another user who issued the sound signal on the second group conversation interface means another user who issued the sound signal that can be currently viewed on the second group conversation interface.
103. The instant messaging client associates the first user pair with the target image, and covers the target image by using a preset non-privacy image on a first group session interface; wherein the first user pair is used as a first basis for removing the non-privacy image covered by the target image.
The instant messaging client associates the first user pair with the target image means that the instant messaging client associates the corresponding relation of the identifications of the two users in the first user pair with the target image.
In the method described in fig. 1, even when the user equipment (e.g., a mobile phone) where the instant messaging client is located is not locked, the image published on the group session interface of a certain group can be prevented from being peeped by other people based on the cross-group mechanism. In addition, in the method described in fig. 1, an illegal user can be prevented from accidentally triggering the instant messaging client to overlay any target image published on the first group session interface of the first group, so that the legitimacy and reliability of image overlay can be improved.
Referring to fig. 2, fig. 2 is a schematic flow chart illustrating another group control method applied to an instant messaging client according to an embodiment of the present invention. As shown in fig. 2, the group control method applied to the instant messaging client may include the following steps:
201. the instant messaging client detects a gesture which is input by a current user aiming at any target image published on a first group conversation interface of a first group and is used for triggering the target image to be covered.
202. And the instant messaging client prompts one user who issues the sound signal on the first group conversation interface to be selected from the first group according to the gesture, and prompts the other user who issues the sound signal on the second group conversation interface to be selected from the second group, so as to form a first user pair.
203. The instant messaging client associates the first user pair with the target image, and covers the target image by using a preset non-privacy image on a first group session interface; wherein the first user pair is used as a first basis for removing the non-privacy image covered by the target image.
204. The instant messaging client detects a removal instruction for a non-private image overlaid with a target image on a first group session interface.
205. The instant communication client prompts to select any one user from the first group and the second group respectively according to the removing instruction so as to form a second user pair.
206. The instant messaging client judges whether the selected second user pair is the same as a first user pair serving as a first basis for removing the non-private image of the covered target image; if yes, go to step 207; if not, the process is ended.
207. And the instant messaging client removes the non-privacy image covered by the target image on the first group session interface so as to redisplay the target image.
In the method described in fig. 2, only when a second user pair formed by any two users selected from the first group and the second group is the same as a first user pair associated with the target image and issuing a sound signal, the non-private image of the target image covered on the conversation interface of the first group is removed to redisplay the target image; on the contrary, if the second user pair is not the same as the first user pair associated with the target image and issuing the sound signal, the non-private image of the overlaid target image on the first group conversation interface is not removed, and the target image is still overlaid. It can be seen that, by implementing the method described in fig. 2, even when the user equipment (e.g., a mobile phone) where the instant messaging client is located is not locked, the image published on the group session interface of a certain group can be prevented from being peeped by other people based on the cross-group mechanism. In addition, in the method described in fig. 2, an illegal user can be prevented from accidentally triggering the instant messaging client to overlay any target image published on the second group session interface of the first group, so that the legitimacy and reliability of image overlay can be improved.
Referring to fig. 3, fig. 3 is a schematic flow chart illustrating another group control method applied to an instant messaging client according to an embodiment of the present invention. As shown in fig. 3, the group control method applied to the instant messaging client may include the following steps:
301. the instant messaging client detects a gesture which is input by a current user aiming at any target image published on a first group conversation interface of a first group and is used for triggering the target image to be covered.
302. And the instant messaging client prompts one user who issues the sound signal on the first group conversation interface to be selected from the first group according to the gesture, and prompts the other user who issues the sound signal on the second group conversation interface to be selected from the second group, so as to form a first user pair.
303. The instant messaging client associates the first user pair with the target image, prompts to select a first sound signal issued by one user included in the first user pair from the first group conversation interface, prompts to select a first sound signal issued by one user included in the first user pair from the second group conversation interface, and prompts to select a second sound signal issued by the other user included in the first user pair from the second group conversation interface.
The first sound signal issued by one user included in the first user pair may be a voice signal or an ambient sound signal issued by one user included in the first user pair on the first group conversation interface, and the first sound signal issued by another user included in the first user pair may be a voice signal or an ambient sound signal issued by another user included in the first user pair on the second group conversation interface.
304. And the instant messaging client synthesizes the selected first sound signal and the second sound signal to obtain a verification sound signal.
As an optional implementation manner, in an implementation of the present invention, before the instant messaging client performs step 304, the instant messaging client may first determine whether the first sound signal and the second sound signal are both sound signals, and perform step 304 only if the first sound signal and the second sound signal are both sound signals.
For example, the instant messaging client may accurately determine whether the first sound signal is a voice signal by:
the instant messaging client carries out fast Fourier transform on the first sound signal to obtain a frequency domain signal;
the instant communication client calculates a spectrum amplitude value according to the frequency domain signal;
the instant communication client calculates the probability density according to the spectrum amplitude value;
the instant messaging client calculates the spectral entropy of the first sound signal according to the probability density;
the instant messaging client determines whether the first sound signal is a voice signal according to the spectral entropy;
the instant messaging client determines whether the first sound signal is a voice signal according to the spectral entropy, and may include:
the instant messaging client calculates the energy of the first sound signal;
the instant messaging client determines whether the first sound signal is a voice signal or not according to the energy and the spectral entropy of the first sound signal, namely, the instant messaging client can calculate the product of the energy of the first sound signal and the spectral entropy of the first sound signal and carry out the square-open operation on the product to obtain a square-open value corresponding to the product; and the instant communication client can judge whether the square value corresponding to the product is larger than a preset threshold value, if so, the first sound signal is determined to be the voice signal, and if not, the first sound signal is determined not to be the voice signal.
305. The instant messaging client associates the verification sound signal with the target image, and covers the target image by using a preset non-privacy image on a first group session interface; wherein, the first user pair is used as a first basis for removing the non-privacy image covered by the target image; verifying a sound signal as a second criterion for removing the non-private image that has covered the target image.
306. The instant messaging client detects a removal instruction for a non-private image overlaid with a target image on a first group session interface.
307. The instant communication client prompts to select any one user from the first group and the second group respectively according to the removing instruction so as to form a second user pair.
308. The instant messaging client judges whether the second user pair is the same as the first user pair serving as a first basis for removing the non-private image of the covered target image; if yes, go to step 309-step 311; if not, the process is ended.
309. And the instant messaging client prompts to select a third sound signal issued by the second user to one contained user from the first group conversation interface and prompts to select a fourth sound signal issued by the second user to another contained user from the second group conversation interface.
310. And the instant messaging client synthesizes the selected third sound signal and the selected fourth sound signal to obtain a synthesized sound signal.
311. The instant messaging client determines whether the synthesized voice signal matches a verification voice signal that is a second basis for removing the non-private image that covers the target image, and if so, performs step 312; if not, the process is ended.
312. And the instant messaging client removes the non-privacy image covered by the target image on the first group session interface so as to redisplay the target image.
As an alternative implementation manner, in step 304, the synthesizing, by the instant messaging client, the selected first sound signal and the second sound signal to obtain the verification sound signal includes:
the instant messaging client determines an alignment point between the selected first sound signal and the second sound signal; wherein, the alignment point refers to a starting position of the synthesis of the first sound signal and the second sound signal; in other words, if the first sound signal and the second sound signal are to be synthesized, it is necessary to find out from which audio frame the synthesis starts, and this audio frame can be understood as the alignment point;
the instant messaging client synthesizes the first sound signal and the second sound signal into a verification sound signal according to the alignment point.
As an alternative embodiment, the instant messaging client determines an alignment point between the selected first sound signal and the selected second sound signal, and includes:
the instant messaging client calculates a first time length of the selected first sound signal and a second time length of the selected second sound signal; wherein the first duration represents a time of sound duration of the first sound signal; the second time duration represents a time duration of sound of the second sound signal;
the instant messaging client calculates the difference between the first time length and the second time length;
the instant messaging client judges whether the difference value is smaller than or equal to a preset value, if so, any one of the first sound signal and the second sound signal is subjected to periodic scaling to obtain the first sound signal and the second sound signal with the same final duration, and then the first audio frame of the first sound signal and the first audio frame of the second sound signal with the same final duration are used as an alignment point.
In the embodiment of the present invention, if the difference is smaller than or equal to the predetermined value, it indicates that the difference between the two sound signals (i.e. the first sound signal and the second sound signal) is small, and at this time, one of the sound signals (e.g. the first sound signal) may be scaled periodically, for example, periodically compressing the sound signal with a longer duration (i.e. commonly referred to as fast forwarding), and/or periodically amplifying the sound signal with a shorter duration (i.e. commonly referred to as slow forwarding), so that the final durations of the two sound signals are the same, and then the first audio frames of the two sound signals are aligned as an alignment point.
Wherein, the value range of the preset value can be 0 to 0.1 second.
As an optional implementation, the instant messaging client scaling periodically any one of the first sound signal and the second sound signal includes:
if the first time length of the first sound signal is shorter than the second time length of the second sound signal, the instant messaging client determines the proportion X of the difference value in the first time length of the first sound signal according to the difference value;
the instant communication client calculates the audio frame number Y of the first sound signal;
the instant communication client calculates an amplification factor Z, wherein Z is X (Y/(Y-1));
and the instant messaging client amplifies other audio frames except the first audio frame in the first sound signal in equal proportion according to the amplification factor so that the final duration of the amplified first sound signal is the same as the second duration of the second sound signal.
For example, if the first sound signal is 1 second and there are 100 audio frames, each audio frame is 0.01 second, and the second sound signal is 1.1 second, it is necessary to amplify the first sound signal to 1.1 second. The first frame is not moved, the subsequent 99 frames are amplified, and the amplification factor Z is firstly determined to be 0.1 (100/(100-1)) -0.101, namely 10.1%; at this time, in the subsequent 99 frames, each frame needs to be amplified by 10.1%, each amplified frame is 0.01 × 0.01101 (1+ 10.1%), the length of the 99 frames after amplification is 1.09 seconds, and the final duration of the first amplified sound signal is 1.1 seconds after the first frame without motion is added by 0.01 seconds, that is, the final duration of the first amplified sound signal is the same as the second duration of the second sound signal.
In the embodiment of the present invention, if the difference is greater than the preset value, it indicates that the difference between the two sound signals (i.e., the first sound signal and the second sound signal) is large when inputting, and if one of the sound signals is periodically scaled at this time, then relatively serious distortion may be caused after scaling, and a problem may occur in subsequent verification, so that a cross-correlation algorithm may be used to determine the alignment point. That is, when the difference is greater than the preset value, the method further includes:
the instant messaging client uses the same default sampling frequency to respectively sample the first sound signal and the second sound signal to obtain a first sampling group and a second sampling group;
the instant messaging client generates a cross-correlation group according to a default sampling frequency (such as 8000Hz to 10000Hz), a first sampling group, a second sampling group and a cross-correlation weight; wherein, the cross-correlation weight is positively correlated with the difference (for example, the cross-correlation weight may be 1.5 times of the difference), and the cross-correlation group includes a plurality of values;
the instant communication client compares a plurality of values in the cross-correlation group to find out the maximum value;
the instant communication client uses the audio frame position corresponding to the maximum value as the alignment point.
Wherein, the instant messaging client generates the cross-correlation group according to the default sampling frequency, the first sampling group, the second sampling group and the cross-correlation weight, and comprises:
wherein，Sn[t]Representing a set of cross-correlations, x [ m ]]Representing the mth sample data in the first sample group, y [ m-t ]]Represents the (m-t) th sampling data in the second sampling group, t represents the offset of time, t is an integer and takes the value from 0 to m, WtAnd expressing a window function, wherein n is l and f, l is a cross-correlation weight, and f is a default sampling frequency.
The instant messaging client may use the audio frame position corresponding to the maximum value as the alignment point:
after finding the maximum value, the instant messaging client may reversely deduce what m is, that is, which sample data according to the above formula (1), then determine which audio frame the sample data is in, and use the audio frame as the alignment point.
In the embodiment of the invention, after acquiring the first sound signal and the second sound signal, the instant messaging client does not verify the two sound signals one by one, but synthesizes the two sound signals to obtain the verified sound signal, then matches the synthesized sound signal with the verified sound signal when the non-private image needs to be removed, and generates more verifiable parameters (such as whether the alignment points are the same or not, whether the voiceprint characteristics are matched or not and the like) after the sound signals are synthesized.
As an alternative implementation manner, in step 311, the determining, by the instant messaging client, whether the synthesized sound signal matches the verification sound signal as the second basis for removing the non-privacy image covered by the target image includes:
the instant messaging client judges whether an alignment point between the synthesized sound signal and a verification sound signal serving as a second basis for removing the non-privacy image covering the target image is the same; the alignment points are the same, and the content of a mixed frame of two mixed audio frames corresponding to the alignment points (one mixed audio frame belongs to the synthesized sound signal, and the other mixed audio frame belongs to the verification sound signal) is the same, and the frame time of the two mixed audio frames corresponding to the alignment points is also the same;
if the two multi-dimensional vectors are the same, the instant messaging client judges whether the first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with the second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the two multi-dimensional vectors are matched, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal is not matched with the verification voice signal;
the first multi-dimensional vector corresponding to the voiceprint features of the synthesized sound signal is composed of a Mel frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the Mel frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, energy, a first order difference of the energy and a Gammatone filter cepstrum coefficient. In addition, the above embodiment can improve the accuracy of sound matching.
In the method described in fig. 3, even when the user equipment (e.g., a mobile phone) where the instant messaging client is located is not locked, the image published on the group session interface of a certain group can be prevented from being peeped by other people based on the cross-group mechanism. In addition, in the method described in fig. 3, an illegal user can be prevented from accidentally triggering the instant messaging client to overlay any target image published on the first group session interface of the first group, so that the legitimacy and reliability of image overlay can be improved.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The group control method applied to the instant messaging client disclosed by the embodiment of the invention is described in detail, a specific example is applied in the method to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (9)
1. A group control method applied to an instant messaging client, a first group and a second group being created in the instant messaging client, wherein the first group is associated with the second group, the method comprising:
the instant messaging client detects a gesture which is input by a current user aiming at any target image published on a first group session interface of the first group and is used for triggering the target image to be covered;
the instant messaging client prompts one user who issues the sound signal on the first group conversation interface to be selected from the first group according to the gesture, and prompts the other user who issues the sound signal on the second group conversation interface of the second group to be selected from the second group, so that a first user pair is formed;
the instant messaging client associates the first user pair with the target image and covers the target image with a preset non-private image on the first group session interface; wherein the first user pair is used as a first basis for removing the non-private image which covers the target image;
before the instant messaging client prompts to select one user who has issued the sound signal on the first group conversation interface from the first group and prompts to select another user who has issued the sound signal on the second group conversation interface of the second group from the second group according to the gesture, so as to form a first user pair, the method further includes:
the instant communication client verifies whether the current user belongs to a legal user of the instant communication client;
the instant communication client side verifies whether the current user belongs to a legal user of the instant communication client side or not, and the verification comprises the following steps:
the instant communication client acquires color information of a face image of a current user of the instant communication client;
the instant communication client carries out binarization processing on the color information of the face image of the current user;
the instant communication client divides the face image of the current user after binarization processing into a plurality of pixel blocks, and performs OR operation on pixel values corresponding to all pixels in each pixel block to obtain an OR operation result of each pixel block to form a down-sampling image of the face image of the current user;
the instant communication client divides the obtained down-sampling image into a plurality of pixel areas, and obtains the characteristic information of each pixel area forming the face image of the current user by summing the OR operation results of all pixel points in each pixel area;
the instant communication client judges whether the face image of the current user is matched with the face image of the legal user stored in the instant communication client in advance according to the characteristic information of each pixel region of the face image of the current user;
if the fingerprint images are matched with the input refined fingerprint image, the instant messaging client preprocesses the corresponding touched fingerprint image when the target image is pressed, wherein the preprocessing comprises image segmentation, image enhancement, image binarization and refining processing of the touched fingerprint image respectively, and the input refined fingerprint image is obtained;
the instant communication client extracts fingerprint minutiae from the input refined fingerprint image, tracks the input refined fingerprint image, extracts sampling points on ridge lines in the input refined fingerprint image, extracts convex hulls of the sampling points of the input refined fingerprint image, and generates input fingerprint characteristics containing the fingerprint minutiae, the sampling points on all ridge lines and the convex hulls of the sampling points;
the instant communication client identifies whether the input fingerprint characteristics are matched with the fingerprint characteristics of a legal user stored in advance by the instant communication client, and if the input fingerprint characteristics are matched with the fingerprint characteristics of the legal user, the instant communication client determines that the current user belongs to the legal user of the instant communication client; if not, the instant communication client determines that the current user does not belong to the legal user of the instant communication client.
2. The group control method applied to an instant messaging client according to claim 1, wherein after the instant messaging client overlays the target image with a preset non-private image on the first group session interface, the method further comprises:
the instant messaging client detects a removal instruction for the non-private image on the first group session interface which covers the target image;
the instant messaging client prompts any one user to be selected from the first group and the second group respectively according to the removing instruction so as to form a second user pair;
the instant messaging client judges whether the selected second user pair is the same as the first user pair serving as a first basis for removing the non-private image covering the target image or not;
if the target image is the same as the original image, the instant messaging client removes the non-privacy image which is covered by the target image on the first group session interface so as to redisplay the target image.
3. The group control method applied to an instant messaging client according to claim 2, wherein after the instant messaging client associates the first user pair with the target image and before overlaying the target image with a preset non-private image on the first group session interface, the method further comprises:
the instant messaging client prompts to select a first sound signal issued by one user included in the first user pair from the first group conversation interface and prompts to select a second sound signal issued by the other user included in the first user pair from the second group conversation interface;
the instant messaging client synthesizes the selected first sound signal and the second sound signal to obtain a verification sound signal;
the instant messaging client associates the verification sound signal with the target image and executes the step of covering the target image with a preset non-privacy image on the first group session interface; wherein the verification sound signal serves as a second basis for removing the non-private image that has covered the target image;
after the instant messaging client determines that the second user pair is the same as the first user pair serving as a first basis for removing the non-private image covering the target image, and before the instant messaging client removes the non-private image covering the target image on the first group session interface to redisplay the target image, the method further includes:
the instant messaging client prompts to select a third sound signal issued by one user included in the second user pair from the first group session interface and prompts to select a fourth sound signal issued by another user included in the second user pair from the second group session interface;
the instant messaging client synthesizes the selected third sound signal and the selected fourth sound signal to obtain a synthesized sound signal;
the instant messaging client determines whether the synthesized sound signal matches the verification sound signal as a second basis for removing the non-private image that has covered the target image, and if so, performs the step of removing the non-private image that has covered the target image on the first group session interface to redisplay the target image.
4. The group control method applied to an instant messaging client according to claim 3, wherein the instant messaging client synthesizes the selected first sound signal and the second sound signal to obtain a verification sound signal, and comprises:
the instant messaging client determines an alignment point between the selected first sound signal and the selected second sound signal; wherein the alignment point refers to a starting position of the synthesis of the first sound signal and the second sound signal;
and the instant messaging client synthesizes the first sound signal and the second sound signal into a verification sound signal according to the alignment point.
5. The group control method as claimed in claim 4, wherein the determining the selected alignment point between the first sound signal and the second sound signal by the instant messenger client comprises:
the instant messaging client calculates a first time length of the selected first sound signal and a second time length of the selected second sound signal; wherein the first duration represents a duration of sound of the first sound signal; the second time duration represents a time duration of sound of the second sound signal;
the instant messaging client calculates the difference between the first time length and the second time length;
and the instant messaging client judges whether the difference value is smaller than or equal to a preset value, if so, any one of the first sound signal and the second sound signal is subjected to periodic scaling so as to obtain the first sound signal and the second sound signal with the same final duration, and then the first audio frame of the first sound signal and the first audio frame of the second sound signal with the same final duration are taken as an alignment point.
6. The group control method applied to an instant messaging client according to claim 5, wherein the instant messaging client performs the scaling on the period of any one of the first sound signal and the second sound signal, and comprises:
if the first time length of the first sound signal is shorter than the second time length of the second sound signal, the instant messaging client determines the proportion X of the difference value in the first time length of the first sound signal according to the difference value;
the instant communication client calculates the audio frame number Y of the first sound signal;
the instant communication client calculates an amplification factor Z, wherein Z is X (Y/(Y-1));
and the instant messaging client amplifies other audio frames except the first audio frame in the first sound signal in an equal proportion according to the amplification factor, so that the final duration of the amplified first sound signal is the same as the second duration of the second sound signal.
7. The group control method as claimed in claim 5, wherein if the difference is greater than the predetermined value, the method further comprises:
the instant messaging client uses the same default sampling frequency to respectively sample the first sound signal and the second sound signal to obtain a first sampling group and a second sampling group;
the instant communication client generates a cross-correlation group according to the default sampling frequency, the first sampling group, the second sampling group and the cross-correlation weight; wherein the cross-correlation weight is positively correlated with the difference, and the cross-correlation group comprises a plurality of values;
the instant communication client compares a plurality of values in the cross-correlation group to find out the maximum value;
and the instant messaging client uses the audio frame position corresponding to the maximum numerical value as an alignment point.
8. The group control method applied to the instant messaging client according to claim 7, wherein the instant messaging client generates the cross-correlation group according to the default sampling frequency, the first sampling group, the second sampling group and the cross-correlation weight, and comprises:
wherein S isn[t]Representing a set of cross-correlations, x [ m ]]Representing the mth sample data in the first sample group, y [ m-t ]]Represents the (m-t) th sampling data in the second sampling group, t represents the offset of time, t is an integer and takes the value from 0 to m, WtAnd representing a window function, wherein n is l f, l is a cross-correlation weight, and f is the default sampling frequency.
9. The group control method applied to an instant messaging client according to any one of claims 4 to 8, wherein the instant messaging client determining whether the synthesized sound signal matches the verification sound signal as a second basis for removing the non-private image that has overlaid the target image comprises:
the instant messaging client determining whether the alignment point between the synthesized sound signal and the verification sound signal as a second basis for removing the non-privacy image that has overlaid the target image is the same;
if the two multi-dimensional vectors are the same, the instant messaging client judges whether the first multi-dimensional vector corresponding to the voiceprint feature of the synthesized voice signal is matched with the second multi-dimensional vector corresponding to the voiceprint feature of the verified voice signal, and if the two multi-dimensional vectors are matched, the synthesized voice signal is matched with the verified voice signal; if not, determining that the synthesized voice signal does not match the verification voice signal;
the first multi-dimensional vector corresponding to the voiceprint feature of the synthetic sound signal is composed of a mel-frequency cepstrum coefficient, a linear prediction cepstrum coefficient, a first order difference of the mel-frequency cepstrum coefficient, a first order difference of the linear prediction cepstrum coefficient, energy, a first order difference of the energy and a Gammatone filter cepstrum coefficient.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810718503.0A CN108959887B (en) | 2018-07-01 | 2018-07-01 | Group control method applied to instant communication client |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810718503.0A CN108959887B (en) | 2018-07-01 | 2018-07-01 | Group control method applied to instant communication client |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108959887A CN108959887A (en) | 2018-12-07 |
| CN108959887B true CN108959887B (en) | 2021-12-24 |
Family
ID=64485294
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810718503.0A Active CN108959887B (en) | 2018-07-01 | 2018-07-01 | Group control method applied to instant communication client |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108959887B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103455770A (en) * | 2013-08-18 | 2013-12-18 | 苏州量跃信息科技有限公司 | Method and terminal for blanking data contents through touch screen |
| FR3002713A1 (en) * | 2013-02-27 | 2014-08-29 | Inst Mines Telecom | GENERATING A SIGNATURE OF A MUSICAL AUDIO SIGNAL |
| CN104333449A (en) * | 2014-09-29 | 2015-02-04 | 形山科技（深圳）有限公司 | Picture encryption method and system |
| CN104951682A (en) * | 2015-06-05 | 2015-09-30 | 小米科技有限责任公司 | Privacy protection method and device |
| CN105451198A (en) * | 2014-09-30 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Method and device for sharing picture in instant messaging |
| CN105760778A (en) * | 2016-02-17 | 2016-07-13 | 北京金山安全软件有限公司 | Method and device for improving security of private picture and electronic equipment |
| CN107666395A (en) * | 2016-07-28 | 2018-02-06 | 中兴通讯股份有限公司 | One population file management method, user terminal, group chat system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8943141B2 (en) * | 2012-06-18 | 2015-01-27 | Lutebox Ltd. | Social networking system and methods of implementation |
-
2018
- 2018-07-01 CN CN201810718503.0A patent/CN108959887B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3002713A1 (en) * | 2013-02-27 | 2014-08-29 | Inst Mines Telecom | GENERATING A SIGNATURE OF A MUSICAL AUDIO SIGNAL |
| CN103455770A (en) * | 2013-08-18 | 2013-12-18 | 苏州量跃信息科技有限公司 | Method and terminal for blanking data contents through touch screen |
| CN104333449A (en) * | 2014-09-29 | 2015-02-04 | 形山科技（深圳）有限公司 | Picture encryption method and system |
| CN105451198A (en) * | 2014-09-30 | 2016-03-30 | 阿里巴巴集团控股有限公司 | Method and device for sharing picture in instant messaging |
| CN104951682A (en) * | 2015-06-05 | 2015-09-30 | 小米科技有限责任公司 | Privacy protection method and device |
| CN105760778A (en) * | 2016-02-17 | 2016-07-13 | 北京金山安全软件有限公司 | Method and device for improving security of private picture and electronic equipment |
| CN107666395A (en) * | 2016-07-28 | 2018-02-06 | 中兴通讯股份有限公司 | One population file management method, user terminal, group chat system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108959887A (en) | 2018-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109450850B (en) | Identity authentication method, identity authentication device, computer equipment and storage medium | |
| CN106778179B (en) | Identity authentication method based on ultrasonic lip language identification | |
| EP3288238B1 (en) | Terminal alarm method and apparatus | |
| CA2188975C (en) | Method and apparatus employing audio and video data from an individual for authentication purposes | |
| JP6855381B2 (en) | Personal authentication device, personal authentication method and personal authentication program | |
| US20170308739A1 (en) | Human face recognition method and recognition system | |
| US8862888B2 (en) | Systems and methods for three-factor authentication | |
| CN109040439B (en) | Method and device for realizing privacy protection | |
| US7949535B2 (en) | User authentication system, fraudulent user determination method and computer program product | |
| CN111385283A (en) | Double-recording video synthesis method and double-recording system of self-service equipment | |
| EP3321846A1 (en) | Systems and methods for secure biometric sample raw data storage | |
| CN111160928A (en) | Identity verification method and device | |
| CN106980836B (en) | Identity verification method and device | |
| CN111611437A (en) | Method and device for preventing face voiceprint verification and replacement attack | |
| CN111444830A (en) | Imaging method and device based on ultrasonic echo signal, storage medium and electronic device | |
| CN108959887B (en) | Group control method applied to instant communication client | |
| CN108574781B (en) | Image processing method applied to instant messaging client dialogue record | |
| CN113596491A (en) | Cross-border live broadcast system based on cloud server | |
| CN109165533B (en) | Anti-peeping method of short video based on cross-group mechanism | |
| CN108833257B (en) | Picture covering method applied to group | |
| CN109002728B (en) | Group display control method based on one-key triggering | |
| JP2000339471A (en) | Method and device for extracting picture | |
| CN108768681B (en) | Method for displaying real-time image of anchor user caused by virtual resource presentation | |
| CN108768680B (en) | Method for pushing instant images of anchor user during event live broadcast | |
| CN109033897A (en) | It is a kind of based on the image processing method across group mechanisms |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211201 Address after: 200333 room 528, building 20, No. 958, Zhenbei Road, Putuo District, Shanghai Applicant after: SHIYI NETWORK TECHNOLOGY (SHANGHAI) Co.,Ltd. Address before: Room 403, No.35, Sanxiang, xiashou new village, Xicheng District, Dongguan City, Guangdong Province 523073 Applicant before: DONGGUAN HUARUI ELECTRONIC TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |