CN112235527B - Danger early warning method and device - Google Patents
Danger early warning method and device Download PDFInfo
- Publication number
- CN112235527B CN112235527B CN202011098939.8A CN202011098939A CN112235527B CN 112235527 B CN112235527 B CN 112235527B CN 202011098939 A CN202011098939 A CN 202011098939A CN 112235527 B CN112235527 B CN 112235527B
- Authority
- CN
- China
- Prior art keywords
- image
- electronic device
- early warning
- dangerous object
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/0202—Child monitoring systems using a transmitter-receiver system carried by the parent and the child
- G08B21/0205—Specific application combined with child monitoring using a transmitter-receiver system
- G08B21/0208—Combination with audio or video communication, e.g. combination with "baby phone" function
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Child & Adolescent Psychology (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
- Alarm Systems (AREA)
Abstract
The application discloses a danger early warning method and device, and belongs to the technical field of communication. The danger early warning method applied to the first electronic device comprises the following steps: under the condition of carrying out video call with second electronic equipment, receiving a first image sent by the second electronic equipment; and sending danger early warning information to the second electronic equipment under the condition that the first image is detected to include the target dangerous object. The technical scheme provided by the embodiment of the application can solve the problems that in the prior art, a user easily ignores the environmental condition and has potential safety hazards during video call to a certain extent.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to a danger early warning method and device.
Background
With the development of communication technology and intelligent terminal technology, more and more users prefer to use intelligent terminals (such as mobile phones, tablet computers and the like) for communication, and the communication mode is also developed from the initial text communication to the current video communication.
At present, video communication is favored by more and more users, so that the users can realize face-to-face communication, and can see each other while obtaining the sound of each other, thereby improving the communication experience.
However, during video communication, a user may overlook potentially dangerous objects that may be present in the environment by paying too much attention to the display on the screen of the communication device. For example, in a walking scene, the surrounding environment where the user is located has uncertain characteristics, and the user cares too much about the display content on the screen of the communication device, which easily increases the risk of accidents, thereby causing unnecessary personal injury and property loss.
Disclosure of Invention
The embodiment of the application aims to provide a danger early warning method and device, and the problem that potential safety hazards exist due to the fact that a user easily ignores the environment condition during video call in the prior art can be solved to a certain extent.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a danger early warning method, which is applied to a first electronic device, and the danger early warning method includes:
under the condition of carrying out video call with second electronic equipment, receiving a first image sent by the second electronic equipment; the first image is an image collected by a camera of the second electronic device;
sending danger early warning information to the second electronic equipment under the condition that the first image is detected to include a target dangerous object; the first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
In a second aspect, an embodiment of the present application provides a danger early warning method, which is applied to a second electronic device, and the danger early warning method includes:
under the condition of carrying out video call with first electronic equipment, sending a first image to the first electronic equipment; the first image is an image collected by a camera of the second electronic device;
under the condition of receiving danger early warning information sent by the first electronic equipment, outputting the danger early warning information; the first electronic device detects that the first image includes a target dangerous object, the first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
In a third aspect, an embodiment of the present application provides a danger early warning apparatus, which is applied to a first electronic device, and the danger early warning apparatus includes:
the receiving module is used for receiving a first image sent by second electronic equipment under the condition of carrying out video call with the second electronic equipment; the first image is an image collected by a camera of the second electronic device;
the first sending module is used for sending danger early warning information to the second electronic equipment under the condition that the first image is detected to include a target dangerous object; the first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
In a fourth aspect, an embodiment of the present application provides a danger early warning apparatus, which is applied to a second electronic device, and includes:
the second sending module is used for sending the first image to the first electronic equipment under the condition of carrying out video call with the first electronic equipment; the first image is an image collected by a camera of the second electronic device;
the output module is used for outputting the danger early warning information under the condition of receiving the danger early warning information sent by the first electronic equipment; the first electronic device detects that the first image includes a target dangerous object, the first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
In a fifth aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions, when executed by the processor, implementing the steps in the hazard warning method according to the first or second aspect.
In a sixth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, and the program or instructions, when executed by a processor, implement the steps of the hazard warning method according to the first aspect or the second aspect.
In a seventh aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the hazard warning method according to the first aspect or the second aspect.
In the embodiment of the application, under the condition that the first electronic device has the dangerous object identification function and the second electronic device does not have the dangerous object identification function, when the first electronic device and the second electronic device perform video call, the second electronic device can send the image collected by the camera to the first electronic device, the first electronic device detects whether a target dangerous object exists in the image, and under the condition that the target dangerous object exists in the image, dangerous early warning information is sent to the second electronic device, so that the second electronic device outputs the dangerous early warning information, and a user corresponding to the second electronic device is reminded, so that the user avoids potential danger, and the safety during video call is improved.
Drawings
Fig. 1 is a schematic flowchart of a danger early warning method applied to a first electronic device according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a second electronic device displaying danger early warning information according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram of a first electronic device displaying danger early warning information according to an embodiment of the present disclosure;
FIG. 4 is one of schematic views of a video call interface of a second electronic device according to an embodiment of the present application;
fig. 5 is a second schematic diagram of a video call interface of a second electronic device according to an embodiment of the present application;
fig. 6 is a schematic view of a video call interface of a first electronic device according to an embodiment of the present application;
fig. 7 is a schematic flowchart of a danger early warning method applied to a second electronic device according to an embodiment of the present disclosure;
FIG. 8 is a schematic flow chart of an example provided by an embodiment of the present application;
fig. 9 is a schematic block diagram of a danger early warning apparatus applied to a first electronic device according to an embodiment of the present application;
fig. 10 is a schematic block diagram of a danger early warning device applied to a second electronic device according to an embodiment of the present application;
FIG. 11 is a block diagram of an electronic device provided by an embodiment of the application;
fig. 12 is a second schematic block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in other sequences than those illustrated or otherwise described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense to distinguish one object from another, and not necessarily to limit the number of objects, e.g., the first object may be one or more. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The method for warning danger provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
Fig. 1 is a schematic flowchart of a danger early warning method provided in an embodiment of the present application, where the danger early warning method is applied to a first electronic device.
As shown in fig. 1, the method for early warning of danger may include:
step 101: and receiving a first image sent by the second electronic equipment under the condition of carrying out video call with the second electronic equipment.
The first image is an image collected by a camera of the second electronic device, the camera may be any one of a front camera and a rear camera, and the camera may be a camera used for video call or other cameras.
In the embodiment of the application, the first electronic device can receive the image which is sent by the second electronic device and is acquired by the camera of the second electronic device under the condition that the first electronic device carries out video call with the second electronic device.
Step 102: and sending danger early warning information to the second electronic equipment under the condition that the first image is detected to include the target dangerous object.
The targeted hazardous objects described herein may include, but are not limited to: at least one of human, animal, article, and building.
The first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
Because the image that the camera was gathered often can show the user and locate the environmental condition, can reflect the security of user's environment to a certain extent, consequently, under the condition that first electronic equipment has dangerous object recognition function and second electronic equipment does not have dangerous object recognition function, second electronic equipment can send the image of self camera gathering to first electronic equipment. After the first electronic device receives the image sent by the second electronic device, whether the image has the target dangerous object or not can be detected through an artificial intelligence image recognition algorithm. If the first electronic equipment detects that the first image has the target dangerous object, the danger early warning information can be sent to the second electronic equipment, so that the second electronic equipment outputs the danger early warning information, a user corresponding to the second electronic equipment is reminded, the user is enabled to avoid potential danger, potential safety hazards during video call can be reduced, and safety during video call is improved.
Optionally, the danger warning information may include: and the second image is generated after the target dangerous object in the first image is marked, so that the second image can be displayed after the second electronic equipment receives the second image, and the second image can be viewed by a user corresponding to the second electronic equipment, so that the user is reminded to pay attention to the dangerous object.
Illustratively, as shown in fig. 2, a second image 201 is displayed in the screen of the second electronic device, with a marked target threat object 202 in the second image 201. Of course, after the second image is displayed, the user corresponding to the second electronic device may also cancel the display of the second image through touch operation.
Optionally, as described above, after the user cancels the display of the second image through the touch operation, the display interface of the second electronic device may be automatically restored to the display interface before the danger early warning information is received.
The danger warning information may further include: image display adjustment information for controlling image display of the second electronic device. For example, after the second electronic device receives the danger early warning information sent by the first electronic device, the second electronic device may control the second image to be displayed in a full screen mode and hide other images according to the image display adjustment information in the danger early warning information, so that a user corresponding to the second electronic device can better view the second image.
The danger warning information may further include: and at least one of text prompt information and voice prompt information used for prompting the target dangerous object. For example, while the second image is being displayed, a "Please note danger! And the text prompt information is displayed in a bullet screen carousel mode. Of course, while the second image is displayed, voice prompt information such as "have potential danger, please note" and the like can also be played to remind the user multiple times. It is understood that the hazard warning message may also be other types of notification messages, such as a vibration alert message of the device.
Optionally, in a case that the first electronic device detects that the target dangerous object is included in the first image, the danger early warning method further includes: and displaying the second image in a full screen mode.
In the embodiment of the application, after the first electronic device detects that the first image has the target dangerous object, the first image can be processed to generate the second image. After the second image is generated, the second image can be sent to the second electronic device and can be displayed through the display screen of the second image, so that a local user (namely, a user corresponding to the first electronic device) can know the existence of the target dangerous object, and the opposite user can be reminded in time through video call. Wherein, the second image is preferably displayed in a full screen mode, so that the home terminal user can better view the second image. In addition, the second image can be displayed in a full screen mode, and other images can be hidden at the same time, so that interference on display of the second image is avoided. After the second image is displayed, the home terminal user can cancel the display of the second image through touch operation, and simultaneously automatically restore the display interface to the display interface before the second image is displayed.
Optionally, in a case that the first electronic device detects that the target dangerous object is included in the first image, the danger early warning method further includes: and displaying the target image area in the second image in a full screen mode. The target image area is a local image area including the target dangerous object in the second image. That is, the image of the target dangerous object is displayed in an enlarged manner so that the user can better view the dangerous object.
Optionally, for the first electronic device, in addition to displaying the second image, the first electronic device may further remind the home terminal user through at least one of text prompt information and voice prompt information. For example, while the second image is displayed, it is also possible to display "the other party is dangerous! And the text prompt information is displayed in a bullet screen carousel mode. Wherein 301 in fig. 3 represents the second image and 302 represents the marked target threat object. Of course, while the second image is displayed, voice prompt information such as "the other party is dangerous, please note" and the like can also be played.
Optionally, in this embodiment of the application, the second image may be a frame image, that is, the second image is a static image, so that the data transmission amount is small, which is beneficial to improving the transmission speed, and the opposite-end user can timely know the existence of the dangerous object. The second image can also be a dynamic image, such as a dynamic picture or a dynamic video, so that the opposite-end user can better know the dynamic state of the dangerous object, and the dangerous object can be avoided.
Optionally, in this embodiment of the application, if the camera that acquires the first image is not a camera used for video call, in a process that the second electronic device performs video call with the first electronic device, the camera may be controlled at preset intervals to acquire one frame of image, and then the image (i.e., the first image) is sent to the first electronic device, so that data transmission amount may be reduced, and transmission speed may be increased. In this case, the second image may be a still image generated from the currently received first image.
In addition, the second electronic device can also control the camera to continuously collect images and send the collected images to the first electronic device in real time, and at the moment, the first images are the same as the video images during video call, so that target dangerous objects around an opposite-end user (namely, a user corresponding to the second electronic device) can be conveniently and timely found. In this case, the second image may be a still image generated from one frame of the first image or a moving image generated from at least two frames of the first image.
Obviously, if the camera acquiring the first image is a camera for video call, the video image acquired by the camera is sent to the first electronic device in real time.
It is to be understood that a strategy for the second electronic device to control the camera to capture an image, a strategy for the second electronic device to send an image, and a strategy for the first electronic device to generate a second image may also be other realizable manners, and this is not particularly limited in the embodiment of the present invention.
Optionally, if the camera acquiring the first image is not a camera used for video call and the first image is an image continuously acquired by the camera, the first image may be displayed in a reduced size after the first electronic device receives the first image. As shown in fig. 4, in the video call interface of the first electronic device, a video image of the home terminal (i.e., a fourth image 401 in the figure), a video image of the opposite terminal (i.e., a third image 402 in the figure), and a first image 403 sent by the second electronic device are displayed. It should be understood that the image display mode is not limited to that shown in fig. 4, and may be another display mode, for example, the first image 403, the third image 402, and the fourth image 401 are displayed in a reduced size and in parallel, as shown in fig. 5.
Optionally, in order to identify the target dangerous object in the first image, a target dangerous object database may be established, in which characteristic data of the target dangerous object is stored in advance. When the target dangerous object is identified, the feature data of the object identified in the first image may be compared with the pre-stored feature data of the target dangerous object. In the case of a match between the two, the object in the first image is considered to be a target dangerous object; in the event of a mismatch between the two, the object in the first image is deemed not to be the target threat object.
The database may be established in a server, and when the first electronic device performs target object identification, the first electronic device may send feature data of an object identified in the first image to the server, and the server compares the received feature data with pre-stored feature data of a target dangerous object, and then sends a comparison result to the first electronic device. It is of course understood that the database may also be established in the first electronic device.
Optionally, when the first electronic device performs a video call with the second electronic device, the method for early warning of danger may further include: the first electronic equipment acquires a fifth image acquired by a camera of the first electronic equipment; detecting whether a target dangerous object exists in the fifth image; and outputting danger early warning information under the condition that the fifth image is detected to have the target dangerous object. For example, in a case that the danger early warning information includes a sixth image generated after the target dangerous object in the fifth image is marked, the sixth image may be displayed to remind the local user. The display mode of the sixth image may refer to the display mode of the second image, and details are not repeated here.
In the embodiment of the application, the first electronic device may also detect whether a target dangerous object exists in an environment where the end user is located, specifically how to detect and how to perform danger early warning, similar to the foregoing contents, and is not repeated here to avoid repetition.
If the camera acquiring the fifth image is not a camera used for video call and the fifth image is an image continuously acquired by the camera, the first electronic device may perform reduced display on the fifth image. As shown in fig. 6, a fourth image 401 of the home terminal video call, a third image 402 of the peer terminal video call, and a fifth image 404 are displayed in the video call interface of the first electronic device. If the camera that collects the first image at the opposite end is not the camera used for the video call and the first image is an image that is continuously collected by the camera, the first electronic device may also perform reduced display on the first image sent by the second electronic device at the same time, as shown in 403 in fig. 6. It is to be understood that the image display mode is not limited to the display mode shown in fig. 6, but may be other display modes, such as the display mode similar to the display mode shown in fig. 5.
To sum up, in this application embodiment, under the circumstances that first electronic equipment has the hazardous articles recognition function and second electronic equipment does not have the hazardous articles recognition function, when the two carry out the video conversation, second electronic equipment can send the image of self camera collection to first electronic equipment, whether have the target hazardous articles in the detection image by first electronic equipment, and under the circumstances that has the target hazardous articles in the detection image, send dangerous early warning information to second electronic equipment, so that this dangerous early warning information of second electronic equipment output, thereby remind the user that second electronic equipment corresponds, make this user avoid potential danger, security when improving the video conversation.
Fig. 7 is a schematic flowchart of a danger early warning method according to an embodiment of the present application, where the danger early warning method is applied to a second electronic device.
As shown in fig. 7, the danger early warning method may include:
step 701: and sending the first image to the first electronic equipment under the condition of carrying out video call with the first electronic equipment.
The first image is an image collected by a camera of the second electronic device, the camera may be any one of a front camera and a rear camera, and the camera may be a camera used for video call or other cameras.
In the embodiment of the application, the second electronic device can send the image acquired by the camera to the first electronic device under the condition of carrying out video call with the first electronic device.
Step 702: and under the condition of receiving the danger early warning information sent by the first electronic equipment, outputting the danger early warning information.
The danger early warning information is sent when the first electronic device detects that the first image includes the target dangerous object. The targeted hazardous objects described herein may include, but are not limited to: at least one of a human, an animal, an article, a building, and the like.
The first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
Because the image that the camera was gathered often can show the user and locate the environmental condition, can reflect the security of user's environment to a certain extent, consequently, under the circumstances that second electronic equipment does not have the hazardous articles recognition function and first electronic equipment has the hazardous articles recognition function, second electronic equipment can send the image of self camera gathering to first electronic equipment. After the first electronic device receives the image sent by the second electronic device, whether the image has the target dangerous object or not can be detected through an artificial intelligence image recognition algorithm. If the first electronic equipment detects that the first image has the target dangerous object, the danger early warning information can be sent to the second electronic equipment, so that the second electronic equipment outputs the danger early warning information, a user corresponding to the second electronic equipment is reminded, the user is enabled to avoid potential danger, potential safety hazards during video call can be reduced, and safety during video call is improved.
Optionally, the danger warning information may include: and the second image is generated after the target dangerous object in the first image is marked, so that the second image can be displayed after the second electronic equipment receives the second image, and the second image can be viewed by a user corresponding to the second electronic equipment, so that the user is reminded to pay attention to the dangerous object. As shown in fig. 2, a second image 201 is displayed in the screen of the second electronic device, with a marked target threat object 202 in the second image 201. Of course, after the second image is displayed, the user corresponding to the second electronic device may also cancel the display of the second image through touch operation.
The danger warning information may further include: image display adjustment information for controlling image display of the second electronic device. For example, after the second electronic device receives the danger early warning information sent by the first electronic device, the second image can be controlled to be highlighted according to the image display adjustment information in the danger early warning information, and other images are hidden, so that a user corresponding to the second electronic device can better view the second image. Alternatively, the highlighting of the second image may be displaying it full screen, zooming in, adding a flashing logo on the displayed image, and so forth.
The danger warning information may further include: and at least one of text prompt information and voice prompt information used for prompting the target dangerous object. For example, while the second image is being displayed, a "Please note danger! "and the like, wherein the text prompt information can be displayed in a bullet screen carousel manner. Of course, while the second image is displayed, voice prompt information such as "have potential danger, please note" and the like can also be played, and multiple reminders are given to the user. It is understood that the hazard warning message may also be other types of notification messages, such as a vibration alert message of the device.
Optionally, in this embodiment of the application, the second image may be a frame image, that is, the second image is a static image, so that the data transmission amount is small, which is beneficial to improving the transmission speed, and the opposite-end user can timely know the existence of the dangerous object. The second image can also be a dynamic image, such as a dynamic picture or a dynamic video, so that the opposite-end user can better know the dynamic state of the dangerous object, and the dangerous object can be avoided.
Optionally, in this embodiment of the application, if the camera that acquires the first image is not a camera used for video call, the second electronic device may control the rear camera to acquire one frame of image at preset time intervals in the process of performing video call with the first electronic device, and then send the image (i.e., the first image) to the first electronic device, so that data transmission amount may be reduced, and transmission speed may be increased. In this case, the second image may be a still image generated from the currently received first image.
In addition, the second electronic device can also control the camera to continuously collect images and send the collected images to the first electronic device in real time, and at the moment, the first images are the same as the video images during video call, so that target dangerous objects around an opposite-end user (namely, a user corresponding to the second electronic device) can be conveniently and timely found. In this case, the second image may be a still image generated from one frame of the first image or a moving image generated from at least two frames of the first image.
Obviously, in the case that the camera acquiring the first image is a camera for video call, the video image acquired by the camera is sent to the first electronic device in real time.
It is to be understood that a strategy for the second electronic device to control the camera to capture an image, a strategy for the second electronic device to send an image, and a strategy for the first electronic device to generate a second image may also be other realizable manners, and this is not particularly limited in the embodiment of the present invention.
Optionally, if the camera that collects the first image is not a camera used for video call and the first image is an image that is continuously collected by the camera, the second electronic device may send the first image to the first electronic device and may perform reduced display on the first image, so that the local user may know the environment where the local user is located.
Optionally, step 701: in the case of performing a video call with a first electronic device, sending a first image to the first electronic device may include: and sending the first image to the first electronic equipment under the conditions that the video call is carried out with the first electronic equipment and the home terminal user is detected to be in a walking state.
The home terminal user is a user corresponding to the second electronic device. The first image is an image collected by a rear camera of the second electronic device.
In the embodiment of the application, when the second electronic device performs a video call with the first electronic device and detects that the home terminal user is in a walking state, if a camera used for the video call between the second electronic device and the first electronic device is a front-facing camera, the rear-facing camera is started to acquire a first image, and the first image is sent to the first electronic device; if the camera used for the video call between the second electronic device and the first electronic device is a rear camera, the image acquired by the rear camera is directly used as a first image and sent to the first electronic device.
When a user is in video call, the user mainly pays attention to the video call, and easily ignores the surrounding situation. Especially, when a video call is performed in a walking process, because the surrounding environment is easy to change and uncertain factors are many, dangerous things such as a telegraph pole, a vehicle and the like are easy to happen due to the fact that the surrounding environment is not noticed, and therefore, the video call performed in the walking process needs to pay attention to safety problems in particular. And because the visual angle of the rear camera is wider, whether the target dangerous object exists can be judged based on the image collected by the rear camera.
Optionally, step 102: outputting the danger early warning information may include: displaying the second image in a full screen mode; alternatively, the second image is displayed in place of the first image.
In the embodiment of the application, after receiving the second image sent by the first electronic device, the second electronic device can display the second image, so that the home terminal user can know the existence of the target dangerous object. When the second image is displayed, the second image can be displayed in a full screen preferentially, so that the home terminal user can better view the second image. In addition, the second image can be displayed in a full screen mode, and other images can be hidden at the same time, so that interference on display of the second image is avoided.
In addition to displaying the second image in a full screen, if the first image is displayed on the screen of the second electronic device, the second image may be displayed in place of the first image for the user to view.
Optionally, step 102: outputting the danger early warning information may include: and displaying the target image area in the second image in a full screen mode. The target image area is a local image area including the target dangerous object in the second image. That is, the image of the target dangerous object is displayed in an enlarged manner so that the user can better view the dangerous object.
Finally, in order to better understand the method for early warning of danger provided by the embodiment of the present invention, the following further explains the method with an example.
As shown in fig. 8, in this example, the interaction process between the first electronic device and the second electronic device is as follows:
step 801: the second electronic device detects that the video call is performed with the first electronic device and the home terminal user is in a walking state, and then step 802 is performed.
And the second electronic equipment adopts the image collected by the front camera to carry out video call with the first electronic equipment.
Step 802: the second electronic device starts the rear camera to capture an image, and then proceeds to step 803.
Step 803: the second electronic device displays the first image and simultaneously transmits the first image to the first electronic device, and then step 804 is entered.
The first image is acquired by the rear camera in real time, and the second electronic equipment displays the first image in a reduced mode. And if the second electronic equipment adopts the image collected by the rear camera to carry out video call with the first electronic equipment, the second electronic equipment normally displays the first image.
Step 804: the first electronic device receives the first image sent by the second electronic device, and then step 805 is entered.
Step 805: the first electronic device identifies whether the target threat object is present in the first image and then proceeds to step 806.
Step 806: the first electronic device recognizes that the target dangerous object exists in the first image, generates the danger early warning information, and then proceeds to step 807.
Wherein, the danger early warning information herein includes: and generating a second image and character prompt information after marking the target dangerous object in the first image.
Step 807: the first electronic device sends the danger early warning information to the second electronic device, displays the danger early warning information at the home terminal to remind a user at the home terminal, and then enters step 808.
The home terminal user is a user corresponding to the first electronic device.
Step 809: and the second electronic equipment receives and displays the danger early warning information sent by the first electronic equipment so as to remind the home terminal user.
The home terminal user is a user corresponding to the second electronic device.
In the above description of the example, it should be noted that the execution sequence of the above steps is only for illustration, and not necessarily, and the actual execution sequence may be adjusted according to actual requirements.
To sum up, in this application embodiment, under the circumstances that first electronic equipment has the hazardous articles recognition function and second electronic equipment does not have the hazardous articles recognition function, when the two carry out the video conversation, second electronic equipment can send the image of self camera collection to first electronic equipment, whether have the target hazardous articles in the detection image by first electronic equipment, and under the circumstances that has the target hazardous articles in the detection image, send dangerous early warning information to second electronic equipment, so that this dangerous early warning information of second electronic equipment output, thereby remind the user that second electronic equipment corresponds, make this user avoid potential danger, security when improving the video conversation.
It should be noted that, in the danger early warning method applied to the first electronic device and the second electronic device provided in the embodiment of the present application, the execution main body may be a danger early warning device, or a control module used for executing the danger early warning method in the danger early warning device. In the embodiment of the present application, a method for executing a risk early warning by a risk early warning device is taken as an example to explain the risk early warning device provided in the embodiment of the present application.
Fig. 9 is a schematic block diagram of a danger early warning apparatus provided in an embodiment of the present application, where the danger early warning apparatus is applied to a first electronic device.
As shown in fig. 9, the danger early warning apparatus includes:
the receiving module 901 is configured to receive a first image sent by a second electronic device when a video call is performed with the second electronic device.
The first image is an image collected by a camera of the second electronic device.
A first sending module 902, configured to send danger early warning information to the second electronic device when it is detected that the first image includes a target dangerous object.
The first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
Optionally, the danger early warning information includes: and the second image is generated after the target dangerous object in the first image is marked.
Optionally, the danger early warning device further includes:
and the display module is used for displaying the second image in a full screen mode.
The danger early warning device provided in the embodiment of the application can realize each process realized by the embodiment of the danger early warning method shown in fig. 1, and is not repeated here for avoiding repetition.
In the embodiment of the application, under the condition that the first electronic device has the dangerous object identification function and the second electronic device does not have the dangerous object identification function, when the first electronic device and the second electronic device perform video call, the second electronic device can send the image collected by the camera to the first electronic device, whether the first electronic device detects that the image has the target dangerous object or not is detected, and under the condition that the image has the target dangerous object, dangerous early warning information is sent to the second electronic device, so that the second electronic device outputs the dangerous early warning information, and a user corresponding to the second electronic device is reminded, so that the user avoids potential dangers, and the safety during video call is improved.
Fig. 10 is a schematic block diagram of a danger early warning apparatus provided in an embodiment of the present application, where the danger early warning apparatus is applied to a second electronic device.
As shown in fig. 10, the danger early warning apparatus includes:
the second sending module 1001 is configured to send a first image to a first electronic device when a video call is performed with the first electronic device.
The first image is an image collected by a camera of the second electronic device.
The output module 1002 is configured to output the danger early warning information when the danger early warning information sent by the first electronic device is received.
The danger early warning information is sent when the first electronic device detects that the first image comprises a target dangerous object; the first electronic device has a dangerous object recognition function, and the second electronic device does not have a dangerous object recognition function.
Optionally, the second sending module 1002 includes:
and the sending unit is used for sending the first image to the first electronic equipment under the conditions that the video call is carried out with the first electronic equipment and the home terminal user is detected to be in a walking state.
The first image is an image collected by a rear camera of the second electronic device.
Optionally, the output module is specifically configured to:
displaying a second image in a full screen mode under the condition that the danger early warning information comprises the second image;
or, under the condition that the danger early warning information comprises a second image, the second image is used for replacing the first image to be displayed;
the second image is generated after the target dangerous object in the first image is marked.
The danger early warning device provided in the embodiment of the application can implement each process implemented by the embodiment of the danger early warning method shown in fig. 8, and is not repeated here to avoid repetition.
In the embodiment of the application, under the condition that the first electronic device has the dangerous object identification function and the second electronic device does not have the dangerous object identification function, when the first electronic device and the second electronic device perform video call, the second electronic device can send the image collected by the camera to the first electronic device, whether the first electronic device detects that the image has the target dangerous object or not is detected, and under the condition that the image has the target dangerous object, dangerous early warning information is sent to the second electronic device, so that the second electronic device outputs the dangerous early warning information, and a user corresponding to the second electronic device is reminded, so that the user avoids potential dangers, and the safety during video call is improved.
The danger early warning device applied to the first electronic device and the second electronic device in the embodiment of the application may be devices, or may be components, integrated circuits, or chips in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The danger early warning device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
Optionally, as shown in fig. 11, an electronic device 1100 is further provided in this embodiment of the present application, and includes a processor 1101, a memory 1102, and a program or an instruction stored in the memory 1102 and executable on the processor 1101, where the program or the instruction is executed by the processor 1101 to implement the processes of the above-mentioned embodiment of the risk early warning method applied to the first electronic device or applied to the second electronic device, and can achieve the same technical effects, and in order to avoid repetition, the details are not repeated here.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.
Fig. 12 is a schematic hardware structure diagram of an electronic device implementing an embodiment of the present application.
The electronic device 1200 includes, but is not limited to: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensors 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 1209, and processor 1210. The electronic device 1200 may be a headset.
Those skilled in the art will appreciate that the electronic device 1200 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 1210 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 12 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
In the case where the electronic apparatus 1200 is a first electronic apparatus, the input unit 1204 is configured to: receiving a first image sent by second electronic equipment under the condition of carrying out video call with the second electronic equipment; the processor 1210 is configured to send danger early warning information to the second electronic device when it is detected that the first image includes a target dangerous object.
The first image is an image collected by a camera of the second electronic device; the first electronic device has a dangerous object recognition function, and the second electronic device does not have a dangerous object recognition function.
Optionally, the display unit 1206 is configured to: and displaying the second image in a full screen mode.
The second image is an image generated after the target dangerous object in the first image is marked.
In the case where the electronic device 1200 is a second electronic device, the processor 1210 is configured to: under the condition of carrying out video call with first electronic equipment, sending a first image to the first electronic equipment; and outputting the danger early warning information under the condition of receiving the danger early warning information sent by the first electronic equipment.
The first image is an image collected by a camera of the second electronic device; the danger early warning information is sent when the first electronic device detects that the first image comprises a target dangerous object, the first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
Optionally, the processor 1210 is further configured to: and sending the first image to the first electronic equipment under the condition of carrying out video call with the first electronic equipment and detecting that the home terminal user is in a walking state.
The first image is an image collected by a rear camera of the second electronic device.
Optionally, the processor 1210 is further configured to: and controlling the display unit 1206 to display the second image in a full screen mode or replace the first image with the second image for displaying when the danger early warning information comprises the second image.
And the second image is generated after the target dangerous object in the first image is marked.
In the embodiment of the application, under the condition that the first electronic device has the dangerous object identification function and the second electronic device does not have the dangerous object identification function, when the first electronic device and the second electronic device perform video call, the second electronic device can send the image collected by the camera to the first electronic device, whether the first electronic device detects that the image has the target dangerous object or not is detected, and under the condition that the image has the target dangerous object, dangerous early warning information is sent to the second electronic device, so that the second electronic device outputs the dangerous early warning information, and a user corresponding to the second electronic device is reminded, so that the user avoids potential dangers, and the safety during video call is improved.
It should be understood that, in the embodiment of the present application, the input Unit 1204 may include a Graphics Processing Unit (GPU) 12041 and a microphone 12042, and the Graphics Processing Unit 12041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1207 includes a touch panel 12071 and other input devices 12072. A touch panel 12071, also referred to as a touch screen. The touch panel 12071 may include two parts of a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1209 may be used to store software programs as well as various data, including but not limited to application programs and an operating system. Processor 1210 may integrate an application processor, which handles primarily the operating system, user interface, applications, etc., and a modem processor, which handles primarily wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1210.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the above-mentioned embodiment of the hazard early warning method applied to the first electronic device or applied to the second electronic device, and can achieve the same technical effects, and in order to avoid repetition, the detailed description is omitted here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned danger early warning method embodiment applied to the first electronic device or applied to the second electronic device, and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (10)
1. A danger early warning method is applied to first electronic equipment and is characterized by comprising the following steps:
under the condition of carrying out video call with second electronic equipment, receiving a first image sent by the second electronic equipment; the first image is an image collected by a camera of the second electronic device;
sending danger early warning information to the second electronic equipment under the condition that the first image is detected to include a target dangerous object; the first electronic device has a dangerous object identification function, and the second electronic device does not have a dangerous object identification function.
2. The hazard warning method of claim 1, wherein the hazard warning information comprises: and the second image is generated after the target dangerous object in the first image is marked.
3. The hazard early warning method according to claim 2, wherein in a case where it is detected that a target hazardous object is included in the first image, the hazard early warning method further comprises:
and displaying the second image in a full screen mode.
4. A danger early warning method is applied to second electronic equipment and is characterized by comprising the following steps:
under the condition of carrying out video call with first electronic equipment, sending a first image to the first electronic equipment; the first image is an image collected by a camera of the second electronic device;
under the condition of receiving danger early warning information sent by the first electronic equipment, outputting the danger early warning information;
the first electronic device detects that the first image includes a target dangerous object, the first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
5. The method of claim 4, wherein sending the first image to the first electronic device in case of a video call with the first electronic device comprises:
the method comprises the steps that when a video call is carried out with the first electronic device and a home terminal user is detected to be in a walking state, the first image is sent to the first electronic device;
the first image is an image collected by a rear camera of the second electronic device.
6. The danger early warning method of claim 4, wherein the outputting the danger early warning information comprises:
displaying a second image in a full screen mode under the condition that the danger early warning information comprises the second image;
or, under the condition that the danger early warning information comprises a second image, the second image is used for replacing the first image to be displayed;
and the second image is generated after the target dangerous object in the first image is marked.
7. The utility model provides a danger early warning device, is applied to first electronic equipment, its characterized in that includes:
the receiving module is used for receiving a first image sent by second electronic equipment under the condition of carrying out video call with the second electronic equipment; the first image is an image collected by a camera of the second electronic device;
the first sending module is used for sending danger early warning information to the second electronic equipment under the condition that the first image is detected to include a target dangerous object; the first electronic device has a dangerous object identification function, and the second electronic device does not have a dangerous object identification function.
8. The danger early warning device according to claim 7, further comprising:
the display module is used for displaying the second image in a full screen mode;
and the second image is generated after the target dangerous object in the first image is marked.
9. The utility model provides a danger early warning device, is applied to second electronic equipment, its characterized in that includes:
the second sending module is used for sending the first image to the first electronic equipment under the condition of carrying out video call with the first electronic equipment; the first image is an image collected by a camera of the second electronic device;
the output module is used for outputting the danger early warning information under the condition of receiving the danger early warning information sent by the first electronic equipment;
the first electronic device detects that the first image includes a target dangerous object, the first electronic device has a dangerous object identification function, and the second electronic device does not have the dangerous object identification function.
10. The hazard early warning device of claim 9, wherein the output module is specifically configured to:
displaying a second image in a full screen mode under the condition that the danger early warning information comprises the second image;
or, under the condition that the danger early warning information comprises a second image, the second image is used for replacing the first image to be displayed;
and the second image is generated after the target dangerous object in the first image is marked.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011098939.8A CN112235527B (en) | 2020-10-14 | 2020-10-14 | Danger early warning method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011098939.8A CN112235527B (en) | 2020-10-14 | 2020-10-14 | Danger early warning method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112235527A CN112235527A (en) | 2021-01-15 |
| CN112235527B true CN112235527B (en) | 2023-03-21 |
Family
ID=74112870
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011098939.8A Active CN112235527B (en) | 2020-10-14 | 2020-10-14 | Danger early warning method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112235527B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006239197A (en) * | 2005-03-04 | 2006-09-14 | Mitsubishi Electric System & Service Co Ltd | Mobile communication terminal machine |
| WO2010042254A1 (en) * | 2008-10-08 | 2010-04-15 | Sony Ericsson Mobile Communications Ab | Personal security feature for a regular camera phone |
| CN104333654A (en) * | 2014-10-14 | 2015-02-04 | 京东方科技集团股份有限公司 | Danger warning method, danger warning device and portable electronic equipment |
| CN106534523A (en) * | 2016-10-28 | 2017-03-22 | 维沃移动通信有限公司 | Mobile terminal danger early-warning method, and mobile terminal |
| EP3157233A1 (en) * | 2015-10-13 | 2017-04-19 | Thomson Licensing | Handheld device, method for operating the handheld device and computer program |
| CN107566659A (en) * | 2017-10-20 | 2018-01-09 | 维沃移动通信有限公司 | User security based reminding method and mobile terminal |
| CN109120801A (en) * | 2018-10-30 | 2019-01-01 | Oppo（重庆）智能科技有限公司 | A kind of method, device and mobile terminal of dangerous goods detection |
| CN110177234A (en) * | 2018-10-25 | 2019-08-27 | 广东小天才科技有限公司 | Video call method based on scene recognition and wearable device |
| CN110177239A (en) * | 2019-03-14 | 2019-08-27 | 广东小天才科技有限公司 | Video call method based on remote control and wearable device |
| CN110177231A (en) * | 2018-10-11 | 2019-08-27 | 广东小天才科技有限公司 | Video call method for wearable device and wearable device |
| CN111093046A (en) * | 2019-04-22 | 2020-05-01 | 广东小天才科技有限公司 | Display screen opening method based on image acquisition equipment and terminal equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150248772A1 (en) * | 2014-02-28 | 2015-09-03 | Semiconductor Components Industries, Llc | Imaging systems and methods for monitoring user surroundings |
-
2020
- 2020-10-14 CN CN202011098939.8A patent/CN112235527B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006239197A (en) * | 2005-03-04 | 2006-09-14 | Mitsubishi Electric System & Service Co Ltd | Mobile communication terminal machine |
| WO2010042254A1 (en) * | 2008-10-08 | 2010-04-15 | Sony Ericsson Mobile Communications Ab | Personal security feature for a regular camera phone |
| CN104333654A (en) * | 2014-10-14 | 2015-02-04 | 京东方科技集团股份有限公司 | Danger warning method, danger warning device and portable electronic equipment |
| EP3157233A1 (en) * | 2015-10-13 | 2017-04-19 | Thomson Licensing | Handheld device, method for operating the handheld device and computer program |
| CN106534523A (en) * | 2016-10-28 | 2017-03-22 | 维沃移动通信有限公司 | Mobile terminal danger early-warning method, and mobile terminal |
| CN107566659A (en) * | 2017-10-20 | 2018-01-09 | 维沃移动通信有限公司 | User security based reminding method and mobile terminal |
| CN110177231A (en) * | 2018-10-11 | 2019-08-27 | 广东小天才科技有限公司 | Video call method for wearable device and wearable device |
| CN110177234A (en) * | 2018-10-25 | 2019-08-27 | 广东小天才科技有限公司 | Video call method based on scene recognition and wearable device |
| CN109120801A (en) * | 2018-10-30 | 2019-01-01 | Oppo（重庆）智能科技有限公司 | A kind of method, device and mobile terminal of dangerous goods detection |
| CN110177239A (en) * | 2019-03-14 | 2019-08-27 | 广东小天才科技有限公司 | Video call method based on remote control and wearable device |
| CN111093046A (en) * | 2019-04-22 | 2020-05-01 | 广东小天才科技有限公司 | Display screen opening method based on image acquisition equipment and terminal equipment |
Non-Patent Citations (1)
| Title |
|---|
| 周刚等.电力行业风险较大作业项目安全管控研究与应用.《电工技术》.2020,(第01期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112235527A (en) | 2021-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108491123B (en) | Method for adjusting application program icon and mobile terminal | |
| CN109814786B (en) | Image storage method and terminal equipment | |
| CN108391008B (en) | Message reminding method and mobile terminal | |
| CN113141293B (en) | Message display method and device and electronic equipment | |
| CN111901896A (en) | Information sharing method, information sharing device, electronic equipment and storage medium | |
| CN112764624B (en) | Information screen display method and device | |
| CN109189303B (en) | Text editing method and mobile terminal | |
| CN107808107B (en) | Application message display method and mobile terminal | |
| US20230152956A1 (en) | Wallpaper display control method and apparatus and electronic device | |
| CN112261340B (en) | Visual field sharing method and device, electronic equipment and readable storage medium | |
| CN112214112A (en) | Parameter adjusting method and device | |
| CN111064654A (en) | Message display method and electronic equipment | |
| CN111865763A (en) | Message display method and device, electronic equipment and storage medium | |
| CN109670105B (en) | Searching method and mobile terminal | |
| CN113709307A (en) | Message display method and device and electronic equipment | |
| CN108063869B (en) | Safety early warning method and mobile terminal | |
| CN107704159B (en) | Application icon management method and mobile terminal | |
| CN113676395A (en) | Information processing method, related device and readable storage medium | |
| CN113806000A (en) | Display method and device and electronic equipment | |
| CN112235527B (en) | Danger early warning method and device | |
| CN113703592B (en) | Secure input method and device | |
| CN110766396A (en) | Graphic code display method and electronic equipment | |
| CN115718581A (en) | Information display method and device, electronic equipment and storage medium | |
| CN113364915B (en) | Information display method and device and electronic equipment | |
| CN113342223A (en) | Unread message identifier display method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |