TW201621833A - Hazard warning method and portable device utilizing the same - Google Patents

Abstract

A hazard warning method for a portable device comprises the steps of: capturing an environmental image toward a first direction when receiving a control signal, and generating a warning signal when the environmental image comprises a dangerous object therein. The aforementioned portable device comprises a image capturing module, a storage module, and a determining module. The image capturing module is used for capturing the environmental image toward the first direction when receiving the control signal. The storage module is used for storing an object database. The determining module is used for determining whether the environmental image having a dangerous object defined in the object database, and generating the warning signal when the environmental image has the dangerous object.

Description

Danger warning method and mobile device applying the same

The present invention relates to a dangerous warning method and a mobile device using the same, and more particularly to a dangerous warning method using an image comparison technique and a mobile device using the same.

At present, when using mobile devices, it is necessary to constantly bow down and form a low-headed phenomenon. However, when the user is staring at the screen while walking, there may be a risk of accidents due to lack of direct visibility, such as a car coming in front of the car, an obstacle or an uneven road surface, which is easy for the user to be hurt. . Therefore, there is a need for a tool that can help the user to pay attention to the road conditions, and remind the user early in the event of an accident that may occur in front.

In view of the above problems, the present invention provides a dangerous warning method and a mobile device using the same, which selectively emits a warning message by judging whether there is a dangerous object in the captured image. This allows the user of the mobile device to know if there is a danger in its direction of travel.

A dangerous warning method according to the present invention is applicable to a mobile device. The method includes the following steps: when receiving the control signal, the first direction is Take an environmental image. Determine if this environmental image contains dangerous objects defined by the object database. And when the environmental image contains dangerous objects, a warning message is generated.

In an embodiment of the invention, the object database stores a plurality of dangerous object images, and in the step of determining whether the environmental image contains the dangerous object, the method includes the following steps: analyzing the environmental image to obtain multiple images included in the environmental image. Environmental object imagery. For each environmental object image, it is determined whether the environmental object image substantially corresponds to one of the plurality of dangerous object images in the object database. When at least one of the foregoing environmental object images substantially corresponds to at least one of the aforementioned dangerous object images, it is determined that the environmental image contains a dangerous object. When all the environmental object images do not substantially correspond to the aforementioned dangerous object image, it is judged that the environmental image does not contain dangerous objects.

In an embodiment of the invention, the dangerous object image is classified into a high-risk object image and a low-risk object image, and when at least one of the environmental object images substantially corresponds to the high-risk object image, the environmental image is used as the warning message. .

In an embodiment of the invention, the method further comprises the step of: detecting an acceleration value with an accelerometer. Based on the acceleration value, it is determined whether the mobile device moves. A control signal is generated when it is determined that the mobile device is moving. The first direction can be adjusted according to the acceleration value.

A mobile device according to the present invention includes an image capturing module, a storage module and a determining module. The judging module is electrically connected to the image capturing module and the storage module. The image capturing module is configured to receive the control signal in a first direction Capture environmental images. The storage module is used to store the object database. The determining module is configured to determine whether the environmental image includes a dangerous object defined in the object database, and generate a warning message when determining that the environmental image contains a dangerous object.

In an embodiment of the invention, the object database stores a plurality of dangerous object images, and the determining module includes an image analyzing unit and an image matching unit. The image analysis unit is electrically connected to the image capture module, and the image comparison unit is electrically connected to the image analysis unit and the storage module. The image analysis unit is configured to analyze the environment image to obtain a plurality of environmental object images included in the environment image. The image comparison unit is configured to determine, according to each environment object image, whether the environment object image substantially corresponds to one of the dangerous object images, wherein at least one of the environmental object images substantially corresponds to at least one of the dangerous object images It is determined that the environmental image contains dangerous objects, and when all the environmental object images do not substantially correspond to the dangerous object image, it is judged that the environmental image does not contain dangerous objects.

In an embodiment of the invention, the mobile device further includes a display module. The dangerous object image is classified into a high-risk object image and a low-risk object image, and when at least one of the environmental object images substantially corresponds to at least one of the high-risk object images, the environmental image is displayed as a warning message on the display module. .

In an embodiment of the invention, the mobile device further includes an accelerometer and a control module. The control module is electrically connected to the accelerometer and the image capturing module. The accelerometer is used to detect the acceleration value. The control module is configured to determine whether the mobile device moves according to the acceleration value, and when the mobile device is determined to move, the control module generates a control signal.

In an embodiment of the invention, the image capturing module is rotatably disposed on the mobile device, and the control module further rotates the image capturing module according to the acceleration value to adjust the first direction.

In summary, according to the hazard warning method of the present invention, it is determined whether the environmental image contains the defined dangerous object image by comparing the captured environmental image with the plurality of dangerous object images in the object database. This selectively sends a warning message to alert the user. In this way, the low-headed family can avoid the danger of not paying attention to the road ahead, because the mobile device will automatically help the low-headed people pay attention to the road conditions.

The above description of the present invention and the following description of the embodiments of the present invention are intended to illustrate and explain the spirit and principles of the invention.

100‧‧‧ mobile devices

110‧‧‧Image capture module

120‧‧‧ storage module

130‧‧‧Judgement module

131‧‧‧Image Resolution Unit

133‧‧‧Image comparison unit

140‧‧‧ display module

150‧‧‧Audio Module

160‧‧ ‧ accelerometer

170‧‧‧Control Module

200‧‧‧First direction

300‧‧‧Environmental imagery

301‧‧‧Central Block

303, 305‧‧‧ edge blocks

310~340‧‧‧Environmental object imagery

D1, D2‧‧‧ axial

1A is a schematic view showing the appearance of a mobile device according to an embodiment of the present invention.

Fig. 1B is a functional block diagram of the mobile device corresponding to Fig. 1A.

2 is a schematic diagram of an environmental image in accordance with an embodiment of the present invention.

3A to 3C are respectively schematic views of accelerations of the mobile device according to an embodiment of the present invention.

Figure 4 is a schematic view showing the use of a mobile device in accordance with an embodiment of the present invention.

Fig. 5 is a flow chart showing a dangerous warning method applied to a mobile device according to an embodiment of the present invention.

Figure 6 is a flow chart of step S700 in accordance with an embodiment of the present invention.

The detailed features and advantages of the present invention are set forth in the Detailed Description of the Detailed Description of the <RTIgt; </ RTI> <RTIgt; </ RTI> </ RTI> </ RTI> <RTIgt; The objects and advantages associated with the present invention can be readily understood by those skilled in the art. The following examples are intended to describe the present invention in further detail, but are not intended to limit the scope of the invention.

Please refer to FIG. 1A and FIG. 1B , wherein FIG. 1A is a schematic diagram showing the appearance of a mobile device according to an embodiment of the present invention, and FIG. 1B is a functional block diagram corresponding to the mobile device of FIG. 1A . As shown in FIG. 1A, the mobile device 100 disclosed in the present invention has an image capturing module 110. As shown in FIG. 1B , the mobile device 100 further includes a storage module 120 and a determination module 130 . The determining module 130 is electrically connected to the image capturing module 110 and the storage module 120. The image capturing module 110 may be, but is not limited to, a complementary metal oxide photosensitive element, a capacitively coupled photosensitive element, or other electronic component suitable for capturing images, in accordance with the spirit of the present invention. The storage module 120 may be, but is not limited to, a non-volatile memory element such as a flash memory, a magnetic disk, or an electronically rewritable read-only memory, in accordance with the spirit of the present invention.

Returning to FIG. 1A, the image capturing module 110 in this embodiment will capture the environmental image in the first direction 200 when receiving the control signal. The environmental image is then transmitted to the decision module 130. The judgment module 130 can be divided into image solutions The analyzing unit 131 and the image matching unit 133. In fact, the judging module 130 may be a central processing unit, a single-chip processor, a field programmable logic gate array, or other electronic components that can be used for image processing in accordance with the spirit of the present invention. The image analyzing unit 131 is electrically connected to the image capturing module 110. When the image analyzing unit 131 receives the environmental image, the image analyzing unit 131 analyzes the environmental image to obtain a plurality of environmental object images in the environmental image, and the method is as follows.

Please refer to FIG. 2, which is a schematic diagram of an environmental image according to an embodiment of the invention. In one embodiment, the image parsing unit 131 may perform high-pass filtering on each column of pixels and each row of pixels of the environment image 300 in FIG. 2 to define adjacent blocks with large color or gray scale changes. These defined blocks can be used as the boundary of the image of each environment object in the image, thereby obtaining the main environmental object image in the environment image 300. In this manner, the image analysis unit 131 analyzes the image 310 of the locomotive, the image 320 of the fence, the image 330 of the automobile, and the image 340 of the step from the environmental image 300. Then, the image comparison module 133 compares the plurality of environmental object images with the dangerous object images in the object database stored in the storage module 120 one by one to determine whether there is any environment in the plurality of environmental object images. The object image corresponds to the image of the dangerous object stored in the object database.

In practice, taking the image 320 of the fence as an example, when the three-dimensional structure diagram or plan view of the fence defined as the dangerous object image in the object database is compared with the image 320 of the fence, the image comparison unit 133 first The left column in the three-dimensional structure of the fence corresponds to the left column of the image 320 of the fence, and then the three-dimensional structure of the fence is enlarged or reduced and rotated. If the fence image 320 is right The side pillars and/or the crossbars may overlap with the right pillars and/or the crossbars in the three-dimensional structure diagram of the fence, and it is determined that the image 320 of the fence substantially corresponds to the three-dimensional structure diagram of the fence, that is, at least one environment The object image substantially corresponds to a dangerous object image. Moreover, the foregoing positions overlap, and in one embodiment, the positions of the two may differ by less than one fault tolerance threshold (e.g., 1/10 of the height of the entire fence).

The image comparison unit 133 sequentially compares the image 310 of the locomotive, the image 320 of the fence, the image 340 of the person and the image 340 of the step with the image of the dangerous object stored in the object database until any one image is judged to substantially correspond to In the case of a dangerous object image, the image matching unit 133 determines that the environmental image 300 contains an image of a dangerous object and correspondingly generates a warning message. If none of the images corresponds to the dangerous image after all the images are compared, the image matching unit 133 determines that the environmental image 300 does not contain the image of the dangerous object. The warning message may be an image, a symbol, or a character of the display module 140 of the mobile device 100, or may be an alarm ring sent by the sound module 150 of the mobile device 100 or the mobile device 100. shock.

In one embodiment, the image of the dangerous object in the object database is classified as a high risk object image and a low risk object image. For example, if a user of the mobile device 100 hits a car or a locomotive, the hospital may be seriously injured, and thus the car and the locomotive are classified as high-risk objects. If the aforementioned user hits a railing, a step or a pedestrian, it falls at most, so the three are classified as low-risk objects. When at least one of the aforementioned environmental object images substantially corresponds to a high risk In the case of the object image, the image comparison unit 133 directly displays the environmental image 300 as a warning message on the display module 140 of the mobile device 100. In this way, the user can immediately know that there are high-risk objects in front, such as a car. The classification of the aforementioned high-risk objects and low-risk objects is only an example. In fact, how to classify each object in the object database can be selected by the designer according to the spirit of the present invention.

In another embodiment, please return to FIG. 2, since the path forwarded by the user generally corresponds to the central block 301 in the environmental image 300, and does not correspond to the edge blocks 303 and 305 on both sides. . Therefore, the image analysis unit 131 only needs to analyze the central block 301 to obtain an image of the environmental object. Moreover, due to the depth of field and spatial characteristics of the captured environmental image 300, the central block 301 can be standardized as a trapezoid as shown in FIG.

In another embodiment of the present invention, since the mobile device 100 is not used by the user at all times, the foregoing method of issuing the alert message does not need to be operated at all times. Returning to FIG. 1B, the mobile device 100 can further include an accelerometer 160 and a control module 170. The control module 170 is electrically connected to the accelerometer 160 and the image capturing module 110.

The accelerometer 160 is used to detect the acceleration value received by the mobile device 100. The control module 170 is configured to determine whether the mobile device 100 moves according to the acceleration value, and when determining that the mobile device 100 moves, the control module 170 generates a control signal to enable the image capturing module 110 to capture the first direction 200. Environmental imagery. For example, please refer to FIG. 3A to FIG. 3C, which are respectively schematic diagrams of accelerations of a mobile device according to an embodiment of the present invention. First, define parallel to the action The direction of the display module 140 disposed at 100 is the first axial direction D1, and the direction orthogonal to the display module 140 is defined as the second axial direction D2. And the accelerometer 160 is at least a two-axis accelerometer to detect the acceleration in the first axial direction D1 and the acceleration in the second axial direction D2, respectively.

As shown in FIG. 3A, when the mobile device 100 is erected, that is, when the second axial direction D2 is parallel to the horizontal plane, the user does not normally use the mobile device 100 and walks at the same time, and the mobile device 100 at this time. The gravitational acceleration received is parallel to the first axial direction D1, that is to say there is no component of the gravitational acceleration in the second axial direction D2. Or as shown in FIG. 3B, when the mobile device 100 is laid flat, that is, when the first axial direction D1 is parallel to the horizontal plane, the user does not normally use the mobile device 100 and walks at the same time. The gravitational acceleration experienced by the mobile device 100 is parallel to the second axial direction D2, that is, the component having no gravitational acceleration in the first axial direction D1. On the other hand, the mobile device 100 in FIG. 3C is inclined, and the first axial direction D1 and the second axial direction D2 are not parallel to the horizontal plane. This is a state in which the user normally walks while using the mobile device 100. At this time, the gravity acceleration received by the mobile device 100 is not parallel to any axial direction, and therefore there are gravitational acceleration components in both axial directions.

That is, if the control module 170 determines that one of the two acceleration values detected by the accelerometer 160 is substantially zero, it is determined that the mobile device 100 is not used by the user while walking, and thus does not need to be generated. The control signal is used to cause the image capturing module 110 to capture an environmental image in a first direction. Conversely, if both acceleration values are not zero, even two acceleration values are periodically If the change is made, the control module 170 can determine that the mobile device 100 is used by the user while walking. Therefore, it is necessary to generate a control signal for the image capturing module 110 to capture the environmental image in the first direction. In this way, when the user is a low-headed family, the mobile device 100 can operate by the method disclosed in the foregoing, and can promptly remind the user when it is determined that there is a dangerous object in front.

According to another embodiment of the present invention, reference is made to FIGS. 3C and 4, wherein FIG. 4 is a schematic diagram of the use of the mobile device according to an embodiment of the present invention. In the embodiment, the image capturing module 110 is rotatably disposed on the mobile device 100, and its rotation axis is orthogonal to the first axial direction D1 and the second axial direction D2. First, in general, the image capturing module 110 captures an environmental image toward the first direction 200, and the first direction 200 is parallel to the second axial direction D2 as shown in FIG. 3C. However, this is equivalent to capturing images from the ground, and it may not be known whether there is a dangerous object in the direction of travel of the user. Therefore, the control module 170 can calculate the tilt state of the mobile device 100 according to the two acceleration values, thereby controlling the image capturing device 110 to rotate around its rotation axis until the first direction 200 is substantially parallel to the horizontal plane, such as Figure 4 shows. In this way, the captured environmental image can be captured in the direction in which the user is heading.

In summary, the dangerous warning method applied by the mobile device disclosed in the present invention can be summarized into FIG. 5, which is a flowchart of a dangerous warning method applied to the mobile device according to an embodiment of the present invention. The method includes the following steps: detecting the acceleration value with an accelerometer as described in step S100. As described in step S300, it is determined whether the mobile device is used during the movement based on the acceleration value. If judge action If the device is not used in the movement, step S300 is repeated. On the other hand, if it is determined that the mobile device is used in the mobile, as described in step S500, a control signal is generated, so that the image capturing module captures the environmental image in the first direction. Then, as described in step S700, it is determined whether the environmental image contains an image of a dangerous object. And when it is determined that the environmental image contains the image of the dangerous object, a warning message is generated as described in step S900.

For a detailed flow of step S700, refer to FIG. 6, which is a flowchart of step S700 according to an embodiment of the present invention. Step S700 includes the following steps: analyzing the environment image to obtain a plurality of environmental object images included in the environment image, as described in step S710. Then, as described in step S730, for each environmental object image, it is determined whether it substantially corresponds to one of the dangerous object images. When at least one of the foregoing environmental object images substantially corresponds to at least one of the dangerous object images, then as described in step S750, determining that the environmental image contains an image of the dangerous object. When all the environmental object images do not substantially correspond to the dangerous object image, then as described in step S770, it is determined that the environmental image does not contain the dangerous object.

In summary, according to the mobile device disclosed in the present invention and the dangerous warning method applied thereto, when it is determined that the mobile device may be being used by the user in the non-sleep state, the mobile device or the user may be automatically captured. Environmental image, and determine whether a specific block in the environmental image contains images of dangerous objects, so as to selectively send a warning message to remind the user. In this way, the low-headed family can avoid the danger of not paying attention to the road ahead, because the mobile device will automatically help the low-headed people pay attention to the road conditions.

Although the present invention is disclosed above in the foregoing embodiments, it is not To limit the invention. It is within the scope of the invention to be modified and modified without departing from the spirit and scope of the invention. Please refer to the attached patent application for the scope of protection defined by the present invention.

Claims (10)

A dangerous warning method is applicable to a mobile device having an image capturing module, the method comprising: when receiving a control signal, capturing, by the image capturing module, an environmental image in a first direction; Whether the environmental image contains a dangerous object, the dangerous object is defined in an object database; and when the environmental image contains the dangerous object, a warning message is generated. The method of claim 1, wherein the storing of the plurality of dangerous object images in the object database, and determining whether the environmental image includes the dangerous object comprises: analyzing the environmental image to obtain the environmental image included in the environment image a plurality of environmental object images in the environment; determining, for each of the environmental object images, whether the environmental object image substantially corresponds to one of the dangerous object images; and at least one of the environmental object images substantially corresponds to the image When at least one of the dangerous object images determines that the environmental image includes the dangerous object; and when the environmental object images do not substantially correspond to the dangerous object images, determining that the environmental image does not include the dangerous object. The method of claim 2, wherein the dangerous object images are classified into at least one high-risk object image and at least one low-risk object image, and when When at least one of the environmental object images substantially corresponds to the at least one high-risk object image, the environmental image is used as the warning message. The method of claim 1, further comprising: detecting at least one acceleration value by an accelerometer; determining whether the mobile device moves according to the at least one acceleration value; and generating the control signal when determining that the mobile device moves . The method of claim 4, further comprising adjusting the first direction according to the at least one acceleration value. A mobile device includes: an image capturing module for capturing an environmental image in a first direction when receiving a control signal; a storage module for storing an object database; and determining The module is electrically connected to the image capturing module and the storage module for determining whether the environmental image includes a dangerous object, the dangerous object is defined in the object database, and when determining that the environmental image includes the danger A warning message is generated when the object is in use. The mobile device of claim 6, wherein the object database stores a plurality of dangerous object images, and the determining module comprises: an image analyzing unit electrically connected to the image capturing module for analyzing The environmental image to obtain a plurality of environmental object images included in the environmental image; An image comparison unit is electrically connected to the image analysis unit and the storage module for determining, for each of the environmental object images, whether the environmental object image substantially corresponds to one of the dangerous object images, wherein When at least one of the environmental object images substantially corresponds to at least one of the dangerous object images, determining that the environmental image includes the dangerous object, and when the environmental object images do not substantially correspond to the dangerous object images When it is determined, the environmental image does not contain the dangerous object. The mobile device of claim 6, further comprising a display module, wherein the dangerous object images are classified into at least one high-risk object image and at least one low-risk object image, and at least one of the environmental object images When substantially corresponding to the at least one high-risk object image, the environmental image is presented as the warning message to the display module. The mobile device of claim 6, further comprising: an accelerometer for detecting at least one acceleration value; and a control module electrically connected to the accelerometer and the image capturing module for The at least one acceleration value determines whether the mobile device moves, and when it is determined that the mobile device moves, the control module generates the control signal. The mobile device as claimed in claim 9, wherein the image capturing module is rotatably disposed on the mobile device, and the control module further rotates the image capturing module according to the at least one acceleration value to adjust the One direction.