TW201415080A - Monitoring system and monitoring method - Google Patents

Abstract

A monitoring system includes a portable device, a plurality of camera units, and a control unit. The portable device includes a display unit with a transparent display allowing a user to view a scene through the transparent display. The camera units produce scene images of the scene. The control unit determines objective(s) according to the scene images, and transmits objective data corresponding to the objective(s) to the display unit. The transparent display of the display unit displays objective information indicating virtual image(s) of the objective(s) seen through the transparent display according to the objective data. A monitoring method is also provided.

Description

Monitoring system and method

The present invention relates to a monitoring system and method, and more particularly to a monitoring system and method for displaying traffic obstacle information through a transparent display screen of a portable device.

The occurrence of traffic accidents is often due to the inattention of the driver of the vehicle. In particular, emergency ambulance vehicles, such as fire engines, ambulances or police cars, are prone to traffic accidents when such emergency ambulances are driven at high speeds to emergency ambulances. Although the sirens sound an alarm, pedestrians or other vehicle drivers close to the emergency ambulance may not be able to avoid in time. In addition, traffic accidents can easily occur at night due to poor visibility.

In view of this, it is necessary to provide a monitoring system and method to reduce the occurrence of vehicle traffic accidents.

A monitoring system comprising:

A portable device, including:

a display unit includes a transparent display screen for the user to see the scene through the transparent display screen;

a plurality of camera units generating a plurality of scene images corresponding to the scene; and

a control unit that determines a plurality of targets based on the scene images and transmits the plurality of target data of the objects to the display unit, the transparent display screens the plurality of objects in the scene according to the plurality of target objects The target information of the virtual image is displayed.

A monitoring method includes:

Produce a plurality of scene images corresponding to the scene;

Judging a plurality of objects according to a plurality of scene images;

Generating a plurality of target data corresponding to the target; and

Transmitting the target data to the portable device of the display unit having a transparent display screen to enable the user to view the scene through the transparent display screen, the transparent display screen virtualizing the plurality of objects according to the target material data The target information of the image is displayed.

The monitoring system can display the target object, such as traffic obstacle information, through the transparent display screen provided on the portable device, thereby automatically notifying the user of the target object, thereby reducing the occurrence of traffic accidents.

1000, 4000. . . Portable device

2000. . . user

3000. . . Target

120, 220. . . Camera unit

130, 230. . . Storage unit

140, 240. . . control unit

110, 210. . . Display unit

111, 211. . . Transparent display

1100. . . Front section

4100. . . Glass department

1111. . . Virtual image

1112. . . Target information

260. . . Second wireless communication unit

6000. . . Short-range wireless network

250. . . First wireless communication unit

270. . . Motion recognition unit

5000. . . vehicle

1 is a block diagram of a preferred embodiment of a monitoring system of the present invention.

2 is a schematic view of the image of the object of FIG. 1 on a transparent display screen.

FIG. 3 is a schematic diagram showing the information of the target object in the transparent display screen of FIG. 1.

4 is a block diagram of another embodiment of a monitoring system of the present invention.

FIG. 5 is a flow chart of a monitoring method when the monitoring system of FIG. 1 performs monitoring.

Please refer to FIG. 1 for a block diagram of the monitoring system of the present invention. The monitoring system is applied to a portable device 1000. In the present embodiment, the portable device 1000 is a helmet. In other embodiments, the portable device 1000 may be other types of portable devices, such as glasses. The monitoring system includes a display unit 110, a camera unit 120, a storage unit 130, and a control unit 140. The display unit 110, the camera unit 120, the storage unit 130, and the control unit 140 are disposed on the portable device 1000.

The display unit 110 includes a transparent display screen 111. The transparent display screen 111 is a transparent portion on the display unit 110, such as a display panel, so that the user 2000 (shown in FIG. 2) with the portable device 1000 can display information such as a picture through the transparent portion. Or the characters see the scene. In the embodiment, the transparent display screen 111 is a transparent active matrix organic light emitting diode display screen disposed on the front portion 1100 (ie, the goggles) of the portable device 1000. The transparent display curtain 111 is of a rigid structure and can be fixed to the frame of the front portion 1100. In other embodiments, the transparent display screen 111 can also be a flexible structure, so that the transparent display screen 111 can be adhered to the glass or plastic of the front portion 1100. In addition, the transparent display screen 111 may also be other types of transparent or translucent display screens, such as transparent liquid crystal display screens. Moreover, the display unit 110 can also be a display device having the transparent display screen 111, such as a telescope or a projector.

The camera unit 120 generates a scene image Gs (not shown) of the scene seen through the transparent display screen 111 of the portable device 1000. In the present embodiment, the camera unit 120 includes a plurality of cameras for capturing a scene image Gs to form a photo or video. The camera unit 120 has a nighttime visual function capable of generating a scene image Gs at night and during the day. In other embodiments, the camera unit 120 may include a plurality of cameras that generate a scene image Gs from different directions to avoid dead ends or blind spots.

The storage unit 130 is a device for accessing digital information, such as a random access memory, a non-volatile memory, or a hard disk. The storage unit 130 stores sample target material Ds (not shown) including a sample target image and a target state. Among them, the "target" is important to the driver and is used to describe an object or a sport or a state on a road. The "target data Do" (not shown) is used to describe or warn each object, and the "sample target data Ds" is a common name of a pre-stored data aggregate. After this, the definitions may be specifically extended. In the present embodiment, the sample target image is a possible traffic obstacle such as a vehicle, a person, an animal, a large object, a suspicious object, or an image of a hole in a road. The target state is a state of a traffic obstacle that may affect the portable device 1000. One possible traffic hazard may correspond to one or more target states, for example, a possible traffic hazard that occurs in the center of the road that the user 2000 is about to reach, or a possible traffic hoop that is quickly approaching the user 2000 at a high speed. In other embodiments, the sample target image may be an image of other types of objects, such as special or objects that the user 2000 likes.

The control unit 140 receives the scene image Gs and judges the object 3000 (shown in FIG. 2) based on the received scene image Gs, for example, by comparing the sample object data Ds to analyze the scene image Gs. In the present embodiment, the target 3000 is a traffic obstacle. The control unit 140 compares the scene image Gs with the sample target image in the sample target data Ds to identify the possible traffic obstacle, and the state of the possible traffic obstacle and the sample target data Ds The target state is compared. Thereafter, the control unit 140 transmits the target material data Do of the target 3000 to the display unit 110. For example, when the user 2000 is near a possible traffic obstacle in the center of the road, the control unit 140 transmits the target material data Do of the possible traffic obstacle to the display unit 110. In other embodiments, the target 3000 may be other types of objects. The camera unit 120 tracks the target 3000 as the target 3000 moves, and the control unit 140 generates a target material Do corresponding to the movement of the target 3000.

In the present embodiment, the target material Do includes a target information data Di (not shown) and a target position data Dp (not shown). The control unit 140 generates the target information data Di, which includes information of the target 3000, such as obtaining the information of the target 3000 according to the sample target image and the target state in the sample target data Ds, such as a name. , type or description of the target 3000. For example, when the control unit 140 determines that the target object 3000 is a possible traffic obstacle in the middle of the road according to the sample target image and the target state, the target information material Di may include a description about the possible traffic obstacle. The information of the target 3000 may be pre-stored in the storage unit 130 or received from a server connected to the monitoring system via a long-distance wireless network and stored in the storage unit 130.

2 is a schematic diagram of the virtual image 1111 of the target 3000 on the transparent display screen 111 of FIG. The control unit 140 generates a target position data Dp corresponding to the position of the virtual image 1111 of the object 3000 on the transparent display screen 111. The virtual image 1111 is a virtual image seen from a specific position P (not shown) of the portable device 1000 through the transparent display screen 111. In the present embodiment, the specific position P is set in advance, for example, the position at which the user 2000 eyes are focused. The control unit 140 determines the position of the virtual image 1111 on the transparent display screen 111 according to the position of the image of the target object 3000 in the scene image Gs and the specific position P, and generates a virtual image adjacent to the transparent display screen 111. Target position data Dp at the position of image 1111. In the present embodiment, the special position P is manually set.

The display unit 110 receives the target material Do from the control unit 140. The target information 1112 (shown in FIG. 3) is based on the target information data Di of the target 3000 included in the target material Do and the position of the virtual image 1111 according to the position of the transparent display screen 111 included in the target material Do. The target position data Dp is displayed on the transparent display screen 111 to display the description of the virtual image 1111 and the virtual image 1111. FIG. 3 is a schematic diagram showing the target information 1112 through the transparent display screen 111 in FIG. The target information 1112 is displayed on the transparent display screen 111 at a position adjacent to the virtual image 1111 on the transparent display screen 111, thereby reminding the user 2000 of the target object by the description of the virtual image 1111. 3000. The target information 1112 may include, for example, a target or an indicator pointing to the virtual image 1111 or a character representing information about the target 3000. The control unit 140 generates a target material Do corresponding to the movement of the target object 3000, and the target object information 1112 changes the position on the transparent display screen 111 according to the movement of the target object 3000.

In addition to the camera unit 120, other types of sensors can be used to generate the sample target data Ds. Thus, the control unit 140 can recognize the target based on the data obtained by the other sensors and the scene image Gs generated by the camera unit 120. 3000. For example, a microphone is used to generate sound material, such that the control unit 140 can describe the object 3000 through the sound and the scene image Gs. In addition, in addition to displaying the target information 1112 using the display unit 110, other types of devices can also be used to display target information. For example, a target speaker Do is received from the control unit 140 using a speaker, and an audible alert is generated based on the target material Do to remind the user 3000 of the target 3000 appearing.

4 is a block diagram of another preferred embodiment of the monitoring system of the present invention. The monitoring system includes a display unit 210, a camera unit 220, a storage unit 230, a control unit 240, a first wireless communication unit 250, a second wireless communication unit 260, and a motion recognition unit 270. In this embodiment, the display unit 210, the first wireless communication unit 250, and the motion recognition unit 270 are disposed on a portable device 4000. The portable device 4000 may be a pair of glasses. The camera unit 220, the storage unit 230, the control unit 240, and the second wireless communication unit 260 are disposed on a vehicle 5000, such as a car, a boat, or an airplane. In other embodiments, the portable device 400 may be other types of portable devices, such as a helmet, and the storage unit 230 and/or the control unit 240 may be disposed on the portable device 4000.

In the embodiment, the display unit 210 includes a transparent display screen 211. The transparent display screen 211 is a transparent active matrix organic light emitting diode display screen disposed on the glass portion 4100 of the portable device 4000. The camera unit 220 generates a scene image Gs of a scene seen through the transparent display screen 211 of the portable device 4000. The storage unit 230 stores sample target material data Ds including a sample target image and a target state. The control unit 240 receives the scene image Gs and judges the object 3000 based on the received scene image Gs, for example, by comparing the sample object data Ds to analyze the scene image Gs. The first wireless communication unit 250 communicates with the second wireless communication unit of the vehicle 5000 via a short-range wireless network 6000, such as a Bluetooth communication protocol or other short-range communication protocol.

The motion recognition unit 270 is disposed on the portable device 4000 for determining motion of the portable device 4000, such as up, down, left, or right. The motion recognition unit 270 determines the motion of the portable device 4000 according to the direction and angle change of the portable device 4000. In this embodiment, the motion recognition unit 270 includes a direction recognition unit that determines the angle of the portable device 4000, wherein the direction recognition unit may include an electronic compass, and the angle recognition unit may include a gravity sensor. The camera unit 220 moves according to the movement of the portable device 4000 to generate a scene image Gs corresponding to the viewing angle of the user 2000 through the transparent display screen 211 of the portable device 4000.

A relative position compensation unit obtains a difference between the relative position of the portable device 4000 and the target 3000 and the relative position of the camera unit 220 to the target 3000 (e.g., relative distance or relative direction). The control unit 240 controls the camera unit 220 to enlarge or reposition according to the difference or consider the difference when the virtual image 1111 on the transparent display screen 211 is determined to compensate the difference, thereby eliminating the The error caused by the difference between the display and the actual position. The location of the portable device 4000 can be manually set or automatically detected, for example using a detection device. In the present embodiment, the control unit 240 can compensate the difference between the relative position of the user 2000 and the target 3000 obtained by the relative position compensation unit and the relative position between the camera unit 220 and the target 3000. value.

FIG. 5 is a flow chart of a monitoring method when the monitoring system of FIG. 1 performs monitoring. The monitoring method is as follows. In other embodiments, this step may increase, decrease, and change the order.

Step S1110: Generate a scene image Gs corresponding to the scene. The target 3000 is tracked as the target 3000 moves. When the object 3000 moves, a scene image Gs corresponding to the moving object 3000 is generated. In the present embodiment, the scene image Gs is generated using a camera having a nighttime visual function. In addition to this, the camera unit 120 disposed on the portable device 1000 performs step S1110. In another embodiment, the camera unit 220 disposed on the vehicle 5000 performs step S1110. The scene image Gs corresponding to the scene is generated according to the movement of the portable device 4000, wherein the movement of the portable device 4000 is determined according to the change of the direction and angle of the portable device 4000. Accordingly, the scene image Gs of the corresponding scene is generated according to the movement of the portable device 4000.

Step S1120: The target object 3000 is judged based on the scene image Gs. The scene image Gs is analyzed based on the scene image Gs and the sample object data Ds including the sample object image and the state of the object to determine the object 3000. In the present embodiment, the target image 3000 is compared with the target object image to determine the target object 3000 and the possible traffic obstacles are identified by comparing the state of the possible traffic obstacle with the target state.

Step S1130: Generate target material Do corresponding to the target object 3000. When the target object 3000 moves, the target material data Do corresponding to the movement of the target object 3000 is generated. In the present embodiment, the target material data Do includes the target information material Di and the target location data Dp. The target information material Di includes information of the target 3000. The target position data Dp corresponds to the virtual image 1111 on the transparent display screen 111 seen through the transparent display screen 111, wherein the virtual image 1111 can be seen from a specific position P.

Step S1140: The target data Do is transmitted to the portable device 1000 having the display unit 110. The display unit 110 includes a transparent display screen 111 that enables the user 2000 to view the scene, so that the transparent display screen 111 displays the target information 1112 according to the target material Do, wherein the target information 1112 passes through the annotation, A label, pointer indication, etc., indicates a virtual image 1111 of the object 3000 on the transparent display screen 111. In the present embodiment, when the position of the target information 1112 displayed on the transparent display 111 corresponds to the target position data Dp of the virtual image 1111 in the target material Do, the transparent display 111 is based on the target. The target information information Di in the material data Do displays the target information 1112.

The monitoring system can automatically display the target object by displaying the target object, such as traffic obstacle information, through a transparent display screen disposed on the portable device. The use of a camera with night vision enables the production of target images during the day and at night.

In summary, the present invention complies with the requirements of the invention patent and submits a patent application according to law. The above description is only the preferred embodiment of the present invention, and equivalent modifications or variations made by those skilled in the art will be included in the following claims.

1000. . . Portable device

120. . . Camera unit

130. . . Storage unit

140. . . control unit

110. . . Display unit

111. . . Transparent display

1100. . . Front section

Claims (19)

A monitoring system comprising:
A portable device includes:
a display unit includes a transparent display screen for the user to see the scene through the transparent display screen;
a plurality of camera units to generate a plurality of scene images corresponding to the scene; and a control unit, the control unit determining the object according to the scene images and transmitting the plurality of object data of the object to the display unit, the transparent display screen is The plurality of target data displays the target information of the virtual image of the plurality of objects in the scene. The monitoring system of claim 1, wherein each target is a traffic obstacle. The monitoring system of claim 1, wherein the portable device comprises a helmet or a pair of glasses. The monitoring system of claim 1, wherein the camera units are disposed on the portable device. The monitoring system of claim 1, further comprising a motion recognition unit, the motion recognition unit being disposed on the portable device for determining motion of the portable device, wherein the camera unit is configured On a vehicle, the camera units move in accordance with the movement of the portable device. The monitoring system of claim 5, wherein the motion recognition unit comprises a direction identifying unit and an angle identifying unit, the direction identifying unit determining a direction of the portable device, the angle identifying unit determining the portability The angle of the device, the motion recognition unit determines the motion of the portable device according to the direction and angle change of the portable device. The monitoring system of claim 5, wherein the control unit is disposed on the vehicle, the portable device includes a wireless communication unit, and the portable device communicates with the vehicle through the wireless communication unit. The monitoring system of claim 1, wherein the transparent display screen comprises at least one transparent active matrix organic light emitting diode display screen and a transparent liquid crystal display screen. The monitoring system of claim 1, further comprising a storage unit for storing a plurality of sample target materials, wherein the control unit analyzes the scene images according to the sample target data to determine the objects. The monitoring system of claim 9, wherein the sample target data includes a plurality of target states, and the control unit compares the state of the plurality of objects identified in the scene image with the state of the objects. To analyze these scene images. The monitoring system of claim 1, wherein the camera units have a nighttime visual function. The monitoring system of claim 1, wherein when the objects move, the camera units track the objects, and the control unit generates a plurality of target data corresponding to the movement of the target. A monitoring method includes:
Produce a plurality of scene images corresponding to the scene;
Judging a plurality of objects according to a plurality of scene images;
Generating a plurality of target data corresponding to the target object; and transmitting the target material to the portable device having the display unit of the transparent display screen to enable the user to see the scene through the transparent display screen, the transparent display screen The target information of the virtual image of the plurality of objects is displayed based on the target data. The monitoring method described in claim 13 of the patent scope further includes:
Determining the movement of the portable device;
The steps for generating a plurality of scene images include:
According to the movement of the portable device, a plurality of scene images corresponding to the scene are generated. The monitoring method of claim 14, wherein the step of determining the movement of the portable device comprises:
Determining the direction of the portable device; and determining the angle of the portable device;
The steps to generate a plurality of scene images include:
Determining the motion of the portable device according to the direction and angle change of the portable device; and generating a plurality of scene images corresponding to the scene according to the motion of the portable device. The monitoring method of claim 13, wherein the step of determining the objects comprises analyzing the scene images based on the sample target data to determine the plurality of objects. The monitoring method according to claim 16, wherein the sample target material includes a plurality of target states, and the step of analyzing the plurality of scene images comprises comparing the target state identified in the scene image with the target states. To judge these targets. The monitoring method of claim 13, wherein the step of generating the scene images comprises using a plurality of cameras to generate a plurality of scene images corresponding to the scene; a portion of the cameras having a nighttime visual function. The monitoring method described in claim 13 further includes the step of: generating a plurality of target data corresponding to the movement of the target when the objects move.