JP2021018536A - Information notification device - Google Patents

Abstract

To provide an information notification device making it possible to visually check video information, which is produced by converting sound information, without use of a display unit of an electronic apparatus or the like.SOLUTION: An information notification device 10 includes: a sound input unit 11 that collects sound information; an information processing unit 12 that produces video information by converting the sound information inputted by the sound input unit 11; and a video projection unit 13 that projects and displays the video information, which is produced by the information processing unit 12, on a display surface 20 in a living room. The information processing unit 12 discriminates the type of inputted sound information. When the identified type is a predetermined type, the information processing unit activates the video projection unit 13 and allows the video projection unit to display the video information, which is produced based on the sound information, on the display surface 20.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information notification device that notifies information about various events by video information.

Conventionally, the sound information input by the sound input unit is transmitted as a wireless signal to an electronic device such as a mobile phone, the device converts the sound information into video information, and the video information is transmitted to the display unit of the electronic device. An information notification system to be displayed on a screen has been proposed (see, for example, Patent Document 1).

According to this information notification system, it is possible to know on a mobile phone an emergency situation such as an intrusion of a suspicious person or a fire that occurred at home while going out. In addition, by applying this system to the living room, people with hearing impairments and people with hearing impairments (hereinafter referred to as hearing-impaired people, etc.) can visually capture information on various events that accompany sound. be able to.

Japanese Unexamined Patent Publication No. 2004-207876

However, since the above information notification system is configured to display video information on the display unit of an electronic device, the resident always carries it even in the living room in order to detect the reception of the information with a vibration or a lamp. You must carry electronic devices such as telephones. Further, even if the resident carries a mobile phone or the like, there is a possibility that the reception may not be noticed, and since the display unit of the electronic device is small, the contents may not be confirmed instantly.

The present invention has been proposed in consideration of such circumstances, and an object of the present invention is to visually convert video information converted and generated based on sound information without using a display unit such as an electronic device. The purpose is to provide an information notification device that can be confirmed.

In order to achieve the above object, the information notification device of the present invention is an information notification device that notifies information about various events by video information, and is input by a sound input unit that collects sound information and the sound input unit. The information processing unit includes an information processing unit that converts and generates the sound information into the video information, and a video projection unit that projects and displays the video information generated by the information processing unit on a display surface in a living room. The unit is characterized in that the type of the input sound information is determined, and when the type is a predetermined type, the image projection unit is activated to display the image information generated based on the sound information on the display surface. And.

Since the information notification device of the present invention has the above-described configuration, the video information converted and generated based on the sound information can be visually confirmed without using a display unit such as an electronic device. ..

It is a block diagram of the information notification device which concerns on one Embodiment of this invention. It is a schematic perspective view which shows the mode of the projection display by the information notification device in a living room. It is a figure which shows the processing flow of an information broadcasting apparatus. (A) and (b) are diagrams showing two examples of image display (projected image) on a display surface by an information processing device.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

The information notification device 10 is a device that notifies information about various events by means of video information (projection image 25). The information notification device 10 converts the sound input unit 11 that collects sound information, the information processing unit 12 that converts and generates the sound information input by the sound input unit 11 into video information, and the video information generated by the information processing unit 12. It is provided with an image projection unit 13 that projects and displays on the display surface 20 in the living room. The information processing unit 12 is configured to determine the type of input sound information, activate the image projection unit 13 at a predetermined type, and display the image information generated based on the sound information on the display surface 20. ing.

Here, the predetermined type is not a type code uniquely determined according to the type of sound, but a frequency, timbre, volume, etc. of the sound obtained by analyzing the sound information by the information processing unit 12. This is for selecting whether or not it is necessary to output as video information. The determination of this type may be made by the sound information input by the sound input unit 11, may be made during the analysis of the information processing unit 12, or may be made by the generated video information.

Therefore, it is not necessary that all the sound information input by the sound input unit 11 is projected on the display surface 20 as video information, and only a limited amount of sound information may be projected and notified by discriminating the type. Of course, it is also possible to project all types, that is, all events that emit sound, as video information.

This information notification device 10 is installed in a living room of a house, a building, etc., converts and generates video information based on the sound information input there, and is a person who is in the living room in a visually easy-to-understand manner (hereinafter, residence). It is a device that conveys information to people. The sound to be input may be an outdoor sound, and the sound input unit 11 for inputting the sound may be arranged indoors or outdoors.

By using this information notification device 10, for example, a resident such as a hearing-impaired person can visually capture an image generated based on indoor and outdoor sounds and detect various events based on the sound. Can be done.

Next, the detailed configuration of the information notification device 10 will be described with reference to FIGS. 1 to 4.

As described above, the information notification device 10 includes a sound input unit 11, an information processing unit 12, and a video projection unit 13, a storage unit 14, an operation unit 15, and an additional information input unit 16 (sensor 16a, reception unit 16b). ) Is provided.

The sound input unit 11 has a built-in microphone, and a plurality of sound input units 11 may be installed at a plurality of locations such as in a living room and outdoors. Further, the image projection unit 13 includes an irradiation unit 13a that irradiates the display surface 20 with an image, and a drive unit 13b that drives the irradiation unit 13a so that the irradiation direction can be changed. The information processing unit 12 is configured to include a CPU and a program.

The storage unit 14 is a storage area for storing various data such as data generated in the device, temporary data, constant data (for example, illustration data that is a part of video information), and is described later, for example. A database and the like are also included in the storage unit 14. The storage unit 14 may be composed of a disk device or the like, and may not be integrally incorporated in the information notification device 10, or may be externally arranged via a communication network 30 or the like. Good.

Further, the present device is provided with an additional information input unit 16 so that additional information other than sound information can be input. As the additional information input unit 16, a sensor 16a and a reception unit 16b are provided. Examples of the sensor 16a include a motion sensor installed at the front door and a security camera. The sensor 16a does not have to be integrally incorporated in the main body of the information notification device 10, and may be installed in a state of being separated from the main body 10a and connected to the main body 10a by wire or wirelessly.

The receiving unit 16b is for acquiring additional information received via the communication network 30, and examples of the source of the additional information include a monitoring system of a home security company and the Japan Meteorological Agency for notifying an Earthquake Early Warning. Further, the sensor information may be input via the communication network 30.

Further, the display surface 20 is a projection surface projected in the living room, and examples thereof include a wall surface 21, a floor surface 22, and a ceiling surface 23 (see FIG. 2), and it is desirable that at least one of them is used. A screen may be installed on the wall surface 21 or the like as the display surface 20 (projection surface), or the front surface of the chest of drawers may be the display surface 20. The display surface 20 (projection surface) is preferably a flat surface, but may have some irregularities, and is projected so as to straddle the two projection surfaces 20 (for example, the wall surface 21 and the ceiling surface 23). You may.

Further, the information notification device 10 includes an operation unit 15 including a stop button for stopping the projection of video information on the display surface 20.

As shown in FIG. 2, the device main body 10a of the information notification device 10 may be placed at an appropriate place in the living room space so that the image projection unit 13 can project the image information onto the display surface 20. The image projection unit 13 may have a plurality of irradiation units 13a, and may be configured to project a plurality of image information onto a plurality of display surfaces 20. Further, a plurality of irradiation units 13a may be arranged so as to correspond to a plurality of rooms.

Further, the image projection unit 13 of the present embodiment is configured such that the direction of the irradiation unit 13a can be changed by the drive unit 12b, and the image information can be sequentially and periodically displayed on each of the projection surfaces 20. .. For example, the video information may be periodically displayed in the order of the wall surface 21, the wall surface 21 next to the wall surface 21, the floor surface 22, and the ceiling surface 23. Further, the irradiation unit 13a may be arranged in each room, and the irradiation unit 13a may be sequentially displayed periodically over a plurality of rooms.

Next, a processing flow of the information notification device 10 and an example of displaying an image on the display surface 20 will be described. FIG. 3 is a diagram showing a processing flow of the information notification device 10.

As shown in FIG. 3, in the information notification device 10, the sound input unit 11 first inputs sound information which is input information. Next, the information processing unit 12 analyzes the sound information data output from the sound input unit 11 and converts and generates it into video information (data). Then, the image projection unit 13 projects the image information as output information on the display surface 20.

More specifically, the information processing unit 12 analyzes the sound information data obtained via the sound input unit 11 by using the information processing device 12a having acoustic analysis software or the like. Acoustic analysis software analyzes frequency, timbre, utterance information of words spoken by humans, determines the time and volume of the utterance, and analyzes sound pressure level.

From the analysis data obtained in this way, it is determined whether or not the original sound should be transmitted to a person in the living room. Discrimination data such as frequency database 14a and required language database 14b are registered in the storage unit 14 so that a predetermined type can be discriminated, and whether or not the analysis data is of a predetermined type is matched by the discriminant data. It may be determined by processing. The types of urgency in this embodiment include not only those that are dangerous and those that are directly linked to a disaster, but also those that should be urgently notified to hearing-impaired people and the like.

Specifically, as urgency types, siren sounds and fires from patrol cars and ambulances, announcements of heavy rain, earthquakes, floods, landslides, crimes, etc., home appliance usage sounds in the living room, door opening and closing sounds, fire alarms, etc. Equipment sounds such as the ringing sound of gas alarms can be mentioned. Further, as the type of urgency, a sound generated in a dangerous state such as when a glass cup is broken, and a conversation voice can be mentioned. In addition, the sound of rain, the sound of wind, the sound of earthquake ground noise, etc. may be targeted.

The information processing unit 12 may collect, edit, convert and generate only the data to be transmitted to the person in the living room, which has been sifted in this way. For video editing, the information notification device 10 may include a term database (not shown) and an illustration database (not shown) in the storage unit 14 and the like. Then, the image projection unit 13 is configured to project the generated image information data as image information on the display surface 20.

Specific examples of the video information include the projected image 25 illustrated in FIGS. 4A and 4B.

In the projection image 25 shown in FIG. 4A, the ringing sound of the fire alarm is used as sound information input by the sound input unit 11. The image of the projection image 25 output by the image projection unit 13 is composed of a combination of a fire illustration 25a, a short word 25b for informing the fire, and an onomatopoeia 25c "jiri-ri-ri-ri" 25c for ringing sounds.

Further, in the projection image 25 of FIG. 4B, the sound of the broken cup is used as the sound information input by the sound input unit 11. The image of the projected image 25 output by the image projection unit 13 is composed of a combination of an illustration 25a of a broken cup, a short word 25b notifying that the cup is broken, and an onomatopoeia 25c "Gachan" when the cup is broken.

Further, in the case of FIG. 4B, when the receiving unit 16b receives the Earthquake Early Warning through the communication network 30 at the input timing of the sound information (almost at the same time), the image projection unit 13 displays the projection image. The vacant area 25d in 25 may be displayed by including the additional information as supplementary information. Further, the image projection unit 13 may alternately display an image notifying the sound of the broken cup and an image notifying the earthquake. When the information processing unit 12 does not detect the sound information data to be transmitted to the person in the living room and the image projection unit 13 does not project the image information, the earthquake early warning, the information from the security camera, etc. Even when the additional information is input, the image projection unit 13 may be activated and the corresponding image information may be displayed.

As described above, according to the information notification device 10, images due to various events such as events requiring emergency notification are visually displayed and notified on the display surface 20 such as the wall surface 21 by projection. Therefore, the person in the living room can immediately and visually know the emergency event. In particular, since it can be displayed as a larger image than the display screen of a mobile phone or the like, it can be confirmed instantly.

If the configuration is such that the periodic display is sequentially performed on the plurality of projection surfaces 20 as in the present embodiment, the resident can discriminate the image from any position in the living room. If the irradiation unit 13a is arranged in each room, the image can be recognized regardless of which room the resident is in.

Further, since the video information is displayed large on the wall surface 21 or the like, oversight is unlikely to occur. In particular, if the illustration 25a, the short word 25b, and the onomatopoeia 25c are combined, even a child or an elderly person can understand the content in an instant. As for the character size of the short word 25b and the onomatopoeia 25c, for example, in an A4 size manuscript, the character size may be about 88 to 100 pt (points). Video information may be projected onto the display surface 20 based on such a manuscript. Of course, it is not limited to the above font size.

Furthermore, since the information is visually notified, it is effective for the hearing impaired and the like. Further, since the video information is projected on the display surface 20 such as the wall surface 21, it is not necessary to install a display device (electronic device) as a display unit. Therefore, it is not necessary to secure a space for installing the display unit, and the cost can be reduced. If the wall surface 21 or the like is a flat and easy-to-see surface, a screen for projection is unnecessary.

Further, the projected video information is not limited to the example of FIG. 4, but it is desirable that at least one of the illustration 25a, the sentence (which may be a short word 25b or a long word), and the onomatopoeia 25c is included. In addition, instead of or in addition to the onomatopoeia 25c, an onomatopoeia may be displayed. That is, an onomatopoeia (onomatopoeia) may be displayed.

These displayed information may be different in size or colored depending on the degree of danger or urgency. If the degree of danger or urgency is low, only one of the illustration 25a, the sentence 25b, and the onomatopoeia 25c may be used.

Furthermore, not only the video converted and generated from the sound information, but also the one associated with the event caused by the sound, for example, the suggestion of the action to be taken next when the event occurs is added to the video information. May be good. For example, when a heavy rain is determined, not only the heavy rain is immediately notified by the video display, but also "taking in laundry and closing the window" may be additionally notified.

In this way, if the additional information such as the detection information by the sensor 16a is also displayed as the video information, the resident can easily recognize the event related to the additional information and can make an instant judgment.

In addition, the image of the security camera at the front door or the detection information of the motion sensor may be added to the image information as additional information. For example, when a suspicious person at the front door generates a sound, additional information by the sensor 16a may be added to the video information generated by the sound information to be notified.

The additional information may not be added to the video information based on the sound information, but may be displayed as a video by the additional information alone. For example, it is effective when a suspicious person is wandering at the front door without making a sound. When the display surface 20 is composed of a plurality of projection surfaces, the main video information may be displayed on one side and the additional information may be displayed on the other side.

Since the video information shown above is intended for urgent information in the present embodiment, it is desirable that the information notification device 10 immediately displays the video at the timing of sound generation. However, if the information notification device 10 determines that it is not urgent, the information notification device 10 may display the image with a time delay. For example, when the information processing unit 12 determines a light rain, and then the light rain continues for a predetermined time, the information processing unit 12 may display and notify the fact at a timing delayed from the time of determining the first light rain.

Further, the information processing unit 12 may determine whether to stop the video display on the display surface 20 based on the type or the like. Specifically, the information processing unit 12 may have different timings for stopping projection depending on the degree of urgency. For example, if the urgency and the risk are high, the resident may stop by operating the stop button of the operation unit 15, or the resident may be automatically stopped after 5 minutes, and the urgency and the risk are low. In the case of, for example, it may be automatically stopped after 10 seconds.

Further, the information notification device 10 may have a configuration incorporating AI (artificial intelligence). For example, the type to be displayed on the video may be discriminated by using a knowledge base that proliferates and changes each time an event occurs. In addition, the urgency may be learned by the stop timing by the resident, and the urgency may be excluded from the type of video display or the urgency may be increased.

10 Information notification device 11 Sound input unit 12 Information processing unit 13 Video projection unit 16 Additional information input unit 20 Display surface (projection surface)
21 Wall surface 22 Floor surface 23 Ceiling surface 25a Illustration 25b Short word (sentence)
25c Onomatopoeia 30 Communication network

Claims (6)

It is an information notification device that notifies information about various events by video information.
A sound input unit that collects sound information,
An information processing unit that converts and generates the sound information input by the sound input unit into the video information, and
It is provided with an image projection unit that projects and displays the image information generated by the information processing unit on a display surface in a living room.
The information processing unit determines the type of the input sound information, and when the type is predetermined, activates the video projection unit to display the video information generated based on the sound information on the display surface. An information notification device characterized by this. In claim 1,
As the predetermined type, the information type regarding danger is included.
When the information processing unit determines that the input sound information is information related to the danger, the information processing unit immediately activates the video projection unit to display the generated video information on the display surface. An information notification device characterized by. In claim 1 or 2,
The information notification device is characterized in that the video information includes at least one of a sentence, an onomatopoeia, and an illustration. In any one of claims 1 to 3,
The information notification device is characterized in that the display surface is at least one of a floor surface, a wall surface, and a ceiling surface. In any one of claims 1 to 4,
The display surface is composed of a plurality of projection surfaces.
The image projection unit is an information notification device characterized in that the image information is sequentially and periodically displayed on each of the projection surfaces. In any one of claims 1 to 5,
It is configured to further include an additional information input unit for inputting additional information other than the sound information.
The information processing unit is an information notification device characterized by converting and generating the additional information input by the additional information input unit into the video information.

Images