JP2001344355A - Remote assistance system for person requiring assistance - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide adequate assistance information when required, by grasping the situation with which a person requiring assistance is faced through image. SOLUTION: This system is provided with a portable assistance device 8, which has a camera 3 attached on an eyeglass frame 2 worn by a person in need of assistance 1, photographs the front of the person's head and outputs image signals including the picture, a microphone 4 which the person requiring assistance 1 inputs an assistance request to and outputs an assistance request signal, a loudspeaker 5 which the assistance information signal is inputted to an outputs assistance information to the person requiring assistance 1, and a radio communication device 7 which transmits the image signal from the camera 3 and the assistance request signal from the microphone 4 to an assistance terminal device 6 via a radio communication line, and outputs the assistance information signal received from the assistance terminal device 6 via the radio communication line to the loudspeaker 5, and is provided with the assistance terminal device 6 which is in full-time operation, displays the picture included in the image signal, that is sent from the camera 3, and is received from the radio communication device 7, outputs the assistance request included in the assistance request signal that is sent from the microphone 4 and is received from the radio communication device 7.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention relates to
A person who needs assistance (needs assistance), such as an elderly or inexperienced person with reduced perceived ability, is facing the person in need of assistance from a distant place when assistance is needed The present invention relates to a remote support system for a supporter who provides appropriate support information from a supporter according to a situation.

[0002]

2. Description of the Related Art Conventionally, a supporter, such as a person with a disability, is usually accompanied by a supporter in response to a request. If the person is not attending, the person needing assistance will not be able to receive assistance, while if he / she is always present, the physical and mental burden on the person will be excessive and the person who needs assistance will be financially and mentally ill. There was a problem that the target burden would be excessive.

In addition, when an inexperienced person such as an inexperienced doctor performs an operation requiring a high level of knowledge and skill such as surgery, an experienced person has conventionally provided instructions alongside.
If such an experienced person is not nearby, there is also a problem that unskilled persons cannot receive appropriate instructions.

[0004] The inventors of the present application have studied the above problems. As a result, it is not always necessary for a person who needs assistance to provide assistance for a short period of time in each individual situation. It is relatively easy to provide appropriate support information with only a visual understanding,
Even if a supporter is located far away from a supporter, if the situation can be known on video and the support information can be sent, one supporter should appropriately support multiple supporters. It turns out that you can.

[0005]

SUMMARY OF THE INVENTION An object of the present invention is to provide a support system which advantageously solves the problems of the conventional support method in view of the above points. The remote support system for a person in need of assistance of the present invention is provided on a wearer of the person in need of assistance, and captures a predetermined direction based on the person in need of assistance, and outputs an image signal including an image of the first image capturing means; A support request input unit for inputting a support request from the support requester and outputting a support request signal including the support request, and inputting a support information signal and outputting the support information included therein to the support requester A support information output unit that transmits an image signal from the photographing unit and a support request signal from the support request input unit to a support terminal device via a wireless communication line, and transmits a wireless communication line from the support terminal device to the support terminal device. A first wireless communication unit that outputs a support information signal received via the first wireless communication unit to the support information output unit; And displaying the support request included in the support request signal from the support request input unit received from the first wireless communication unit, and displaying the video and the support. One or a plurality of the support terminal devices for inputting the support information corresponding to the request from the supporter and transmitting the support information signal including the support information to the first wireless communication means via a wireless communication line. It will be equipped.

In such a system, a support request input means, such as a microphone, a switch, or a portable keyboard, of a portable support device carried by a person requiring assistance receives voice or specific signals from the person requiring assistance. The support request is input, a support request signal including the support request is output, and a first photographing means such as a CCD camera provided on a wearing object such as glasses of the support requester is used as a reference for the support requester. For example, when a predetermined direction such as a direction in which the face of the person in need of assistance is turned on is photographed and an image signal including the image is output, the first wireless communication means such as a cellular phone of the portable assistance apparatus is activated. Transmitting the image signal from the first photographing unit and the support request signal from the support request input unit to the support terminal device via a wireless communication line, and transmitting the image signal from the support terminal device via the wireless communication line. The received support information signal is output to the support information output means, and the support information output means such as a speaker, an earphone, and a screen display device inputs the support information signal and outputs the support information included therein to a person in need of support. And output as characters and images.

[0007] On the other hand, in this system, one support terminal device that is always running or a plurality of support terminal devices that are always running in parallel or alternately is provided with a first imaging terminal received from the first wireless communication means. Means for displaying a support request included in the support request signal from the support request input means received from the first wireless communication means, and displaying the support request from the support means. When the supporter confirms the current situation and inputs the support information from the supporter who has confirmed the support request, the support information signal including the support information is transmitted to the portable type that the supporter carries. The data is transmitted to the first wireless communication means of the support device via a wireless communication line.

Therefore, according to the remote support system for persons requiring assistance of the present invention, a person requiring assistance, such as a demented person, an elderly person with reduced perceptual ability, or an inexperienced person, can provide assistance at any time when assistance is required. Since the supporter can provide appropriate support information from the remote location in response to the support request and based on the situation that the support needer identified from the video is facing, the support of people with disabilities etc. Can reduce the physical and mental burden of the supporter and the financial and mental burden of the supporter, and ensure that the When performing an operation that requires skill, even if an experienced person is not accompanied by an experienced person, the unskilled person can receive appropriate instructions. Work Ukoto can. In addition, since the need for support is not always required, but is usually short for each situation, one supporter can appropriately support multiple support needs and one supporter By signing a contract to support a plurality of support users, the system can be easily operated economically.

In the present invention, the first radio communication means intervenes between the first radio communication means and the support terminal apparatus, and operates constantly, and receives the first radio communication means received from the first radio communication means.
And displaying the support request included in the support request signal from the support request input unit received from the first wireless communication unit, and displaying the video and the support. An image signal from the first photographing means received from the first wireless communication means to the support terminal device of the supporter selected by the mediator from the plurality of supporters in response to the request, and the support request input Sending a support request signal from the means, or inputting support information corresponding to the video and the support request from the intermediary, and wirelessly transmitting the support information signal including the support information to the first wireless communication means. One or a plurality of intermediary terminal devices for transmitting via a communication line may be provided.

[0010] In such a system, one intermediary terminal device that is always operating or a plurality of intermediary terminal devices that are always operating in parallel or alternately are required to be able to understand the situation and the support faced by the support person identified from the video. Based on the request, an intermediary selected from among a plurality of supporters, for example, those who are currently available, and especially those who have expertise in the situations facing those in need The first terminal received from the first wireless communication means is sent to the support terminal device of the user.
Sending the image signal from the photographing means and the support request signal from the support request input means, or, for example, in the case of an emergency and when there is no supporter who is currently available, the video and the support request Is input from the mediator itself, and a support information signal including the support information is transmitted to the first wireless communication means via the wireless communication line.

Therefore, according to the remote support system for a person in need of support, it is possible to more quickly provide the person in need of support with support information appropriately responding to the support request.

Further, the system according to the present invention may include an information holding means for holding at least one of the information of the plurality of supporters and the information of the support requester and displaying the information to the intermediary. According to the system, the mediator can use the information holding means to quickly select a supporter with appropriate expertise, etc. Can be provided more quickly.

Further, in the system of the present invention,
The first wireless communication unit may transmit a position information signal including current position information of the wireless communication unit to the support terminal device via a wireless communication line. If a person who needs assistance, such as a visually impaired person or an elderly person with reduced visual ability, cannot recognize the current position and it is difficult to determine the current position from image information, the supporter or intermediary will carry the person Since the current position information can be obtained from the first wireless communication means of the portable support device to guide the person who needs the support, the convenience of the system can be further improved.

Further, in the system of the present invention,
The wearing object may be a spectacle frame having the first photographing unit facing the front, and according to such a system, when the supporter wears the spectacle frame, the first
Since the photographing means automatically turns in the direction in which the face of the person requiring support faces, the supporter or intermediary can easily know in the image the object that the person requiring support is looking at or about to see,
It is possible to provide more appropriate support information to the person in need of support, and to avoid giving both the person in need of support and the people around him or her discomfort to use the portable support device.

[0015] In the system of the present invention,
The spectacle frame may include at least one of the support request input unit and the support information output unit. According to such a system, only a person in need of assistance wears the spectacle frame, For example, the support request can be input or the support information can be received by voice or the like, so that the convenience of the system can be further improved.

In addition, in the system of the present invention,
At least one of the plurality of support terminal devices and / or the plurality of intermediary terminal devices is connected to artificial intelligence including a computer such as an automatic discriminator or an expert system so that the supporter and the intermediary can communicate with each other. At least one, or at least one, may be replaced with such artificial intelligence, thus focusing on knowledge,
For a support request with a small number of judgment elements, voice response is possible even with artificial intelligence, so that the burden on the mediator and the supporter can be reduced.

In addition, in the system of the present invention,
The support terminal device is connected one-on-one to the support terminal device and operates constantly, and converts the image signal from the first photographing unit received from the first wireless communication unit and the support request signal from the support request input unit into the support. A second wireless communication unit, such as a mobile phone, for transmitting the support information signal from the support terminal device to the first wireless communication unit via a wireless communication line while sending to the terminal device may be provided. By doing so, the remote support system for persons requiring assistance according to the present invention can be configured simply and inexpensively.

In addition, in the system of the present invention,
The support terminal device includes an image signal in the support information signal, and the portable support device outputs an image signal in the support information signal to another display device, or an output unit that outputs the image signal in the support information signal. A display means such as a small liquid crystal screen for outputting a video represented by the image signal may be provided. In this case, the supporter needs a display device or a portable support device from a supporter or an intermediary. Since images such as maps and explanatory texts can be received as support information by the display means, the convenience of the system can be further improved.

In addition, in the system of the present invention,
The support terminal device may include a second image capturing unit that captures the supporter and outputs an image signal including the video, the support terminal device may include the image signal in the support information signal,
In this way, the supporter and the supporter or intermediary can see each other's video, so that the supporter can receive support in sign language or writing, for example, to improve the convenience of the system. Can be.

Further, in the system of the present invention, the third wireless communication system is connected to the support terminal device one-to-one, always operates, and transmits a support image signal from the support terminal device via a wireless communication line. Means for outputting a support image signal from the third wireless communication means to another display device, or display means for outputting a video image represented by the image signal in the support information signal. Means may be provided, so that information can be simultaneously exchanged between the first and second wireless communication means and between the third and fourth wireless communication means, respectively. Therefore, even when the communication bandwidth that can be used between the wireless communication means is narrow, it is possible to transmit image signals at a relatively high speed, exchange moving image information in real time and high-resolution image information in a short time. Can be closed if the interaction easy.

Further, in the system of the present invention,
The support terminal device may include a second image capturing unit that captures the supporter and outputs an image signal including the video, and the support terminal device may include the image signal in the support image signal,
By doing so, in addition to the above-mentioned advantages, since the supporter and the supporter or the intermediary can see each other's video, the supporter can receive, for example, support in sign language, and the convenience of the system can be improved. Sex can be further enhanced.

[0022]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings. FIG. 1 is a block diagram showing a first embodiment of a remote support system for persons requiring assistance according to the present invention. In FIG. 1, reference numeral 1 denotes a person requiring assistance, and 2 denotes an eyeglass frame as a wearable object of the person requiring assistance. Is shown.

As shown in the figure, the remote support system for persons requiring assistance according to this embodiment is built in the center of the spectacle frame 2 and is oriented in a predetermined direction with respect to the person 1 who needs to wear the spectacle frame 2. A CCD (solid-state image sensor) camera 3 as a first photographing means for photographing a direction in which the face of the person 1 requiring assistance faces, and outputting an image signal including the image.
A microphone 4 as a support request input means for inputting a voice support request from the support requester 1 and outputting a support request signal including the support request, and a support information signal to be described later, Needed support information by voice of included support information 1
A speaker 5 as support information output means for outputting to the
The CCD camera 3, the microphone 4, and the speaker 5 are connected in a wired manner by a connection cord, and an image signal from the CCD camera 3 and a support request signal from the microphone 4 are transmitted to a support terminal device 6 described later via a wireless communication line. A first wireless communication means such as a normal mobile phone, a PHS, and a wireless LAN as a first wireless communication means for transmitting a support information signal received from the support terminal device 6 via the wireless communication line to the speaker 5.
And a first wireless communication device 7 such as an AN.

Further, in the remote support system for the person in need of support of this embodiment, the C received from the first wireless communication device 7
The video included in the image signal from the CD camera 3 is displayed, and the support request included in the support request signal from the microphone 4 received from the first wireless communication device 7 is output. A plurality of parallel computers including ordinary computers that transmit a support information signal including support information input by a home supporter (home supporter) 9 to the first wireless communication device 7 in response to the Or an alternately operating support terminal device 6 and an image from the CCD camera 3 received from the first wireless communication device 7 interposed between the first wireless communication device 7 and the support terminal device 6 It displays an image included in the signal and outputs a support request included in a support request signal from the microphone 4 received from the first wireless communication device 7, and outputs a plurality of home requests according to the image and the support request. Supporter 9 Then, a first or a plurality of intermediaries (exclusive intermediaries) 11 of the support center 10 or one or a plurality of intermediaries (home intermediaries) at home selected by the support center 10 described below are provided to the support terminal device 6 of the at-home supporter 9. A plurality of ordinary computer-operated intermediary terminal devices 13 for transmitting an image signal from the CCD camera 3 received from the wireless communication device 7 and a support request signal from the microphone 4 and operating constantly in parallel or alternately. I have it.

If an urgent support request is made but there is no home support person 9 currently available, the exclusive intermediary 11 or the home intermediary 12 itself responds to the video and the support request. The support information is input to the mediation terminal device 13, and the mediation terminal device
13 transmits a support information signal including the support information to the first wireless communication device 7 via a wireless communication line.

The support center 10 has an Internet
A WWW server 17, a file server, a router 15, which is always connected to the wireless communication line 14, a remote access server 16, which is always connected to the wireless communication line via a wired telephone line, for example.
18, a gateway 19, and a plurality of intermediary terminal devices 13 operated by a dedicated intermediary 11 are installed, they are connected to each other via a local area network, where the router 15 is connected via the Internet 14, The remote access server 16 is connected to each of the plurality of support terminal devices 6 operated by the home supporter 9 and each of one or more intermediary terminal devices 13 operated by the home intermediary 12, and the remote access server 16 is connected via the wireless communication line. Is connected to the first wireless communication device 7 of the portable support device 8 carried by each person 1 who needs support. In addition,
Router 15, remote access server 16, WWW server 1
7, the file server 18 and the gateway 19 are each composed of a normal computer or the like, and the WWW server 17 is provided with each home support person 9 and each home intermediary 12 as information holding means.
The current status of the hand-held work, which is dynamic data, and the data of expertise, which is static data, are held as a database so that each dedicated intermediary 11 and each home intermediary 12 can refer to the database, and the file server 18 Holds the personal data (corresponding to a medical chart in medical care) of each person needing support 1 and the suitability of each home support person 9 as a database so that each dedicated intermediary 11 and each home intermediary 12 can refer to the data. And
The gateway 19 protects the personal data of each supporter 1 in the file server 18 from malicious access.

In the system of this embodiment, the microphone 4 provided on the eyeglass frame 2 of the person 1 who needs the support 1 of the portable support device 8 carried by the person 1 who needs the support 1 , And outputs a support request signal including the support request, and the CCD camera 3 provided on the spectacle frame 2 captures a direction in which the face of the support required person 1 faces, When the image signal including the video is output, the first wireless communication device 7 of the portable support device 8 wirelessly communicates the image signal from the CCD camera 3 and the support request signal from the microphone 4 to the support terminal device 6. In addition to transmitting the support information signal from the support terminal device 6 via the wireless communication line to the speaker 5 provided on the spectacle frame 2, the speaker 5 Outputting by voice assistance information included in the signal in the assistance required person.

On the other hand, in the system of this embodiment, a plurality of support terminal devices 6 which are always operating in parallel or alternately transmit the image signals from the CCD camera 3 received from the first wireless communication device 7. The included image is displayed, and the support request included in the support request signal from the microphone 4 received from the first wireless communication device 7 is output, and the current situation of the support requiring user 1 is confirmed from the image. At the same time, the home supporter 9 who has confirmed the support request inputs support information corresponding to the current situation of the support requiring user 1 to the support terminal device 6, and the support terminal device 6 outputs a support information signal including the support information to the support terminal signal. The information is transmitted to the first wireless communication device 7 of the portable support device 8 carried by the user 1 via a wireless communication line.

Therefore, according to the system of this embodiment, a person who needs assistance, such as a person with a sensory impairment, an elderly person with a reduced perceptual ability, or an inexperienced person, can always respond to an assistance request when assistance is needed. Since it is possible to provide appropriate support information from the home supporter 9 based on the situation facing the supporter 1 found from the video from a remote place, the supporter 1 such as a person with a disability can be provided. Can eliminate the need for the supporter 9 to be always present, and can reduce the physical and mental burden of the supporter 9 and the financial and mental burden of the supporter 1. At home can enable the person with motor dysfunction to become a home supporter 9 and participate in society. Can receive care

Further, according to the system of this embodiment, when an inexperienced person who has little work experience as the support person 1 performs a work requiring a high level of knowledge and skill, an experienced person will accompany him. Even without this, the unskilled person can receive appropriate instructions, so that the unskilled person can perform appropriate work including installation and maintenance of the machine, for example, at a surgical site or a laboratory. Moreover, the need for support 1 is not always required, but is usually short for individual situations. That is, for example, when describing the visually impaired, in addition to daily mail sorting and garbage removal, etc., at the time of extraordinary work such as checking cooking recipes, manuals and contracts, or suddenly becoming alone, In case of emergency, such as when water leaks or collision with people and the sense of direction is lost, furthermore, check the products and prices when shopping, check the change, the color of the traffic light and the position of the push button, the stairs and the home When confirming the position of the edge, etc., a short but urgent support is required. In this situation, according to the present system, demand-response-type support can be provided. It is also possible for people other than the visually impaired to immediately obtain specialized knowledge in art, science, design, etc. when needed, and to provide support (interpretation, directions, etc.) like a Japanese guide when traveling abroad. It becomes possible. In addition, by asking for help when encountering a crime,
Since it is possible to leave the situation of the scene at that time as evidence of video and audio, it is also possible to suppress crimes such as stalking, assault and bullying. Since one home supporter 9 can appropriately support a plurality of support users 1, each home support provider 9 makes a contract to support the plurality of support users 1, which makes the system economically easy. Can be operated.

Further, in the system of this embodiment, the image from the CCD camera 3 received from the first wireless communication device 7 intervenes between the first wireless communication device 7 and the support terminal device 6. It displays an image included in the signal and outputs a support request included in a support request signal from the microphone 4 received from the first wireless communication device 7, and outputs a plurality of home requests according to the image and the support request. The CC received from the first wireless communication device 7 to the support terminal device 6 of the home supporter 9 selected by the dedicated mediator 11 or the home mediator 12 from the supporters 9
An image signal from the D camera 3 and a support request signal from the microphone 4 are transmitted, or support information corresponding to the video and the support request is input from the exclusive intermediary 11 or the home intermediary 12 and includes the support information. The support information signal is transmitted to the first wireless communication device 7
To a plurality of intermediary terminal devices 13 for transmission via a wireless communication line
And a plurality of intermediary terminal devices 13 which are always running in parallel or alternately, and the support
The home agent 9 or the home agent 9 selected by the mediator 11 or 12 based on the current situation and the support request, for example, the currently available supporter 9, and especially the supporter 1 among them The image signal from the CCD camera 3 received from the first wireless communication device 7 and the support request signal from the microphone 4 are sent to the support terminal device 6 of the supporter 9 who has expertise in the current situation. Send or, for example, in the case of an emergency and there is no supporter 9 currently available, input support information corresponding to the video and the support request from the mediator 11 or 12 itself, A support information signal including the support information is transmitted to the first wireless communication device 7 via a wireless communication line.

Therefore, according to this system, support information appropriately responding to the support request is provided to the support requester 1.
Can be provided more quickly.

Further, according to the system of this embodiment, the current status of the hand-held work as dynamic data of each home supporter 9 and each home intermediary 12 and the data of expert knowledge as static data are exclusively used. Intermediaries 11 and each home intermediary 12
WWW that is maintained as a database so that users can refer to it
Each dedicated intermediary 11 and each home intermediary 12 can refer to the server 17, personal data (corresponding to a medical record at a medical institution) of each person needing assistance 1, and appropriateness data on the assistance of each home assistant 9. As described above, since the file server 18 is provided as a database, the exclusive intermediary 11 and the home intermediary 12 can quickly select an appropriate home supporter 9 by using those databases. Support information appropriately responding to the support request can be promptly provided to the support requester 1.

It should be noted that the support request information composed of the image signal and the audio signal passing through the mediation terminal device 13 and the assistance information composed of the audio signal are automatically recorded in the mediation terminal device 13, and the report of the support result is made after the support is completed. Need support 1
And the supporter 9 may receive the information of the supporter 1 in the database of the file server 18 and the static information of the supporter 9 in the database of the WWW server 17. In addition to being able to update the information on the expertise that is part of the data as appropriate, the file server
Static data other than the specialty of each supporter 9 in the 18 databases can be updated as appropriate. In addition, the above WW
The system may be configured such that various data in the database of the W server 17 are copied to the file server 18 periodically or at any time, and are backed up by the file server 18.

According to the system of this embodiment,
Since the spectacle frame 2 as the wearing object has the CCD camera 3 facing the front, as shown in FIG. 1, when the supporter 1 mounts the spectacle frame 2, the CCD camera 3 Since the face of the person 1 faces automatically in the direction in which the face of the person 1 faces, the supporter 9 or the mediators 11 and 12 can easily know the target which the supporter 1 is looking at or is looking at by using an image, so that more appropriate support is provided. The information can be provided to the person 1 who needs the support,
It is possible to avoid giving a feeling of strangeness to using the portable support device 8. Also, when the camera direction is set in order to obtain the image that the supporter 9 wants to see, the camera direction can be set intuitively and smoothly since the supporter 1 may be instructed to indicate the face direction.

Moreover, according to the system of this embodiment,
Since the spectacle frame 2 has the microphone 4 and the speaker 5, as shown in FIG. 1, the support requester 1 simply inputs the spectacle frame 2 and inputs a support request by voice, Since the support information can be received by voice, the convenience of the system can be further improved. Note that the eyeglass frame 2 may have a bone conduction microphone instead of the microphone 4 and an earphone or a bone conduction speaker instead of the speaker 5.

FIG. 2 shows a second embodiment of the remote support system for persons in need of support according to the present invention. The system according to this embodiment comprises a CCD camera 3, a microphone 4 and a speaker provided on an eyeglass frame 2. 5 and the wireless communication device 7, another wireless communication device 20 connected to the wireless communication device 7, and further connected to the CCD camera 3, the microphone 4 and the speaker 5 provided on the spectacle frame 2. Only the point that data is transmitted and received by wireless connection with another wireless communication device (not shown) is different from the previous embodiment, and the other points are configured similarly to the previous embodiment. is there.

FIG. 3 shows a third embodiment of the remote support system for persons in need of support according to the present invention. In this embodiment, the other wireless communication device 20 is replaced with the wireless communication device 7.
It has the same configuration as that of the second embodiment except that it is incorporated in the second embodiment.

According to the systems of the second and third embodiments, both the CCD camera 3, microphone 4, and speaker 5 provided on the spectacle frame 2 and the first wireless communication device 7 are wired. Since the connection cable is not obstructed because it is not connected and wireless, the portable support device 8 can be used by both the support user 1 and the surrounding people. It can be done without giving a sense of strangeness. In particular, according to the system of the third embodiment, the other wireless communication device 20 is incorporated in the wireless communication device 7, so that the portable support device 8 can be more easily carried.

FIG. 4 shows a fourth embodiment of the remote support system for people in need of assistance according to the present invention. The remote assistance system for people in need of assistance in this embodiment is the same as that in the first embodiment. In addition to a portable support device 8 having a CCD camera 3, a microphone 4 and a speaker 5 provided on the eyeglass frame 2 and a first wireless communication device 7 connected thereto, the support in the first embodiment is provided. Internet of center 10
A router 15 which is always connected to 14, a remote access server 16 which is always connected to the wireless communication line, and a WWW server 1
7, file server 18, gateway 19, full-time intermediary 11
Terminal device 13 operated by the home intermediary 12 and the support terminal device 6 operated by the home supporter 9 and constantly connected to the Internet 14, instead of the first wireless communication device 7 to a normal wireless telephone. A second wireless communication device 21 that can be connected at any time via a line, such as a normal mobile phone, PHS, or wireless LAN, and that is always operating, and is always connected to the second wireless communication device 21 And a support terminal device 6 which is always operated and operated by the home support person 9.

The support terminal device 6 in this embodiment also displays an image included in the image signal from the CCD camera 3 received by the second wireless communication device 21 from the first wireless communication device 7 and displays the image. The support request included in the support request signal from the microphone 4 received from the first wireless communication device 7 is output, and the home support person 9 is output in response to the video and the support request.
Transmits a support information signal including the support information input to the first wireless communication device 7 via the wireless communication line.

According to this embodiment, a remote support system can be constituted by one or several portable support devices 8, one support terminal device 6, and one second wireless communication device 21. Thus, the remote support system for those who need support can be configured simply and inexpensively.

FIG. 5 shows a fifth embodiment of the remote support system for people who need assistance according to the present invention.
A connector (not shown) as an output unit for outputting an image signal in the support information signal from the support terminal device 6 to another display device 22;
Is connected to a video camera 23 as a second photographing means for photographing the home supporter 9 and outputting an image signal including the video, and the support terminal device 6 is connected to the home supporter 9 from the video camera 23. The fourth embodiment is different from the fourth embodiment only in that an image signal including a video and an image signal such as a map or an explanatory note as support information can be included in the support information signal. This is configured similarly to the fourth embodiment.

According to this embodiment, the supporter 1 can also receive an image such as a map or an explanatory note as support information from the supporter 9 by another display device 22, thereby improving the convenience of the system. Since the supporter 1 and the supporter 9 can see each other's images,
For example, the support requiring user 1 can receive support from the supporter 9 in sign language, writing, or the like, and in this regard, the convenience of the system can be further improved. A connector for outputting the image signal in the support information signal to another display device 22 or a second imaging for imaging the home supporter 9 or the mediators 11 and 12 and outputting an image signal containing the image. The video camera 23 as a means can be provided also in the wireless communication device 7 of the first and second embodiments. Also, instead of outputting the image signal in the support information signal to another display device 22, the wireless communication device 7 having a small liquid crystal screen, such as a mobile phone or a PHS, outputs the image to the small liquid crystal screen of the wireless communication device 7, and the support image is displayed there. May be displayed.

FIG. 6 shows a sixth embodiment of the remote support system for people in need of support according to the present invention. The remote support system for people in need of support in this embodiment is connected to the support terminal device 6 on a one-to-one basis. And a third wireless communication means for transmitting a support image signal from the support terminal device 6 via a wireless communication line, such as a normal mobile phone, PHS, or wireless LAN. A wireless communication device 24 and a fourth wireless communication device having a connector (not shown) as an output device for outputting the support image signal from the third wireless communication device 24 to another display device 22. A fourth wireless communication device 25, such as a mobile phone, a PHS, or a wireless LAN, which is always operating, and is preferably carried by the person 1 who needs assistance;
A video camera 23 is connected as second photographing means for photographing the home supporter 9 and outputting an image signal including the video, and the support terminal device 6 transmits the video of the home supporter 9 from the video camera 23. The fourth embodiment differs from the fourth embodiment only in that an image signal such as a map or a description as support information that can be included in the support image signal is included. It is configured similarly to the example.

According to this embodiment, information can be simultaneously exchanged between the first and second wireless communication devices 7 and 21 and between the third and fourth wireless communication devices 24 and 25, respectively. Therefore, even when the communication bandwidth that can be used between the wireless communication devices is narrow, it is possible to transmit image signals at a relatively high speed, exchange moving image information in real time, and transmit high-resolution image information in a short time. Can make the exchange easier,
Moreover, similarly to the fifth embodiment, the supporter 1 can receive an image such as a map or an explanatory note as support information from the supporter 9 by another display device 22,
Since the supporter 1 and the supporter 9 can see each other's images, the supporter 1 can receive support from the supporter 9 in, for example, sign language or writing, thereby improving the convenience of the system. it can. Note that, instead of outputting the support image signal to another display device 22, the wireless communication device 7 having a small liquid crystal screen such as a mobile phone or a PHS is output to the small liquid crystal screen of the wireless communication device 7, and the support image is displayed there. Is also good.

Although the present invention has been described with reference to the illustrated example, the present invention is not limited to the above-described example.
(A global positioning system using artificial satellites), a PHS current position detection system, or the like, and transmits a position information signal including the current position information to the support terminal device 6 via a wireless communication line. In this case, for example, a person 1 requiring assistance, such as a visually impaired person or an elderly person with reduced visual ability, cannot recognize the current position, and the supporter 9 or the mediators 11 and 12 can provide assistance only with image information. When it is difficult to grasp the current position of the user 1, it is possible to obtain the current position information from the wireless communication device 7 of the portable support device 8 carried by the user 1 and guide the user 1. As a result, the convenience of the system can be further improved.

In the above embodiment, the CCD camera 3 and the microphone 4
(Or a bone conduction microphone) and a speaker 5 (or an earphone or a bone conduction speaker), but instead of the eyeglass frame 2, a headband (hair stopper) to be worn on the head
A CCD camera, a microphone, or the like may be built in a pendant, a hat, a pendant attached to the chest, or a broach attached to clothes.
A digital camera using an OS sensor may be used,
A stereo microphone may be used as the microphone 4 so that the direction of the sound source can be recognized. The support request input means may be a switch or a portable keyboard, and the support information output means may be, for example, a display device (screen display device) such as a small liquid crystal screen. Can be easily used.

Further, such a small liquid crystal screen may be provided on, for example, one or both of the two lenses or the optical filters mounted on the spectacle frame 2, so that a person who needs assistance when assistance image information is needed. One can use it at any time.

Furthermore, the image signal and the support request signal from the support needer 1 and the support information signal and the support image signal from the supporter 9 or the mediators 11 and 12 are used in order to improve security. It has at least one of a secret function to prevent leaks to three parties, a message authentication function to confirm that the support record has not been tampered with, and a digital signature function to identify who created the support record. Preferably, it is encrypted.

Further, the portable support device 8 provides support by an instruction from the support terminal device 6 so that the support request signal transmitted from the support terminal device 8 can be easily understood and provided to the support person 9 and the agents 11 and 12. The image quality (resolution, color information, quantization level of each pixel, etc.) and brightness (shutter speed, aperture, bias, etc.) of the video are transmitted per second by the operation of the user 1 or the remote operation from the support terminal device 6. It is preferable that the number of images, that is, the frame rate (FPS: frameper second), the field of view (pan, tilt, zoom), the packet size of the support request signal, the communication bandwidth between video and audio, and the like can be changed. It is preferable that the first photographing means of the portable support device is provided with an image blur correction function using an optical mechanism or software.

Here, as a method of changing the field of view, for example, a tilted mirror is put in and out of the first photographing means, so that a standard front and a lower part for photographing the hand and feet of the person requiring assistance can be obtained. May be switched between the two types,
This makes it possible to change the field of view even when space restrictions are severe, such as when the first photographing unit is provided on the spectacle frame 2. If space permits, it is preferable to provide an optical field changing mechanism in the first photographing means.

Further, the communication protocol used for each wireless communication means is one that can correspond to real time (for example, UDP
(User Datagram Protocol) / RTP (Realtime Transform
portProtocol)).

Further, when the supporter 9 obtains a high-definition image or the like from the supporter 1, the support terminal device 6 stores the image as data such as a still image and displays the current image on the screen. May be separately and continuously displayed in a display frame different from the display frame of the image described above, and such a function can be effectively used when a supporter reads and listens to a book or a manual.

Further, the portable support device 8 can turn on and off the power of the portable support device 8 with one touch by operating the switch provided on the spectacle frame 2 or the like. It is preferable to be able to confirm the communication status (e.g., whether the power of the portable support device 8 is ON or OFF, and whether the mobile terminal 8 is preparing for connection with the support terminal device 6 or connecting when the power is ON) by voice. .

Further, it is preferable that the portable support device 8 does not synchronize the audio and the video, so that only the audio can be communicated in real time like a telephone even during the acquisition of high-definition video. This is because both the supporter 1 and the supporter 9 can maintain a sense of security.

In the remote support system of the present invention, the sign language service can be performed as follows in the systems of the first to fourth embodiments in which images are communicated in only one direction.

First, a person who services the hearing-impaired person wears the glasses frame 2 as the supporter 1 and sends the sign language of the hearing-impaired person to the supporter 9. The supporter 9 reads the sign language using the support terminal device 6 and displays the contents of the sign language on the eyeglass frame 2.
To the person who is providing the service by voice. This allows the service person to see and answer the question in writing to the hearing impaired (ie, there is no need to employ a sign language interpreter in the service person's group) In addition, since the sign language has different dialects and systems, the supporter 9 can select a person who can deal with the sign language of the hearing-impaired person from among persons who can sign language).

For example, a plurality of windows are provided at the support center, a display device (screen display device) such as the mediation terminal device 13 is installed on the counter of each window, and a video camera 23 is installed thereon. When a hearing-impaired person arrives, a person such as a mediator 11 who came to the window calls the remote supporter on the screen of the display device, and has a sign language conversation between the hearing-impaired person and the remote supporter on the screen. If the remote supporter speaks out and speaks, the agent or the like at the window can understand it.
It is possible to receive remote support via the support center without using.

Further, in the above embodiment, only the home supporter 9 who provides only support information is set as the supporter. However, the home supporter or the support center 10 which is dispatched in response to the support request and also provides the labor force is provided. Needless to say, there may be a dedicated supporter waiting, and at least one of the supporter and the intermediary may be replaced with artificial intelligence comprising a computer such as an automatic discriminator or an expert system. .

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing a first embodiment of a remote support system for persons requiring support according to the present invention.

FIG. 2 is a configuration diagram showing a main part of a second embodiment of the remote support system for persons requiring support according to the present invention.

FIG. 3 is a configuration diagram showing a main part of a third embodiment of the remote support system for persons in need of support of the present invention.

FIG. 4 is a configuration diagram showing a fourth embodiment of the remote support system for persons requiring support according to the present invention.

FIG. 5 is a configuration diagram showing a fifth embodiment of the remote support system for persons requiring support according to the present invention.

FIG. 6 is a block diagram showing a sixth embodiment of the remote support system for persons in need of support of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 support required person 2 glasses frame 3 CCD camera 4 microphone 5 speaker 6 support terminal device 7 first wireless communication device 8 portable support device 9 home support person 10 support center 11 full-time intermediary 12 home intermediary 13 intermediary terminal device 14 Internet 15 Router 16 Remote access server 17 WWW server 18 File server 19 Gateway 20 Another wireless communication device 21 Second wireless communication device 22 Display device 23 Video camera 24 Third wireless communication device 25 Fourth wireless communication device

 ──────────────────────────────────────────────────続 き Continuing from the front page (72) Inventor Iwao Sekida 1-1-4 Umezono, Tsukuba, Ibaraki Pref., Ministry of Economy, Trade and Industry (AIST) Tetsuya Higuchi Umezono, Utsuen, Tsukuba, Ibaraki 1-1-4, Electronic Technology Research Institute, National Institute of Advanced Industrial Science and Technology (METI) (72) Inventor Yuriko Uchida 1-4-1, Umezono, Tsukuba City, Ibaraki Prefecture, Electronic Technology Research Institute, National Institute of Advanced Industrial Science and Technology, Ministry of Economy, Trade and Industry

Claims (13)

[Claims] A first photographing means (3) provided on an attachment (2) of a person in need of assistance for photographing in a predetermined direction based on the person in need of assistance, and outputting an image signal including the photographed image. ), A support request input means (4) for inputting a support request from the support requester and outputting a support request signal including the support request, and inputting a support information signal and converting the support information contained therein. A support information output unit (5) for outputting to a support person, an image signal from the photographing unit and a support request signal from the support request input unit are transmitted to the support terminal device (6) via a wireless communication line. A portable support device (8) having first wireless communication means (7) for outputting a support information signal received from the support terminal device via a wireless communication line to the support information output means; And the first wireless communication A video included in the image signal from the first photographing means received from the stage is displayed, and the support request included in the support request signal from the support request input means received from the first wireless communication means is displayed. One or more of: outputting a support information corresponding to the video and the support request from a supporter and transmitting the support information signal including the support information to the first wireless communication means via a wireless communication line. And a remote support system for a person in need of support. 2. The first photographing means which is interposed between the first wireless communication means (7) and the support terminal device (6), always operates, and receives from the first wireless communication means. Displaying the video included in the image signal from (3) and outputting the support request included in the support request signal from the support request input means (4) received from the first wireless communication means; An image signal from the first photographing unit received from the first wireless communication unit to the support terminal device of the supporter selected by the mediator from the plurality of supporters in response to the video and the support request, and A support request signal is transmitted from a support request input unit, or support information corresponding to the video and the support request is input from the intermediary, and the support information signal including the support information is transmitted to the first wireless communication unit. To send to the user via a wireless communication line Or a plurality of intermediary terminal devices (1
3. The remote support system for a person in need of support according to claim 1, wherein 3) is provided. 3. An information holding means (18) for holding at least one of the information of the plurality of supporters and the information of the support requester and displaying the information to the mediator. The remote support system for those who need assistance as described. 4. The first wireless communication means (7) transmits a position information signal including current position information of the first wireless communication means to the support terminal device (6) via a wireless communication line. 4. A remote support system for a person in need of support according to any one of claims 1 to 3, characterized in that: 5. The need for assistance according to claim 1, wherein the wearing object is an eyeglass frame (2) having the first photographing means facing forward. Remote support system for the elderly. 6. The support person according to claim 5, wherein the spectacle frame (2) has at least one of the support request input means (4) and the support information output means (5). Remote support system. 7. The support according to claim 1, wherein at least one of the plurality of support terminal devices (6) is connected to an artificial intelligence comprising a computer. Remote support system for those who need it. 8. The support according to claim 2, wherein at least one of the plurality of mediation terminal devices (13) is connected to an artificial intelligence comprising a computer. Remote support system for those who need it. 9. An image processing apparatus which is connected to the support terminal device (6) on a one-to-one basis and operates constantly, receives an image signal from the first photographing means received from the first wireless communication means, and receives a signal from the support request input means. A second wireless communication means (21) for sending the support request signal to the support terminal device and transmitting the support information signal from the support terminal device to the first wireless communication means via a wireless communication line. Characterized by having a
The remote support system for people in need of support according to claim 1. 10. The support terminal device (6) includes an image signal in the support information signal, and the portable support device (8) converts an image signal in the support information signal to another display device (22). Output means to output to, characterized by having a display means to output the video represented by the image signal in the support information signal,
The remote support system for a person requiring support according to any one of claims 1 to 9. 11. A second photographing means (23) for photographing the supporter and outputting an image signal including the image thereof, wherein the support terminal device (6) converts the image signal into the support information signal. The remote support system for people in need of support according to claim 10, wherein the remote support system includes: 12. A third wireless communication means (2) which is connected one-to-one to the support terminal device and operates constantly, and transmits a support image signal from the support terminal device via a wireless communication line.
4) and output means for outputting the support image signal from the third wireless communication means to another display device (22) or display means for outputting a video represented by the image signal in the support information signal. The remote support system for people in need of assistance according to claim 9, comprising: wireless communication means (25) according to (4). 13. A second photographing means (23) for photographing the supporter and outputting an image signal including the video, wherein the support terminal device (6) converts the image signal into the support image signal. 13. The remote support system for a person in need of support according to claim 12, wherein the system is included.