JP2016162012A - Video interactive device with call originating function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To notify a watching person of the situation of a watched person by an extremely simple operation.SOLUTION: Watched person side terminal equipment includes: a touch panel type display device 1; a touch detection part 2; a touch information transmission part 3; a video mail recognition part 12; a video mail reception detection part 13; a video mail reception part 14; a video mail reproduction detection part 15; a video mail photographing part 16; a video camera 22; and a video mail transmission part 17. Watching person side terminal equipment includes: a touch information reception part 4; a video mail photographing part 6; a video camera 7; a video mail recording part 8; a video mail list creation part 9; a display device 5; a video mail transmission part 10; a video mail authentication part 18; a video mail reception detection part 19; a video mail reception part 20; and a reception video mail recording part 21. Video mail type interaction is achieved by using a screen touch operation as a trigger. Furthermore, the mechanical part of the watched person side terminal equipment is covered with a staffed suit such that the watched person side terminal equipment is caused to function as a personified medium having a function for encouraging the natural utterance of a watched person.SELECTED DRAWING: Figure 1

Description

The present invention uses a call operation of a watched person such as a hospitalized patient or a bedridden caregiver as a trigger, and transmits a video image mail spoken by a watcher such as a medical / nursing staff from a watcher side terminal device. It is related to the mechanism that the response of the watcher who saw the video image is automatically returned as a video image mail from the watcher's terminal device.

  In recent years, mobile terminals called smartphones have become widespread, and videophone functions using mobile terminals such as Skype (Non-patent Document 1) can be used free of charge. It is extremely useful to apply such a function that can communicate video information as a watching technique for hospitalized patients or bedridden caregivers. However, the procedure for operating a mobile terminal is extremely difficult for a watched patient such as a hospitalized patient or a bedridden caregiver.

On the other hand, a call function such as a nurse call consists of a call function such as a buzzer and information exchange by voice, and the amount of information is insufficient to know the face of the watched person and the state of the utterance.

In this way, TV phone functions such as Skype, a high-performance mobile phone, are effective for understanding the watch's face color and utterance, but basically the terminal operation of both the watcher and the watcher is not possible. It is necessary, and it is difficult for a watched person such as an inpatient or a bedridden elderly person to expect the operation. Therefore, in the present invention, the problem is solved by combining the calling function with the remote dialogue support device of (Patent Document 1).

Japanese Patent Application 2013-231929

Microsoft, “Skype”, [online], [Search February 22, 2015], Internet <URL: http://www.skype.com/en/>

  Currently, 24.1% of the total population, about one in four, is a super-aging society with the elderly, Ministry of Internal Affairs and Communications Statistics Bureau "National Census" (2000), National Institute of Population and Social Security Research According to the future estimate of the number of households in Japan (3003), the number of elderly living alone has increased rapidly, reaching nearly 6 million as of 2015. The Cabinet Office “Survey on the Actual Conditions of Living for the Elderly” (2009) According to the announcement in December), 1% of them are bedridden or close to bedridden.

  A TV phone function such as Skype is useful as a means for a medical / nursing staff or a remote family to watch over the situation of a watched person such as an elderly person or an inpatient in such a situation.

However, the TV phone function basically requires terminal operation for both the watcher and the watcher, and it is difficult for the watcher such as an inpatient or bedridden elderly person to expect the operation. In particular, it is difficult for the elderly to make a call from a watched person, and it is necessary to have a means to send and receive video information for watching with only a simple operation.

  The present invention provides a watcher-side terminal device and a watcher-side terminal device, which are high-function mobile phones, utilizing the video shooting and recording function and communication function of a high-function mobile phone. Taking a video call called a video message from the watcher's terminal device and sending a video mail to the watcher's terminal device, triggered by calling the watcher only with “screen touch”, the video image is played back. The watcher's terminal device automatically starts recording after a certain period of time from the start of video image playback, automatically records the watcher's response to the video message for a certain period of time, and then watches it. The main feature is automatic transmission of video mail to terminal devices.

Further, in the present invention, it is possible to cover parts other than the display device and the video photographing device of the watched person side terminal device with the costume, and to make the watched person side terminal device function as an anthropomorphic medium (see the effect of the invention). Features.

  The present invention is based on the fact that a watcher, who is a high-function mobile phone, calls a watcher only by a simple operation of “terminal screen touch” on the watcher's terminal, and receives a video message from the watcher's terminal device. When a video image is called and a video mail is sent to the watcher's terminal device, the video image is played back, and the watcher's terminal device automatically starts recording after a certain period of time after the start of video image playback. The watcher's response to the video message is automatically recorded for a certain period of time and then automatically sent as a video mail to the watcher's terminal device.

The watcher has the advantage that the situation can be communicated to the watcher as a video video mail just by responding to the message without the need for terminal operation other than “screen touch”.

Description of anthropomorphic media:
An existence like a stuffed toy or a humanoid robot that does not have a true heart but has a heart is called an anthropomorphic medium.
References: Noriaki Kuwahara, Atsuko Yonezawa, Toshiyo Tamura, Akira Utsumi, Nobuharu Abe, “A Study on Behavior Support Media that Supports the Creation of Motivation and Attention Guidance for People with Memory Disorders and Dementia,” 2011 Research Results Report According to, it has been found that such anthropomorphic media can stimulate the watcher's willingness to interact by activating the right brain that senses nonverbal communication and, as a result, activating the left brain with a language field. Yes. For this reason, it is possible to facilitate the dialogue of watchers whose willingness to talk has declined due to dementia.

Figure 1 shows a schematic diagram of the configuration of a video interaction device with a calling function. Example 1 Fig. 2 shows a schematic diagram of the configuration of a video dialogue device with a calling function. (Example 2)

The purpose of constructing a mechanism for watching a watched person such as a bedridden or elderly person living alone who is close to bedridden by using video information is eliminated. In addition, the call processing is realized only by the simple operation of the watcher's “terminal screen touch”, and the video image mail called video message is sent and received by the watcher side terminal device and the watcher side terminal device. It will be realized as a smartphone application using a high-performance mobile phone device.

  FIG. 1 is a diagram of one embodiment of the device of the present invention. The terminal device on the watched person side is: (1) a touch panel display device, (2) a touch detection unit, (3) a touch information transmission unit, (12 ) Video mail authentication part, (13) Video mail reception detection part, (14) Video mail reception part, (15) Video mail playback detection part, (16) Video mail photographing device, (22) Video camera, (17) Video It consists of a mail transmission part and (23) costume (anthropomorphic medium). The terminal device on the watcher side consists of (4) touch information receiver, (2) video mail shooting unit, (7) video camera, (8) video mail recording unit, (9) video mail list creation unit, (5) It consists of a display device, (10) video mail transmission unit, (18) video mail authentication unit, (19) video mail reception detection unit, (20) video mail reception unit, and (21) received video mail recording unit.

The watcher touches the (1) touch panel display on the guardian's terminal to call the watcher.

In order to transmit to the watcher that the guardian's terminal has been touched, (1) the touch information of the touch panel display device is detected by (2) the touch detector and (3) transmitted from the touch information transmitter. (11) Received by the touch information receiver on the watcher's terminal via the communication network.

When the touch information by the watched person is received by the (4) touch information receiver of the watcher side terminal, (5) a message notifying the reception is presented on the display device together with the received sound.

After the watcher receives a call from the watched person, he / she interacts with the watched person using video mail. The video mail communication function is described below.

  When a watcher shoots video mail using the watcher's terminal device, the (6) video mail shooting device of the watcher's terminal device is activated, (7) acquires video image information from the video camera, ( 8) Recorded in the video mail recording part.

  (8) The video mail information recorded by the video mail recording unit is listed by the (9) video mail list creation unit and (5) displayed on the display device.

  When the watcher selects the video mail that has just been recorded or the video mail that has been recorded once from the list and sends it, (10) the video mail sending section selects the video mail information selected from the list. (8) is retrieved from the video mail recording unit, and (11) is sent to the watcher's terminal via the communication network along with the authentication information.

  In the watcher side terminal, the authentication information sent from the watcher side terminal is referred to by the (12) video mail authentication unit, and if it is verified that it is the video mail information of the own watcher, the video mail information (13 ) Detected by the video mail reception detector.

  (13) When the video mail reception detection unit detects the arrival of the video mail information, a signal notifying the detection is transmitted to the (16) video mail photographing unit, and (15) through the video mail reproduction detection unit (1 ) Present video mail information on a touch panel display.

  (16) Upon receiving the video mail information incoming detection signal, the video mail shooting device starts shooting the response video mail of the watched person detected by the video camera after the preset time (22). The response video mail information of the recorded recording time is transmitted to (17) Video mail transmission section.

  (17) The video mail transmission unit (11) watches the response video mail information along with the authentication information via the communication network and sends it to the terminal device on the viewer side.

  When the watcher's terminal receives the response videomail information and authentication information, (18) the videomail authentication unit verifies the authentication information and authenticates that it is a watcher.

(18) When authenticated by the video mail authentication unit, (19) the video mail reception detection unit (5) presents the response video mail information to the display device, and (21) records the received video mail recording unit. The watcher-side terminal device is (23) a costume (anthropomorphic medium) that covers (1) the touch panel display device and (22) machine parts other than the video camera. It functions as an anthropomorphic medium described.

  FIG. 2 is a diagram of a second embodiment of the device of the present invention.

  In the second embodiment, (6) video mail recording unit, (8) video mail list creating unit, (9) video mail recording unit, (10) video mail transmitting unit, ( 18) The video mail authentication unit, (21) the received video mail recording unit, and the watcher's terminal device configuration, (12) the video mail authentication unit is separated from each terminal device, and (11) on the communication network. It is a device configuration built on the server device installed in.

  The mechanism between the devices constituting the second embodiment is the same as that of the first embodiment.

In the second embodiment, since it is not necessary to record video mail information with a large amount of information on the terminal device on the watcher side, it operates stably against a shortage of storage capacity of the terminal device.

  There are many watchers who care about remote watchers. These include remote elderly people, especially those who are bedridden or close to bedridden, families and caregivers who need to watch over, and medical staff who need to watch over patients in hospital. However, the terminal device functions that can be easily handled by current watchers, as described in the explanation of the “Background Technology” above, are easy to operate, but are simple voice call devices with a nurse call function or terminal operation functions. At present, only difficult TV phone equipment is available.

  According to the present invention, it is possible to realize a dialogue with a watcher using video information such as video mail information with a simple operation of “screen touch” by a watcher.

  Therefore, it is possible to use high-performance mobile phones (smartphones) that are now widely used as terminals, and smartphone applications that realize the device configuration of the watcher side terminal device and the watcher side terminal device on the Internet. Since it can be distributed at low cost and its functions can be expanded on the network, it is possible to configure a service to realize a watch dialogue that is inexpensive and abundant in information.

Furthermore, since the functions of the anthropomorphic medium described in the above “Description of the anthropomorphic medium” can be realized by selling costumes, this service can be provided inexpensively and easily.

(1) Touch panel display device,
(2) Touch detector,
(3) Touch information transmitter
(4) Touch information receiver,
(5) display device,
(6) Video mail shooting department,
(7) Video camera,
(8) Video mail recording part,
(9) Video mail list creation part,
(10) Video mail sending part,
(11) communication network,
(12) Video mail authentication department,
(13) Video mail reception detector,
(14) Video mail receiver,
(15) Video mail playback detector,
(16) Video mail shooting department,
(17) Video mail sending unit,
(18) Video mail authentication department,
(19) Video mail reception detector,
(20) Video mail receiver,
(21) Received video mail season part,
(22) Video camera,
(23) Costume (anthropomorphic medium)

Claims (2)

The terminal device for the watched person is a touch panel display device, a touch detection unit, a touch information transmission unit, a video mail authentication unit, a video mail reception detection unit, a video mail reception unit, a video mail playback detection unit, a video mail photographing device, and a video. Camera, video mail transmitter, touch information receiver as watcher's terminal device, video mail camera, video camera, video mail recorder, video mail list generator, display device, video mail transmitter , A video mail authentication unit, a video mail reception detection unit, a video mail reception unit, and a received video mail recording unit. A touch panel display of the terminal device of the guardian for the watcher to make a call When touching the device, a touch panel display device is used to notify the watcher that the terminal on the guardian side has been touched. Touch information is detected by the touch detection unit, transmitted from the touch information transmission unit, and received by the touch information reception unit of the terminal on the watcher side via the communication network. When received by the touch information reception unit of the terminal, a message notifying the reception is presented on the display device of the watcher side terminal together with the received sound, and the watcher responds to the watcher's call. , When shooting video mail using the watcher's terminal device, the video mail shooting device of the watcher's terminal device is activated, video image information is acquired from the video camera, and recorded in the video mail recording unit. Furthermore, the video mail information recorded by the video mail recording unit of the watcher's terminal device is listed by the video mail list creating unit and displayed as a list on the display device. Furthermore, when the watcher selects the video mail that has been recorded or the video mail that has been recorded from the list and performs the transmission operation, (1) Video mail information selected from among them is retrieved from the video mail recording unit and sent to the watcher's terminal via the communication network together with the authentication information. In addition, the watcher's terminal receives the information from the watcher's terminal. When the sent authentication information is referred to by the video mail authentication unit and it is verified that it is the video mail information of the watcher of the watcher, the video mail reception detection unit detects the video mail information. When the video mail reception detection unit detects an incoming video mail information, a signal notifying the detection is transmitted to the video mail photographing unit. The video mail information is presented to the touch panel display device via the video mail playback detection unit. Further, when the video mail photographing device of the watcher's terminal device receives the video mail information incoming detection signal, Later, shooting of the response video mail of the watched person detected by the video camera is started, and response video mail information of the preset recording time is transmitted to the video mail sending unit. The mail transmission unit sends the response video mail information to the watcher side terminal device together with the authentication information via the communication network, and further, when the watcher side terminal device receives the response video mail information and the authentication information, The video mail authentication unit verifies the authentication information and authenticates that it is a watched person. Furthermore, the video mail authentication of the watcher's terminal device The video mail reception detection unit presents the response video mail information on the display device and records it in the received video mail recording unit. Using the communication function, the watcher side terminal device and the watcher side terminal device, which are high-function mobile phones, are prepared, and the watcher is called only by the “terminal screen touch” of the watchdog. When a video image called a video message is shot from a watcher terminal device and video mail is sent to the watcher's terminal device, the video image is played back. Recording starts automatically after a certain period of time, and the watcher's response to the video message is automatically recorded for a certain period of time. This is a video dialogue device with a calling function whose main feature is that it is automatically transmitted as video mail to the terminal device.
In addition to the device configuration of “Claim 1”, the machine part of the watcher's terminal device other than the video camera and the touch panel display device is covered with a costume (anthropomorphic medium), so that the watcher's terminal device Is a video dialogue device with a calling function, characterized in that it functions as an anthropomorphic medium with a function to promote the natural utterance of the watched person.

Images