JP4932938B1 - Call system - Google Patents

Abstract

The present invention provides a call system that allows a call executor to confirm part of a face of a callee more easily than before.
The call system includes a server device 20 used by a call executor who makes a call to a vehicle driver, and a client device used by the driver. The client device is an image of the driver. And a communication unit 27 that transmits an image captured by the video camera 23 to the server device 20. The server device 20 receives the image transmitted by the communication unit 27 of the client device. The communication unit 27, the PC 21 that extracts a part of the face image of the driver from the image received by the communication unit 27 by image recognition, and the part of the face image extracted by the PC 21 is displayed. And a monitor 25.
[Selection] Figure 2

Description

  The present invention relates to a call system that can support a call to a callee by a caller.

  The conventional call system includes a computer used by an operation manager who is a call executor and a computer used by a car driver who is a callee, and the computer used by the driver is An imaging device that captures an image of the driver and a first data transmission / reception device that transmits an image captured by the imaging device to a computer used by the operation manager are used by the operation manager The computer includes a second data transmitting / receiving device that receives an image transmitted by the first data transmitting / receiving device, and an image display device that displays the image received by the second data transmitting / receiving device. An apparatus is known (for example, refer to Patent Document 1). This car operation management device confirms the appearance of the driver's complexion and facial expression to the operation manager based on the images displayed on the image display device in order to make the operation manager judge the health status of the driver at a remote location. Can be made.

JP 2007-058295 A

  Human health conditions may appear prominently on part of the face, such as redness of the eyes. Therefore, the human can not only look at the face of others vaguely but also accurately determine the health status of others by noting a part of the face.

  However, the conventional automobile operation management device can make the operation manager confirm the driver's appearance by the image displayed on the image display device, but the operation manager can check a part of the driver's face on the priority check site. It is not suitable for letting attention.

  Therefore, an object of the present invention is to provide a call system that allows a caller to easily confirm a part of the face of the person being called.

  The call system of the present invention includes a call execution device used by a call execution person who makes a call, and a to-be-called device used by a to-be-called person who makes the call. Image capturing means for capturing an image of a person to be called, and image transmitting means for transmitting an image captured by the image capturing means to the call execution device, wherein the call execution device is configured by the image transmission means. Image receiving means for receiving the transmitted image, and part of face extracting means for extracting from the image received by the image receiving means a face partial image that is a part of the face of the callee by image recognition And image display means for displaying the face part image extracted by the face part extraction means.

  With this configuration, the call system of the present invention extracts and displays a part of the face of the callee's face from the image received by the call execution device from the callee device. It is possible to make it easier for the caller to confirm.

  Further, the image display means of the call system of the present invention displays a face image, which is an image including the face of the person being called, separately from the face partial image, and displays the face partial image of the face image. You may enlarge and display rather than the corresponding part inside.

  With this configuration, the call system of the present invention allows the caller to confirm the entire face of the person to be called by displaying the face image, and is displayed in an enlarged manner from the corresponding part in the face image. A part of the face of the person to be called can be easily confirmed by the caller by using the partial face image.

  Further, the partial face image of the call system of the present invention may be an image including the eyes of the callee.

  With this configuration, the call system according to the present invention allows the call executor to easily check the “eyes” in which the health condition of the called person is likely to appear remarkably by displaying the partial face image.

  Further, the face partial image of the call system of the present invention may be an image including the periphery of the eye of the called person.

  With this configuration, the call system according to the present invention allows the call executor to easily confirm the periphery of the eye of the called person who is likely to notice the health condition of the called person easily by displaying the face partial image, like the eye. be able to.

  The program for a call execution device of the present invention comprises a call execution device used by a call execution person who makes a call, and a callee device used by a callee who makes the call. The call execution device of the call system, in which the to-be-called device includes the image shooting means for shooting the image and the image transmission means for transmitting the image shot by the image shooting means to the call execution device is made to function. A program for a call execution device for receiving an image transmitted by the image transmitting unit, and an image of a part of the face of the callee from the image received by the image receiving unit Face part extraction means for extracting a face part image by image recognition, and image display means for displaying the face part image extracted by the face part extraction means Characterized in that the functioning of the serial roll call executive device.

  With this configuration, the call execution device that executes the program for the call execution device of the present invention extracts and displays an image of a part of the face of the callee from the image received from the callee device. A part of the face can be easily confirmed by the caller.

  According to the call system of the present invention, a part of the face of a callee can be easily confirmed by a caller.

1 is a block diagram of a call system according to an embodiment of the present invention. It is a block diagram of the server apparatus shown in FIG. It is a block diagram of the client apparatus shown in FIG. It is a figure which shows the example of the screen displayed on the monitor of the server apparatus shown in FIG. 3 is a flowchart of the operation of the PC of the server apparatus shown in FIG. 2 when a request for a roll call is received from a client apparatus. It is a figure which shows the extraction method of the face partial image by PC of the server apparatus shown in FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  First, the configuration of a call system according to an embodiment of the present invention will be described.

  FIG. 1 is a block diagram of a call system 10 according to the present embodiment.

  As shown in FIG. 1, a call system 10 is used by a server device 20 as a call execution device of the present invention used by a call execution person who makes a call, and a driver who is a to-be-called person who receives a call. And a plurality of client devices 40 as the to-be-called device of the present invention for transmitting the state of the person to the server device 20 by sound and image. The server device 20 and the client device 40 can communicate with each other via a network 11 such as the Internet. Note that the call system 10 may include a plurality of server devices 20 or only one client device 40.

  The call system 10 is a system used by a carrier, and is a system that supports a call before a driver's crew, which is required by law. The server device 20 is installed at the headquarters of the carrier. The client device 40 is installed in each branch of a transportation company scattered across the country, for example, several hundreds.

  FIG. 2 is a block diagram of the server device 20.

  As shown in FIG. 2, the server device 20 is a computer (PC) 21 that controls the entire server device 20, a microphone 22 that inputs sound, a video camera 23 that inputs images, and outputs sound. A speaker 24 for outputting images, a monitor 25 for outputting images, an operation unit 26 such as a keyboard, a mouse, and a touch panel for inputting operations by a caller, and a communication unit 27 for communicating with an external device. . In some cases, an alarm device 28 that gives an alarm by sound and a call lamp 29 that calls a call executor by light may be provided. Here, the communication unit 27 is configured to receive an image transmitted by a communication unit 47 (to be described later) of the client device 40, and constitutes an image receiving unit of the present invention. Further, the PC 21 extracts a face partial image, which is a partial image of the driver's face, from the image received by the communication unit 27 by image recognition. It is composed. Further, the monitor 25 displays a partial face image extracted by the PC 21, and constitutes an image display means of the present invention. The server device 20 may have a configuration in which the alarm device 28 and the call lamp 29 are replaced by the speaker 24 and the monitor 25, respectively.

  The PC 21 includes a CPU (Central Processing Unit), an HDD (Hard Disk Drive) that stores in advance a program including the program for the call execution device of the present invention and various data of the OS (Operating System), and a work area for the CPU. It is composed of a RAM (Random Access Memory) used and the like. The CPU is an arithmetic processing unit that operates the PC 21 by executing a program stored in the HDD. The RAM temporarily stores programs and various data when the programs are executed by the CPU.

  FIG. 3 is a block diagram of the client device 40.

  As shown in FIG. 3, the client device 40 includes a PC 41 that is a computer that controls the entire client device 40, a microphone 42 that inputs sound, a video camera 43 that inputs images, and a speaker 44 that outputs sound, A monitor 45 for outputting an image, an operation unit 46 such as a keyboard, a mouse, and a touch panel for inputting operations by a driver, and a communication unit 47 for communicating with an external device are provided. Here, the video camera 43 is configured to capture an image of the driver, and constitutes an image capturing means of the present invention. In addition, the communication unit 47 is configured to transmit an image captured by the video camera 43 to the server device 20, and constitutes an image transmission unit of the present invention.

  The PC 41 includes a CPU, an HDD that stores programs and various data in advance, and a RAM that is used as a work area for the CPU. The CPU is an arithmetic processing unit that operates the PC 41 by executing a program stored in the HDD. The RAM temporarily stores programs and various data when the programs are executed by the CPU.

  FIG. 4 is a diagram illustrating an example of a screen displayed on the monitor 25 of the server device 20.

  As shown in FIG. 4, the screen displayed on the monitor 25 is an image including a “driver information” area 61 for displaying information on the driver currently on the call and the face of the driver currently on the call. “Driver face image” area 62 for displaying a face image, “Face partial image” area 63 for displaying the face partial image of the driver currently on the call, and an image including the face of the call executor A “caller executor face image” area 64 for displaying a face image is included.

  In the “driver information” area 61, an “office, branch” area 61 a that displays identification information of the client device 40 that has requested the call of the driver who is currently being called, and the employee number of the driver who is currently being called The “employee number” area 61b is displayed, and the “name” area 61c is displayed that displays the name of the driver who is currently making a call. The information displayed in the “sales office, branch” area 61 a, “employee number” area 61 b and “name” area 61 c is the identification information of the driver, and the PC 21 of the server device 20 makes a call from the client device 40. This information is transmitted from the client device 40 together with the call request when the request is received.

  The face image displayed in the “driver face image” area 62 is an image captured by the video camera 43 of the client device 40 and transmitted from the client device 40 to the server device 20.

  The face partial image displayed in the “face partial image” area 63 is an image generated by the video camera 43 of the client device 40 and generated based on the image transmitted from the client device 40 to the server device 20. is there. Here, the face partial image displayed in the “face partial image” area 63 is displayed in a larger size than the corresponding part in the face image displayed in the “driver face image” area 62. The PC 21 can arbitrarily designate the magnification of enlargement from the caller through the operation unit 26.

  The face image displayed in the “driver face image” area 64 is an image taken by the video camera 23.

  Next, the operation of the call system 10 will be described.

  The client device 40 can receive a call request instruction from the driver by inputting various information including the driver's employee number and name from the operation unit 46, for example. Accordingly, when the driver inputs various information including the employee number and name of the driver and instructs the client device 40 to make a call request, the PC 41 of the client device 40 sends the call request via the communication unit 47. It transmits to the server device 20. Here, when the PC 41 transmits a call request to the server device 20, the client device 40 itself includes identification information and various information including the driver's own employee number and name input by the driver. It is transmitted to the server device 20 together with a request for a roll call.

  When the PC 21 of the server device 20 receives a call request from the client device 40, it starts the processing shown in FIG.

  FIG. 5 is a flowchart of the operation of the PC 21 of the server device 20 when a call request is received from the client device 40.

  As shown in FIG. 5, the PC 21 drives the alarm device 28 and the call lamp 29 to notify the call executor of the reception of the call request by the sound output from the alarm device 28 and the light emission by the call light 29. (S81).

  Next, the PC 21 determines whether or not the start of a roll call has been instructed (S82). Here, the call execution person can instruct the server device 20 to start the call by pressing the call start button from the operation unit 26 of the server device 20, for example.

  If the PC 21 determines in S82 that the start of the roll call has not been instructed, it executes the process of S81 again.

  On the other hand, if the PC 21 determines in S82 that the start of the call has been instructed, it notifies the client device 40 (hereinafter referred to as “target client device”) that has transmitted the call request via the communication unit 27. (S83). Here, when the PC 41 of the target client device receives the start of the call from the server device 20, it outputs the sound acquired by the microphone 22 of the server device 20 to the speaker 44 and is shot by the video camera 23 of the server device 20. By displaying the obtained image on the monitor 45, the driver is notified of the start of the call.

  Next, the PC 21 displays various information received together with the call request from the target client device in the “driver information” area 61 of the monitor 25 (S84). Here, among the various types of information received from the target client device, the PC 21 displays the identification information of the client device 40 in the “sales office, branch” area 61a, and the driver's employee number in the “employee number” area 61b. The name of the person is displayed in the “name” area 61c.

  Next, the PC 21 outputs the sound acquired by the microphone 42 of the target client device from the speaker 24 and the image captured by the video camera 43 of the target client device in the “driver's face image” area 62 of the monitor 25. Displaying is started (S85). Here, the PC 21 receives the sound acquired by the microphone 42 of the target client device and transmitted from the target client device to the server device 20 by the communication unit 27 and outputs it from the speaker 24. In addition, the PC 21 receives an image captured by the video camera 43 of the target client device and transmitted from the target client device to the server device 20 by the communication unit 27 and displays it in the “driver's face image” area 62 of the monitor 25. To do.

  Next, the PC 21 starts displaying the driver's face partial image in the “face partial image” area 63 of the monitor 25 based on the image captured by the video camera 43 of the target client device (S86). Here, the PC 21 extracts the driver's face partial image from the image displayed in the “driver face image” area 62 of the monitor 25, and the extracted face partial image is the “face partial image” area of the monitor 25. 63.

  Here, a method in which the PC 21 extracts the driver's partial face image from the image received from the target client device will be described.

  FIG. 6 is a diagram illustrating a method for extracting a partial face image by the PC 21.

  As shown by a rectangular frame 71 in FIG. 6, the PC 21 extracts the driver's face by image recognition from the image received from the target client device. The face extraction is performed by a known method using, for example, a cascade classifier using feature quantities.

  Next, the PC 21 extracts a face partial image from the extracted face image as indicated by a rectangular frame 72 in FIG. For example, the PC 21 determines the frame 72 so as to surround the lower half region of the upper half region surrounded by the frame 71. When the driver's face is a general face, the area surrounded by the frame 72 includes the driver's eyes and the periphery of the eyes.

  Note that the PC 21 can arbitrarily set whether or not to display the frames 71 and 72 as shown in FIG. 6 in the “driver face image” area 62 from the call executor via the operation unit 26. is there.

  As shown in FIG. 5, after the process of S86, the PC 21 starts displaying an image photographed by the video camera 23 in the “caller face image” area 64 of the monitor 25 (S87).

  Next, the PC 21 starts transmitting the sound acquired by the microphone 22 to the target client device and transmitting the image captured by the video camera 23 to the target client device (S88). As a result, the PC 41 of the target client device can output the sound acquired by the microphone 22 of the server device 20 to the speaker 44, and the image captured by the video camera 23 of the server device 20 on the monitor 45. Can be displayed.

  Next, the PC 21 determines whether or not the completion of the call is instructed until it is determined that the completion of the call is instructed (S89). The caller can instruct the server device 20 to complete the call by, for example, pressing a call completion button from the operation unit 26 of the server device 20.

  If the PC 21 determines in S89 that the completion of the roll call has been instructed, the PC 21 ends the communication with the target client device by transmitting an instruction to the target client device via the network 11 (S90), and is shown in FIG. End the process.

  As described above, the call system 10 outputs the sound received by the server device 20 from the client device 40 to the speaker 24, and displays the image received by the server device 20 from the client device 40 on the “driver's face” of the monitor 25. Since the image is displayed in the “image” area 62, the driver can confirm the state of the driver. Therefore, the call executor can advance the call while confirming the state of the driver and feeling the driver's physical condition from the driver's way of speaking, voice, complexion, and the like.

  Further, the call system 10 extracts a partial image of the driver's face from the image received by the server device 20 from the client device 40 and displays it in the “partial face image” area 63 of the monitor 25. It is possible to make the call executor confirm part of the face of the person more easily than before.

  Further, in the call system 10, the monitor 25 of the server device 20 displays the partial face image separately from the corresponding face image so as to be larger than the corresponding part in the facial image. Can be confirmed by the call executor, and a part of the driver's face can be easily confirmed by the call executor using the partial facial image displayed larger than the corresponding part of the face image. Can be made.

  In addition, since the face part image is an image including the driver's eyes, the call system 10 can display the driver's eyes that are likely to cause the driver's health to be noticeable to the caller by displaying the face part image. It can be easily confirmed. For example, the call executor can easily check the driver's eyes for redness by displaying a partial facial image. Redness of the eyes occurs due to various causes such as lack of sleep and eye strain.

  Moreover, since the partial call face image is an image including the periphery of the driver's eyes, the roll call system 10 is similar to the eyes, and the face around the driver's eyes where the driver's health condition is likely to appear remarkably appears. By displaying the partial image, the call executor can be easily confirmed. For example, the caller can easily confirm the bear under the driver's eyes by displaying the partial face image. Bears under the eyes are caused by various causes such as lack of sleep, artificial dialyzers and diabetes.

  In the above, the example in which the computer of the server device 20 and the client device 40 is configured by a PC has been described. However, at least one computer of the server device 20 and the client device 40 is configured by a computer other than the PC. Also good. For example, in the server device 20 and the client device 40, the computer may be configured by a mobile communication device such as a mobile phone, or an IP network camera / microphone terminal.

  In addition, the “partial face image” area 63 is included in the same window as the “driver information” area 61, the “driver face image” area 62, and the “caller face image” area 64 in the present embodiment. However, the window is included in a separate window from the window including the “driver information” area 61, the “driver face image” area 62, and the “caller face image” area 64. Also good. The “partial face image” region 63 changes in size in real time depending on the size and orientation of the driver's face in the “driver's face image” region 62, and is preferably included in an independent window.

  In addition, the face partial image displayed in the “partial face image” area 63 is an image including the periphery of the eyes of the driver in the present embodiment, but may be an image including only eyes. .

  In addition, the face partial image displayed in the “partial face image” area 63 is an image including the eyes of the driver in the present embodiment. As long as the health condition appears, it may be an image of a part other than the eyes. For example, the face partial image displayed in the “face partial image” area 63 may be an image of the driver's mouth. For example, a call executor can make the color of the driver's lips one of the criteria for determining the driver's health.

  Further, the PC 21 may adopt a method other than the method shown in the present embodiment as an image recognition method for extracting a partial face image from a face image.

  Further, in the present embodiment, the call system 10 is provided with the monitor 45 in the client device 40, but the monitor 45 may not be provided in the client device 40. For example, when the call executor and the driver talk directly at a short distance, it is mentally burdensome for the call executor and the driver that the call executor pays attention directly to the driver's eyes. By introducing the call system 10, the call executor can watch the driver's eyes on the monitor 25. In this case, the client device 40 only needs to include a video camera 43 and a communication member such as a cable for transmitting an image captured by the video camera 43 to the server device 20.

  In addition, the call system 10 is introduced by the carrier in the present embodiment, but the introducer is not limited to the carrier, and for example, it is also used by operators and passenger companies where the call is not required by law. Is possible.

  The to-be-called person is a driver in the present embodiment, but may be a person other than the driver. For example, the callee may be a vehicle conductor, guide, crew, or the like.

10 point call system 20 server device (call execution device)
21 PC (face partial extraction means)
25 Monitor (image display means)
27 Communication unit (image receiving means)
40 Client device (Dialed device)
43 Video camera (photographing means)
47 Communication unit (image transmission means)

Claims (4)

A call execution device used by a call execution person who makes a call, and a to-be-called device used by a callee who makes the call,
The to-be-called device includes image capturing means for capturing an image of the to-be-called person, and image transmitting means for transmitting an image captured by the image capturing means to the call executing device,
The call execution device includes: an image receiving unit that receives an image transmitted by the image transmitting unit; and a face partial image that is a partial image of the face of the callee from the image received by the image receiving unit A face part extracting means for extracting the image by image recognition, and an image display means for displaying the face part image extracted by the face part extracting means ,
The image display means displays a face image, which is an image including the face of the callee, separately from the face partial image, and enlarges the face partial image from a corresponding portion in the face image. A call system characterized by being displayed .   The call system according to claim 1, wherein the partial facial image is an image including the eyes of the callee.   3. The call system according to claim 2, wherein the partial face image is an image including a periphery of the eye of the callee.   An image capturing means comprising a call execution device used by a call executor for making a call and a to-be-call device used by a to-be-called person to which the call is made; A program for a call execution device for causing the call execution device of the call system to include the image transmission means for transmitting the image photographed by the image photographing means to the call execution device. ,
  An image receiving means for receiving an image transmitted by the image transmitting means, and a face for extracting a face partial image, which is a partial image of the face of the callee, from the image received by the image receiving means by image recognition The call execution device functions as a partial extraction means and an image display means for displaying a partial facial image extracted by the partial facial extraction means,
  The image display means displays a face image, which is an image including the face of the callee, separately from the face partial image, and enlarges the face partial image from a corresponding portion in the face image. A program for a call execution device characterized by being displayed.

Images