WO2024004291A1

WO2024004291A1 - Real-time video distribution system

Info

Publication number: WO2024004291A1
Application number: PCT/JP2023/010708
Authority: WO
Inventors: 健斗藤原; 良介工藤; 幸一品田
Original assignee: 株式会社カーメイト
Priority date: 2022-06-27
Filing date: 2023-03-17
Publication date: 2024-01-04
Also published as: JP2024003484A

Abstract

[Problem] To provide a real-time video distribution system that makes it possible for a plurality of terminals to perform two-way communication and makes it possible for environmental information including video to be distributed from a distribution-side terminal. [Solution] A real-time video distribution system characterized by having: an information acquisition terminal 12 having an imaging function and a function with which it is possible to acquire environmental information; a first communication terminal 14 that acquires data acquired via the information acquisition terminal 12, forms a shared screen image 18 for a call, displays the shared screen image 18 for a call on a display screen, and makes the shared screen image 18 for a call shareable; and a second communication terminal 16 that is connected to the first communication terminal 14 and makes it possible to show the shared screen image 18 for a call on a display screen, it being made possible for the first communication terminal 14 and the second communication terminal 16 to perform two-way communication in a state in which the shared screen image 18 is shown on the display screens.

Description

Real-time video distribution system

The present invention relates to video distribution technology, and particularly to a system suitable for distributing captured video in real time.

Due to the development of video technology and communication technology, in recent years, the technology for distributing captured video in real time has been increasing. For example, in the technology disclosed in Patent Document 1, an operating terminal and a field terminal are provided to enable video communication. The video communication device having such a configuration is configured such that images, sensor information, position information, etc. acquired by the field terminal by operations via the operating terminal can be viewed via the operating terminal. .

According to such technology, it becomes possible to grasp in real time images, sensor information, etc. acquired by on-site terminals via operation terminals. Therefore, the person operating the operating terminal can grasp the situation at the site without actually visiting the site.

However, with such technology, the distribution of video, audio, and other information is one-way, and information from the operating terminal cannot be acquired on the field terminal side. On the other hand, in a video call system such as that disclosed in Patent Document 2, two-way video calls are possible between a first user terminal and a second user terminal that are connected via a server.

However, in the technology disclosed in Patent Document 2, the data sent to both terminals is generally only video and audio captured by both terminals. For this reason, it becomes difficult for both terminals to grasp the situation in which the other terminal is placed. As described above, even though the technologies disclosed in Patent Document 1 and Patent Document 2 are both video distribution technologies, there are problems that cannot be compensated for by both techniques.

JP2022-34244A JP2022-87522A

Therefore, the present invention provides a real-time video distribution system that enables two-way communication between a plurality of terminals connected via a network, and also enables a distribution terminal to distribute environmental information including video. With the goal.

A real-time video distribution system according to the present invention for achieving the above object includes: an information acquisition terminal having an imaging function and a function capable of acquiring environmental information; forming a shared screen image for a call having a video display area for acquiring information and displaying the image, and an information display area for displaying at least a part of the environmental information as additional information; a first communication terminal capable of displaying video on a display screen and sharing the video of the shared call screen via a network; and a first communication terminal connected to the first communication terminal via the network, the shared screen for calls one or more second communication terminals that are capable of projecting video on a display screen, and the first communication terminal and the second communication terminal display the shared screen video for a call on their respective screens. The feature is that two-way communication is possible while the image is displayed on the display screen.

Furthermore, in the real-time video distribution system having the above characteristics, the information acquisition terminal is equipped with a GPS sensor, an acceleration sensor, and a timer, and the environmental information includes position information, speed information, and acceleration information. It is recommended that at least one of the following be included. With such features, the second terminal can not only simply view the video but also easily understand the situation in which the first terminal is placed.

Furthermore, in the real-time video distribution system having the above features, the information acquisition terminal may be equipped with a vehicle information input terminal to enable acquisition of vehicle information. With these features, when an information acquisition terminal is installed in a vehicle, it becomes possible to easily acquire vehicle information, and it is useful to understand the driving situation of the driver who owns the first terminal. It can be useful.

Furthermore, in the real-time video distribution system having the above characteristics, the environmental information includes map information that can be obtained via the first communication terminal, and the position information obtained based on the GPS sensor is It is desirable to reflect this in the map information and display it in the information display area. By having such characteristics, it becomes possible to easily understand where the video being distributed via the first terminal is.

According to a real-time video distribution system with the above characteristics, multiple terminals connected via a network can perform two-way communication, and the distribution terminal can also distribute environmental information including video. becomes. Therefore, the recipient terminal holder can easily grasp visually and intuitively the situation in which the transmitting terminal is located.

FIG. 1 is a block diagram illustrating an example configuration of a real-time video distribution system according to an embodiment. FIG. 7 is a diagram illustrating an example of a configuration of a shared screen image for a call in which map information and a current location are reflected in an information display area. FIG. 7 is a diagram illustrating an example of a configuration of a shared screen video for a call in which display information and divided areas are increased.

Hereinafter, embodiments of the real-time video distribution system of the present invention will be described in detail with reference to the drawings. It should be noted that the embodiments shown below are some of the preferred modes for carrying out the present invention, and even if a part of the configuration is changed, it does not constitute part of the present invention as long as the embodiment achieves the effect. It can be considered.

[composition]
First, with reference to FIG. 1, the configuration of a real-time video distribution system (hereinafter simply referred to as video distribution system 10) according to the present embodiment will be described. The video distribution system 10 according to this embodiment includes at least an information acquisition terminal 12, a first communication terminal 14, and a second communication terminal 16. The information acquisition terminal 12 is a terminal that plays the role of acquiring video and environmental information that can be recorded in association with the video. Here, the environmental information is, for example, position information, speed information, acceleration information, direction information, etc., and information that can be obtained secondarily based on these information (for example, current location information on map data based on position information). etc.) are also included. In this embodiment, the information acquisition terminal is fixed to the vehicle, and the configuration is such that vehicle information can also be acquired as part of the environmental information.

The information acquisition terminal 12 having such a function has at least an imaging means, a GPS sensor, an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, a timekeeping means, a vehicle information input terminal, a communication means, a storage means, a control means, etc. That's fine. Note that the communication means in the information acquisition terminal 12 may be any means capable of at least short-range communication, and does not necessarily need to be wireless communication. An example of a general-purpose product that has such a function and can be used as the information acquisition terminal 12 is a drive recorder.

Information input via the vehicle information input terminal includes engine ON/OFF signals, vehicle speed pulses, engine speed, reverse gear signals, parking brake signals, foot brake signals, turn signal signals, and door opening/closing signals. Any signal that instructs is sufficient, and each signal can be used to obtain environmental information.

In the information acquisition terminal 12 having such a configuration, various environmental information that can be acquired simultaneously when acquiring the video data is acquired together with the video data. The environmental information acquired simultaneously with the video data is sent to the first communication terminal 14 in association with the video data.

The first communication terminal 14 at least acquires the video data and environment information output from the information acquisition terminal 12, forms a shared screen image 18 for calls (see FIG. 2), and shares the video data for calls via the network. Any device may be used as long as it has a function to enable sharing of the screen image 18 and communication.

For this reason, although the specific configuration is not shown, the first communication terminal 14 is preferably equipped with at least a display screen, a calculation means, a storage means, a communication means, an operation means, etc., and is portable. Examples of general-purpose devices include high-performance mobile phones (so-called smartphones), tablet terminals, and notebook computers.

Here, the shared screen video 18 for a call is a video that follows a screen configuration for distribution that includes a video acquired via an information terminal and environmental information. As an example of the shared screen image 18 for a call, as shown in FIG. 2, at least an image display area 18a and an information display area 18b are provided. Here, the video display area 18a is an area for displaying photographed video data, and the information display area 18b is an area for displaying environmental information etc. associated with the video data. In the example shown in FIG. 2, map information is displayed in the information display area 18b, and the current position A is also displayed.

Note that when forming the shared screen image 18 for a call, the first communication terminal 14 may use external data to construct the environment information. For example, by associating the location information acquired via the information acquisition terminal 12 with map information that is external data and projecting the current location on the map, the current location information can be visualized as shown in FIG. good.

The first communication terminal 14 capable of executing such processing can share a shared screen image for a call with the second communication terminal 16 by using call software that uses a network, an online conference application, etc. It can be distributed (distributed). Further, the first communication terminal 14 can also make a call with the second communication terminal 16 while distributing the shared screen image 18 for a call to the second communication terminal 16 .

The second communication terminal 16 is connected to the first communication terminal 14 via a network, projects a shared screen image 18 for calls on the display screen, and enables calls with the first communication terminal 14. That's fine. Therefore, the basic configuration of the second communication terminal 16 can be the same as that of the first communication terminal 14. In the video distribution system 10 of FIG. 1, the first communication terminal 14 and the second communication terminal 16 are shown in a one-to-one relationship, but the video distribution system 10 according to the embodiment A configuration including a plurality of communication terminals 16, that is, a configuration including a plurality of second communication terminals 16 for one first communication terminal 14 may be used.

[Effect]
The video distribution system 10 configured as described above can be used in various ways, but as an example below, the information acquisition terminal 12 is mounted on a vehicle (not shown) and the driving status of the vehicle is distributed. An example of how to use this will be explained below.

(Video shooting/information acquisition)
In the video distribution system 10 according to the present embodiment, in preparation for system operation, the information acquisition terminal 12 and the first communication terminal 14 are connected by short-range wireless communication or wired communication, so that information can be transmitted. Further, the first communication terminal 14 and the second communication terminal 16 are connected via a network to enable so-called video calls such as online conferences.

Photographing is performed using the information acquisition terminal 12 in such a state. The photographing range is not limited, but may be, for example, the front and rear of the vehicle and the interior of the vehicle. Further, the information acquisition terminal 12 can acquire acceleration, angular velocity, position information, etc. in association with the video via sensors provided therein. Here, it is preferable to use time as a common item to associate various acquired information (environmental information). Further, if vehicle information is input to the information acquisition terminal 12, changes in vehicle speed, direction of travel, foot brake usage status, etc. can also be acquired in association with the video.

The video and various information acquired via the information acquisition terminal 12 are recorded on a storage medium within the information acquisition terminal 12 and are sequentially transmitted to one communication terminal.

(Screen formation)
The first communication terminal 14 creates a shared screen image 18 for a call based on the image and environmental information acquired via the information acquisition terminal 12.

(Screen distribution/call)
When the shared screen image 18 for a call is created by the first communication terminal 14, the first communication terminal 14 shares the shared screen image 18 for a call with the second communication terminal 16. As a result, the shared screen image 18 for calls displayed on the display screen of the first communication terminal 14 can also be viewed on the display screen of the second communication terminal 16. Here, the first communication terminal 14 and the second communication terminal 16 are in a state where they are sharing their screens in a so-called video call. Therefore, the first communication terminal 14 and the second communication terminal 16 can make a call while displaying the shared screen image 18 on each other's display screens.

Under such circumstances, the person holding the second communication terminal 16 can view the video and environmental information (included in the shared screen video 18 for calls) displayed on the display screen of the second communication terminal 16 at a remote location. However, it is possible to issue directions and driving instructions to the person holding the first communication terminal 14 (for example, a driver of a vehicle). Furthermore, since two-way communication is possible between the first communication terminal 14 and the second communication terminal 16, if the guidance or instructions from the second communication terminal 16 are difficult to hear or understand, the first Questions and answers can be asked via the communication terminal 14.

[effect]
According to the video distribution system 10 as described above, a plurality of terminals connected through a communication line enable two-way communication, and the distribution side terminal (first communication terminal 14) also distributes environmental information including video. things become possible. Therefore, on the second communication terminal 16 side that receives the shared screen video 18 for calls made up of real-time video and environmental information attached to the video, the location of the first communication terminal 14 (information acquisition terminal 12) is This makes it easier to understand the situation visually and intuitively.

On the other hand, from the second communication terminal 16, it is possible to talk to the first communication terminal 14 while viewing the shared screen image 18 for calls. Therefore, for example, when the person holding the first communication terminal 14 is driving the vehicle, it is possible to issue guidance or instructions to the person holding the first communication terminal 14 (driver) without being a passenger in the vehicle. becomes possible. Therefore, it can be used not only for navigation purposes, but also for preventing drowsy driving, wrong-way driving, or dangerous driving.

In the embodiment described above, when forming the shared screen image 18 for a call, the image display area 18a and the information display area 18b are divided, and the image and environment information are displayed in each area. However, each area (video display area 18a and information display area 18b) does not need to be completely divided. Specifically, as shown in FIG. 3, vehicle right/left turn information 18b1 may be displayed in a part of the video display area 18a. Furthermore, it is not necessary to divide the shared screen image 18 for calls into two areas (image display area 18a and information display area 18b), and the vehicle shift signal (P: parking, R: rear), brake ( B) An area (vehicle information area 18c) for displaying the presence or absence of a signal may be provided. In the example shown in FIG. 3, vehicle speed information is also displayed in the information display area 18b in addition to map information and current location information.

Further, in the embodiment described above, the information acquisition terminal 12 is attached to the vehicle, and the driving status of the person who owns the first communication terminal 14 is distributed to the person who owns the second communication terminal 16, and the driving status of the person who owns the first communication terminal 14 is distributed to the person who has the second communication terminal 16. I explained that I would be making a call to the other side. However, in the video distribution system 10 according to the present invention, the person who holds the first communication terminal 14 may hold the information acquisition terminal 12. If the person holding the information acquisition terminal 12 is a worker at a construction site, the person holding the second communication terminal 16 will be able to grasp the work situation and work environment and give instructions to the person holding the first communication terminal 14 for various tasks. It becomes possible to issue instructions, and it also becomes possible to notify the worker (the person holding the first communication terminal 14) of dangers that they are unaware of while viewing the shared screen image 18 for calls.

In addition, when the person holding the first communication terminal 14 and the information acquisition terminal 12 searches a mountain forest, etc., the person holding the second communication terminal 16 who has viewed the shared screen image 18 for a call can check the location of interest. It is also possible to give instructions to search for.

10...Video distribution system, 12...Information acquisition terminal, 14...First communication terminal, 16...Second communication terminal, 18...Shared screen video for calls, 18a...Video display Area, 18b... Information display area, 18b1... Right/left turn information, 18c... Vehicle information area.

Claims

an information acquisition terminal having an imaging function and a function capable of acquiring environmental information;
It has a video display area that acquires video and environmental information acquired via the information acquisition terminal and displays the video, and an information display area that displays at least a part of the environmental information as additional information. a first communication terminal that forms a shared screen image for a call, displays the shared screen image for a call on a display screen, and allows the shared screen image for a call to be shared via a network;
one or more second communication terminals connected to the first communication terminal via the network and capable of projecting the shared screen image for a call on a display screen;
Real-time video distribution characterized in that the first communication terminal and the second communication terminal are capable of two-way communication while displaying the shared screen image for communication on their respective display screens. system.
The information acquisition terminal is equipped with a GPS sensor, an acceleration sensor, and a timer,
The real-time video distribution system according to claim 1, wherein the environmental information includes at least one of position information, speed information, and acceleration information.
3. The real-time video distribution system according to claim 2, wherein the information acquisition terminal is equipped with a vehicle information input terminal to enable acquisition of vehicle information.
The environmental information includes map information that can be acquired via the first communication terminal, and position information acquired based on the GPS sensor is reflected in the map information and displayed in the information display area. The real-time video distribution system according to claim 2 or 3, characterized in that: