JP2021026442A - Information processing device, system, information processing method, and program - Google Patents

Abstract

To protect information from peeping in presenting the information in a movable body.SOLUTION: An information processing device includes: positional relation acquisition means for acquiring relative positional relation between a first movable body and an other movable body existing around the first movable body; attribute acquisition means for acquiring an attribute corresponding to the degree of secrecy of information that can be outputted by a display device provided in the first movable body; and visibility change means for changing visibility of the information outputted by the display device. The visibility change means changes the visibility of the information according to the relative positional relation and the degree of secrecy based on the attribute of the information.SELECTED DRAWING: Figure 3

Description

The present disclosure relates to information processing devices, systems, methods and programs provided in a moving body, and more particularly to information processing devices, systems, information processing methods and programs that change the visibility of displayed images.

Traditionally, proposals have been made regarding security level control. For example, Patent Document 1 (Japanese Unexamined Patent Publication No. 2009-116512) discloses a system that prevents a visitor from seeing confidential information when the visitor approaches a computer terminal in a room. Patent Document 2 (Japanese Unexamined Patent Publication No. 2008-9615) discloses a device for setting a security level for vehicle theft prevention based on sensing data of the surrounding environment of the vehicle.

Japanese Unexamined Patent Publication No. 2009-116512 Japanese Unexamined Patent Publication No. 2008-9615

In recent years, work styles that are mainly teleworked and are not limited to places have been recommended. At the time of teleworking, the user displays confidential company information on the display to perform the work, but it is necessary to implement security management so that the displayed information is not snooped (sniffed) by a third party.

As a form of telework, a mobility as a service (MaaS) that can be used for multiple purposes such as mobility, logistics, and product sales, and a concept model using an electric vehicle have been proposed. When the above teleworking is carried out in a vehicle of such a model, it is necessary to protect the information from peeping by a third party including the driver of another vehicle.

However, although Patent Documents 1 and 2 disclose a technique for managing the security level, the information displayed on the display in a moving body such as a vehicle is snooped by a third party including a person in another vehicle. We have not proposed a technology to protect from the above, and cannot meet the above needs.

An object of the present disclosure is to provide information processing devices, systems, information processing methods and programs capable of protecting information from peeping when presenting information in a moving body.

The information processing device according to the present disclosure includes a positional relationship acquisition means for acquiring a relative positional relationship between another moving body existing around the first moving body and the first moving body, and a display device provided in the first moving body. The visibility changing means includes an attribute acquiring means for acquiring attribute information indicating the sensitivity of information that can be output by the display device and a visibility changing means for changing the visibility of the information output by the display device. The visibility is changed according to the relative positional relationship and the density indicated by the attribute information of the information.

In the above disclosure, the relative positional relationship includes the distance from the first moving body to the other moving body and the direction of the other moving body from the first moving body.

In the above disclosure, the relative positional relationship further includes the degree to which the other mobile is close to the first mobile.

In the above disclosure, the other moving object further includes an external camera that includes a person and images the surroundings, and a means for detecting the line of sight of the person from the image of the person included in the image captured by the external camera. The information processing device acquires the degree of possibility that the information output by the display device is visually recognized from the line of sight of a person, and the visibility changing means further determines the visibility of the information, the relative positional relationship, and the sensitivity. And change according to the degree of possibility of being seen.

In the above disclosure, the degree of likelihood of being visible is based on the time a person stares at the first moving object and the frequency with which the person's line of sight to the first moving object is detected.

In the above disclosure, the change in the visibility of the information output by the display device includes the change in the output mode of the information.

In the above disclosure, a plurality of display devices are provided in the first moving body, and the change of the output mode includes switching of the display devices for outputting information.

In the above disclosure, a display device that outputs information is determined from among the plurality of display devices based on the orientation and relative positional relationship of each of the plurality of display devices.

In the above disclosure, an internal camera for photographing the inside of the first moving body is further provided, and the orientation of each display device is detected from the image captured by the internal camera.

In the above disclosure, the relative positional relationship includes the distance from the first moving body to the other moving body and the direction of the other moving body from the first moving body, and the orientation of each display device is the display device. Among the display devices including the orientation of the screen provided in the above, a display device whose screen orientation is different from the direction from the first moving body of another moving body is determined as a display device for outputting information.

In the above disclosure, the orientation of each user is detected from the images of one or more users in the first moving body taken by the internal camera, and based on the orientation of each display device, the relative positional relationship, and the orientation of each user. Determine the display device to output the information.

In the above disclosure, among a plurality of display devices, a display device whose screen orientation is different from the orientation of another moving object from the first moving object and whose orientation of one or more users faces the screen. Determined as a display device that outputs information.

In the above disclosure, the change in the output mode includes the change in the brightness of the information output by the display device.

In the above disclosure, the first moving body is provided with an image processing device for printing information, and the change in the output mode includes printing the information by the image processing device.

In the above disclosure, the first moving body comprises a window, and the visibility changing means changes the transmittance of the window glass according to the relative positional relationship and the density based on the attribute of information.

In the above disclosure, a sensor that senses other moving objects in the vicinity is provided, and the positional relationship acquisition means has a relative positional relationship from the position information received from the server that manages the position of each moving object or the output of the sensor. To get.

In the above disclosure, visibility includes the ease with which information output from another moving body by the display device in the first moving body can be visually grasped.

The system according to the present disclosure includes a server that manages the position of the mobile body and an information processing device provided in the first mobile body that communicates with the server, and the information processing device exists in the vicinity of the first mobile body. Attribute to acquire the attribute corresponding to the sensitivity of the information that can be output by the positional relationship acquisition means for receiving the relative positional relationship between the other moving body and the first moving body from the server and the display device provided in the first moving body. The visibility changing means includes an acquisition means and a visibility changing means for changing the visibility of the information output by the display device, and the visibility changing means determines the visibility of the information based on the relative positional relationship and the attributes of the information. Change according to.

The information processing method according to the present disclosure is an information processing method executed by a computer, and includes a step of acquiring a relative positional relationship between another moving body existing around the first moving body and the first moving body, and a first step. (1) The visibility is changed by including a step of acquiring attribute information indicating the sensitivity of information that can be output by a display device provided in the moving body and a step of changing the visibility of the information output by the display device. In the step, the visibility of the information is changed according to the relative positional relationship and the sensitivity indicated by the attribute information of the information.

The present disclosure provides a program for causing a computer to execute the above information processing method.

According to the present disclosure, when presenting information in a moving body, the information can be protected from peeping.

It is a figure which shows typically the vehicle 100 which includes the information processing apparatus 30 which concerns on this embodiment, and the surrounding environment. It is a figure which shows an example of the hardware composition of the information processing apparatus 30 which concerns on this embodiment. It is a figure which shows typically the module structure which the information processing apparatus 30 which concerns on this embodiment includes. It is a figure which shows typically an example of the density table 620 which concerns on this Embodiment. It is a figure which shows typically an example of the leakage possibility table 630 which concerns on this embodiment. It is a figure which shows typically an example of the image file 640 which concerns on this Embodiment. It is a figure which shows typically an example of the index value table 650 which concerns on this embodiment. It is a flowchart which shows an example of the process which concerns on this Embodiment. It is a flowchart which shows an example of the process which concerns on this Embodiment. It is a figure which shows typically an example of the interior of the vehicle 100 which concerns on this embodiment. It is a figure which shows typically the state which the visibility was adjusted in (the first case) which concerns on this embodiment. It is a figure which shows the other example of the interior of the vehicle 100 which concerns on this embodiment schematically. It is a figure which shows typically the state which the visibility was adjusted in (the second case) which concerns on this embodiment. It is a figure which shows the other example of the interior of the vehicle 100 which concerns on this embodiment schematically. It is a figure which shows typically the state which the visibility was adjusted in (the third case) which concerns on this embodiment. It is a figure which shows the structure of the network system which includes the information processing apparatus 30 which concerns on this embodiment. It is a figure which shows typically an example of the hardware configuration of the management server 710 which concerns on this Embodiment.

Embodiments of the present invention will be described in detail with reference to the drawings. The same or corresponding parts in the drawings are designated by the same reference numerals and the description thereof will not be repeated.

<Overview>
FIG. 1 is a diagram schematically showing a vehicle 100 including the information processing device 30 according to the present embodiment and its surrounding environment. In the present embodiment, the "moving body" may include at least one of a vehicle, a bicycle, a robot, a personal mobility, a person (an occupant 111 described later), and the like. The vehicle 100 is an embodiment of the "first mobile body". The information processing device 30 is an embodiment of the "information processing device", and is realized by using, for example, hardware (for example, a general-purpose computer) that follows a general-purpose architecture. Hereinafter, the information processing device 30 is also abbreviated as the device 30.

The present embodiment can be applied to, for example, a case where a user works by using the inside of a moving body during automatic driving as a mobility office. Specifically, the vehicle 100 corresponding to the "first moving body" basically corresponds to public transportation like a taxi, and is automatically driven unmanned. In the case of automatic driving, when the user sets the destination to the device 30 by operating the operation panel in the car, the voice input unit (microphone), the user's mobile terminal, etc. at the time of boarding, the automatic driving starts toward the destination. Will be done.

With reference to FIG. 1, one or more vehicles 110 travel around the vehicle 100. In the same lane as the vehicle 110, the vehicle 110 runs in front of and behind the vehicle 100, respectively, and the vehicle 110 of the auto bai runs in the lane adjacent to the vehicle 100. The vehicle 110 is boarded by an occupant 111 such as a driver, but the occupant 111 is not limited to the driver and includes other passengers. The vehicle 100 and the vehicle 110 according to the embodiment may be unmanned autonomous vehicles. Further, the road on which the vehicle 100 travels may be a two-way road with one lane on each side, and the type of road on which the vehicle 100 travels is not limited.

The vehicle 100 provides a mobility office, which is an office environment constructed in a movable vehicle, and a device 30 mainly controls the mobility office. By using the mobility office, the user can perform work (telework) such as a meeting in the vehicle while moving in the vehicle 100. The work carried out in the mobility office is not limited to meetings.

When a conference is held in the vehicle 100, the device 30 displays information such as conference materials as images (pictures, characters, videos (moving images, still images), etc.) on the display 372 provided in the vehicle 100. .. Since the image displayed on the display 372 is visible from another moving body (such as another vehicle 110 or its occupant 111) through the window 378 of the vehicle 100, there is a risk that the information will be peeped. In this embodiment, the display 372 may also include a display (such as a screen) on which an image is displayed by a projector.

Therefore, in the present embodiment, the device 30 acquires information on the relative positional relationship between the self-moving body and another moving body existing around the self-moving body (vehicle 100) (step R1), and displays 372 on the display 372. Attribute information indicating the degree of confidentiality, which is an attribute of the displayed information, is acquired (step R2), and is displayed on the display 372 according to the acquired relative positional relationship and the sensitivity indicated by the attribute information. The visibility of the information to be displayed is changed (step R3).

For example, when the information displayed on the display 372 can be viewed from the outside through the window 378, the device 30 reduces the visibility of the displayed information based on the relative positional relationship and the density. .. As a result, it is possible to avoid the risk that the information displayed on the display 372 is snooped (sniffed) by another moving body outside through the window 378.

In the present embodiment, visibility represents a concept that expresses the ease with which information can be visually perceived (or confirmed). More specifically, this visibility provides information displayed from the outside of the self-moving body (for example, outside the vehicle) by a third party (such as the occupant 111 of another moving body) inside the self-moving body (for example, inside the vehicle). Shows a concept that expresses the ease that can be visually perceived. When this visibility is reduced, the readability or readability is also reduced, so that the information can be effectively protected from peeping.

Specific examples will be described below.
<Hardware configuration of information processing device 30>
FIG. 2 is a diagram showing an example of the hardware configuration of the information processing apparatus 30 according to the present embodiment. With reference to FIG. 2, the device 30 may be connected to the travel control system 50 for controlling the travel of the vehicle 100 via the communication interface 40. Since the travel control system 50 has a well-known configuration such as including a drive mechanism for a wheel motor, detailed description will not be repeated. Here, the device 30 is configured to be communicable with the travel control system 50, but may be configured standalone without communicating with the travel control system 50.

The device 30 includes a CPU (Central Processing Unit) 300, a storage device for storing programs and data, a memory interface 340, a GPS (Global Positioning System) receiver 350, a network interface 360, and a communication circuit 370. The storage device includes an HDD (Hard Disk Drive) 310, a ROM (Read Only Memory) 320, and a RAM (Random Access Memory) 330.

The CPU 300 expands the program stored in the storage device into the RAM 330, and controls each unit by executing the expanded program.

The memory interface 340 includes a driver circuit to which the storage medium 345 is detachably mounted and reads data or a program from the mounted storage medium 345 or writes data or a program to the storage medium 345. The storage medium 345 transfers the information of the program or the like electrically, magnetically, optically, mechanically or chemically so that the CPU 300, other devices, the machine or the like can read the information of the program or the like recorded therein. It is a medium that accumulates by the action.

The GPS receiver 350 detects the position of the vehicle 100 by receiving a signal from the GPS satellite 700, which will be described later, and executing a given calculation using the signal. The GPS receiver 350 outputs the detected position information to the CPU 31.

The network interface 360 is configured to include a circuit that controls communication between an external network including the Internet and the device 30, for example, a NIC (Network Interface Card).

The network interface 360 receives content 610 including information that can be displayed on the display 372 from an external server or the like. Attribute information 609 indicating the sensitivity of the content is added to the content 610. Specifically, in the present embodiment, the user connects to the server in the user's company via the device 30 by VPV (Virtual Private Network) or the like, and obtains the necessary content 610 from the server in the company to which the user is connected. The selected content 610 is downloaded to the user terminal 371 or the like via the VPN and the network interface 360 of the device 30, and the downloaded content 610 is displayed on the display 372. The acquisition route of the content 610 is not limited to the route via the device 30. For example, the user terminal 371 may wirelessly communicate with the company server without going through the device 30, and the content 610 may be downloaded from the company server to the user terminal 371.

Further, in the present embodiment, the above-mentioned external server may include a Web server. In that case, the content 610 may include information on the Web page.

The communication circuit 370 is a circuit for the device 30 to communicate with a peripheral device described later. For example, the communication circuit 370 connects peripheral devices to the device 30 via various networks 900 including wired or wireless such as Ethernet (registered trademark), (wifi (registered trademark), Bluetooth (registered trademark).

<Module configuration of information processing device 30>
FIG. 3 is a diagram schematically showing a module configuration included in the information processing apparatus 30 according to the present embodiment. With reference to FIG. 3, as peripheral devices of the device 30, the CPU 300 includes external cameras 3741, 3742, 3743 capable of photographing the external periphery of the vehicle 100, an in-vehicle camera 375 capable of photographing the inside of the vehicle 100, and peripherals of the vehicle 100. One or more proximity sensors 376, a display 372, a polarization adjusting device 373 that adjusts the amount of incident light from the window 378 into the vehicle, a user terminal 371 such as a computer carried by a user in the vehicle 100, a printer, or It includes an MFP (Multi-Function Peripherals) 377 which is a copier or a multifunction device thereof. The MFP 377 is an embodiment of an image processing device that prints out information (content 610) displayed on the display 372. The proximity sensor 376 detects the distance and direction between the self-moving body (vehicle 100) and another moving body, and outputs the detected distance and direction. The detected directions may include forward (traveling direction), rearward (opposite the traveling direction), right side, and left side with respect to the direction of the vehicle 100 (that is, the direction corresponding to the traveling direction).

The CPU 300 exchanges information (data or signals) with these peripheral devices via the communication control unit 420 corresponding to the communication circuit 370. The device 30 receives a user operation on the device 30 and operates according to a command indicated by the received user operation. In the present embodiment, the device 30 receives a user operation via an input device (not shown), but can also receive a command based on the user operation via communication with the user terminal 371. When the user is operated from the user terminal 371, the device 30 can be operated by displaying the desktop screen of the device 30 on the user terminal 371. Although the external cameras 3741, 3742, and 3743 have different mounting positions (that is, the imaging range), they have the same functions. Therefore, when they are not distinguished, they are collectively referred to as the external cameras 374. The number of in-vehicle cameras 375 is not limited to one, and may be a plurality of cameras having different mounting positions (that is, imaging ranges).

The outside camera 374 and the inside camera 375 are configured to include, for example, a CCD (Charge Coupled Device). These cameras may be 3D cameras. The proximity sensor 376 includes, for example, a photoelectric sensor. The display 372 includes, for example, a liquid crystal display.

Various programs and data are stored in the storage unit 500 included in the device 30 so that the CPU 300 can access (read / write). The storage unit 500 includes at least one of HDD 310, ROM 320, RAM 330, and storage medium 345. The storage unit 500 includes a system program 400 including an OS (Operating System) and an application program 501 executed by the CPU 300 under the system program. The application program 501 includes a density acquisition program 510, a proximity detection program 511, a camera image analysis program 512, a moving object tag generation program 513, a relative positional relationship calculation program 514, a drawing program 516, an image output control program 517, and an adjustment method determination. Includes program 518 and transmission control program 519.

The storage unit 500 further includes a density table 620, a leakage possibility table 630, an image file 640, and an index value table 650.

When the CPU 300 executes each program of the application program 501, a module corresponding to the program is realized. For example, as modules, the density acquisition unit 410 corresponding to the density acquisition program 510, the proximity detection unit 411 corresponding to the proximity detection program 511, the camera image analysis unit 412 corresponding to the camera image analysis program 512, and the moving object tag. The moving body tag generation unit 413 corresponding to the generation program 513, the relative positional relationship calculation unit 414 corresponding to the relative positional relationship calculation program 514, the line-of-sight detection unit 415, the drawing unit 416 corresponding to the drawing program 516, and the image output control program 517. The corresponding image output control unit 417, the adjustment method determination unit 418 corresponding to the adjustment method determination program 518, and the transmission rate control unit 419 corresponding to the transmission rate control program 519 are included. The relative positional relationship calculation unit 414 is an embodiment of the “positional relationship acquisition means”. The CPU 300 has a processing unit 430 including a mobile tag generation unit 413, a relative positional relationship calculation unit 414, and a line-of-sight detection unit 415.

The drawing unit 416 receives the content 610 specified by the user from the user terminal 371 or the like via the communication control unit 420, and generates drawing data for displaying the image representing the received content 610 on the display 372. The image output control unit 417 generates display control data 615 that controls the display 372 based on the drawing data from the drawing unit 416, and outputs the display control data 615 to the display 372 via the communication control unit 420. As a result, the display 372 displays the image of the content 610 according to the display control data 615.

The camera image analysis unit 412 includes a first analysis unit 41 that analyzes an image from the outside camera 374 and a second analysis unit 42 that analyzes an image from the in-vehicle camera 375. The camera image analysis unit 412 outputs the image analysis result to the processing unit 430. The image analysis process will be described later.

The proximity detection unit 411 determines the proximity, which is the degree of proximity of other moving objects in the vicinity to the vehicle 100, from the output of the proximity sensor 376. For example, the proximity detection unit 411 compares the distance to other moving objects in the vicinity output from the proximity sensor 376 with the threshold value, and detects that the proximity is high when the comparison result indicates (distance <threshold value). If not, the proximity is detected as low.

The moving body tag generation unit 413 inputs an image of the moving body captured when it is determined that the proximity is high among the images of the moving body output from the first analysis unit 41 of the camera image analysis unit 412. , Generates a tag 642, which will be described later, for identifying the image. The mobile tag generation unit 413 generates a tag 642 for each feature amount of the image input from the first analysis unit 41. As a result, the mobile tag generation unit 413 can assign the same tag 642 to each image group having the same or similar feature amount.

The relative positional relationship calculation unit 414 acquires the relative positional relationship 612 between the moving body (that is, another moving body existing around the vehicle 100) determined by the proximity detection unit 411 to have a high proximity and the own vehicle 100. To do. In the present embodiment, the relative positional relationship includes the distance from the vehicle 100 to the other moving body and the direction of the other moving body from the vehicle 100.

The density acquisition unit 410 is an embodiment of the “attribute acquisition means”. The machine density acquisition unit 410 acquires the attribute information 609 indicating the machine density of the content 610 displayed on the display 372 by the drawing unit 416, and acquires the machine density 611 from the acquired attribute information 609. Specifically, for example, when the device 30 opens (displays) the content 610 with the corresponding application by user operation, the density acquisition unit 410 is a machine added in advance in the header of the opened content 610. Attribute information 609 (flag, etc.) indicating the density is acquired, and the level (degree) of the density 611 in FIG. 4 described later is determined from the attribute information 609. Alternatively, the sensitivity acquisition unit 410 analyzes the file name of the opened content 610, and based on the analysis result, the attribute information 609 indicating the sensitivity included in the file name (for example, "confidential" or "secret", etc. (Character string) is extracted, and the level of sensitivity is determined from the extracted attribute information 609.

The adjustment method determination unit 418 adjusts the visibility of the content 610 (information) displayed on the display 372. The adjustment of visibility includes switching of an information display device (display 372). The visibility is also adjusted according to the density 611 from the density acquisition unit 410 and the relative position 612 from the relative position calculation unit 414 to adjust the visibility of the content 610 (information) displayed on the display 372. The adjustment amount 613 for the determination is determined, and the determined adjustment amount 613 is output.

The image output control unit 417 changes the brightness of the image according to the adjustment amount 613 from the adjustment method determination unit 418, and generates and outputs display control data 615 for displaying the image having the changed brightness. Further, the transmittance control unit 419 determines the light transmittance 614 according to the adjustment amount 613 from the adjustment method determination unit 418, and outputs the light transmittance to the polarization adjusting device 373 via the communication control unit 420. The polarization adjusting device 373 operates so as to adjust the amount of incident light according to the transmittance 614, and the adjusting method will be described later. In this way, according to the density 611 and the relative positional relationship 612, the brightness of the image displayed on the display 372 is reduced to darken the image, or the amount of incident light from the outside to the inside of the vehicle is reduced through the window 378. Is possible. As a result, it is possible to prevent the content 610 (information) displayed on the display 372 in the vehicle from being peeped from another moving body through the window 378.

Instead of adjusting the brightness of the display image of the display 372, the brightness of the screen of the display 372 itself may be adjusted according to the adjustment amount 613, or may be adjusted by a combination of both. The brightness is changed to prevent peeping, but the changed brightness is such that the user in the vehicle 100 can visually recognize the display information on the display 372.

FIG. 3 shows a configuration example in which necessary functions are provided by the CPU 300 executing a program, and some or all of these provided functions are provided by a dedicated hardware circuit (for example, an ASIC (for example)). It may be implemented using Application Specific Integrated Circuit) or FPGA (Field-Programmable Gate Array). Alternatively, the main part of the device 30 may be implemented using hardware that follows a general-purpose architecture. In this case, virtualization technology may be used to execute a plurality of OSs having different uses in parallel, and to execute a necessary program on each OS.

<Example of density table 620>
FIG. 4 is a diagram schematically showing an example of the density table 620 according to the present embodiment. With reference to FIG. 4, the density table 620 has a degree indicated by the machine density 611 and a transmittance 614 corresponding to each degree. For example, if the density 611 is "top secret", the transmittance 614 indicates "0%" at which the amount of incident light is zero, and if the density 611 is "none", the transmittance 614 is the amount of incident light. Indicates an appropriate "50%". In this way, the transmittance 614 is set so that the amount of incident light decreases as the density 611 increases.

In the present embodiment, the default value of the transmittance 614 is not limited, but is set to, for example, 50%. The default transmittance 614 indicates a value that allows other moving objects to fully see the interior of the vehicle 100 through the window 378.

<Example of leak possibility table 630>
FIG. 5 is a diagram schematically showing an example of the leakage possibility table 630 according to the present embodiment. With reference to FIG. 5, the leakage possibility table 630 is referred to for determining the possibility of information leakage by peeping at the information displayed on the display 372 from another mobile body. Specifically, the leak possibility table 630 includes one or more indexes 631 for determining the possibility and an additional value 632 for calculating the index value corresponding to each index 631.

The index 631 is an index indicating the degree to which other moving bodies in the vicinity are approaching the self-moving body. For example, the relative speed of the vehicle 100 with the other moving body is low (for example, the relative speed is a threshold value (1 km / km / km / km). Includes an index 6311 indicating time) and an index 6312 indicating time when the relative distance of the vehicle 100 to another moving body is short (for example, the relative distance is equal to or less than a threshold (2 meters)). Further, the index 631 is an index indicating the degree of possibility that the information displayed on the display device of the self-moving body is visually recognized by the other moving body, for example, the other moving body (passenger of another vehicle). An index 6313 indicating the time when the own vehicle 100 was stared (continued), and the frequency (the number of times the other moving object saw the own vehicle 100 or the number of times the vehicle was seen per unit time), that is, the other. Includes an index 6314 indicating the frequency with which the line of sight of the moving body 100 is detected.

The addition value 632 indicates a value cut up by the line-of-sight detection unit 415 in order to calculate the corresponding index 631. According to these addition values 632, for example, the index 6311 is calculated by adding 2 every minute when the relative speed is low. The index 6312 is calculated by adding 5 every minute when the relative distance is short. The index 6313 is calculated by adding 10 every minute of the gaze time. The index 6314 is calculated by adding 1 each time a line of sight from another moving body to the own vehicle 100 is detected.

The threshold value and the added value (value to be counted up and interval of count-up) shown in FIG. 5 are examples and are variable. The device 30 sets these values, for example, based on a user operation on the device 30.

<Image analysis processing>
The first analysis unit 41 of the camera image analysis unit 412 extracts a predetermined feature amount from the image output from the external camera 374. The predetermined feature amount is a unique feature amount possessed by the image of another moving object as the subject, for example, the license plate number, the body color, the body design, and the face of the occupant 111 (entire face, face portion). (Eyes, nose, mouth, etc.)) features are included. The first analysis unit 41 outputs the image output from the external camera and the extracted feature amount for each of the external cameras 3741 to 743. The process of extracting a predetermined feature amount from an image can be realized by, for example, pattern matching.

The second analysis unit 42 of the camera image analysis unit 412 extracts a predetermined feature amount from the image output from the in-vehicle camera 375. The predetermined feature amount is the feature amount of each display, each user, and each window image extracted from the image, for example, the position and screen orientation of each display, the position and face orientation of each user, and each. Includes window position and orientation, etc. The process of extracting a predetermined feature amount from an image can be realized by, for example, pattern matching. The second analysis unit 42 constructs a three-dimensional virtual space corresponding to the inside of the vehicle from the image output from the in-vehicle camera 375, and in the three-dimensional virtual space, the position of the display and the orientation of the screen, the position of the user and the orientation of the face, And the feature quantity indicating the position and orientation of the window is extracted as, for example, three-dimensional coordinates or a three-dimensional vector.

The second analysis unit 42 detects the position and orientation of each display and the position and orientation of each window from the captured image of the in-vehicle camera 375, but the detection method is not limited to this. For example, if the layout of the equipment and windows in the vehicle is fixed, the second analysis unit 42 may acquire the position and orientation of each display and the position and orientation of each window from this layout information.

<Example of image file 640>
FIG. 6 is a diagram schematically showing an example of an image file 640 according to the present embodiment. With reference to FIG. 6, the image file 640 stores a plurality of images 643 of other moving objects taken by the external camera 374 in chronological order according to the captured time t. In the image file 640, the plurality of images 643 are each classified into one or more groups consisting of one or more images 643. Each group of images includes images with the same or similar features. Each image group is assigned a tag 642 for identifying the image group and a flag 641 indicating whether or not to discard the image group. When flag 641 indicates 0, it indicates that the group of corresponding images 643 has been discarded, and when it indicates 1, it indicates that the group of corresponding images 643 has been retained. In the present embodiment, the destruction of the image 643 indicates that the image 643 is excluded from the target image for determining the leakage possibility 654, and the retention of the image 643 means that the image 643 is leaked. Indicates that 654 can be referenced to determine.

In FIG. 6, for example, the image 643 whose tag 642 indicates TAGi is changed from holding on the left side of FIG. 6 to discarding on the right side by rewriting the corresponding flag 641 from 1 to 0.

<Example of index value table 650>
FIG. 7 is a diagram schematically showing an example of the index value table 650 according to the present embodiment. With reference to FIG. 7, the index value table 650 corresponds to each of the tags 642 and has the index 6311, the index 6312, the index 6313 and the index 6314 and the leak potential calculated according to the leak potential table 630 of FIG. Each value of 654 is stored. In the present embodiment, the leakage possibility degree 654 corresponding to the tag 642 is set based on, for example, the total value of the corresponding indexes 6311 to 6314. For example, the leakage probability 654 for tags 642 having a total value of 20 or more is set to "high", and if it is less than 20, it is set to "low".

The leakage possibility degree 654 can also be calculated from at least the total value of the index 6311 and the index 6312, which indicate the degree to which other moving bodies in the vicinity are approaching the self-moving body. In the present embodiment, the leakage possibility degree 654 is an index 6311 to 6314 including the indexes 6313 and 6314 indicating the degree of possibility that the information displayed on the display device of the own moving body is visually recognized from other moving bodies. By deriving from the total value of, it becomes possible to obtain a more reliable leakage probability 654.

<Example of adjusting window transmittance>
A method of adjusting the amount of incident light according to the transmittance 614 by the polarization adjusting device 373 will be described. In the present embodiment, the window 378 includes a windshield provided in front of the vehicle 100, a rear glass provided in the rear, a left side glass on the left side, and a right side glass on the right side. Each of these glasses is a dimming glass provided between the inside of the vehicle 100 and the outside of the vehicle. For example, a dimming glass provided with a liquid crystal film (not shown) configured to include two electrodes and a liquid crystal layer inserted between the two electrodes is used. Such dimming glass is well known, and the light transmittance is controlled by changing the light distribution property of the liquid crystal molecules according to the applied voltage. That is, the polarization adjusting device 373 controls the transmittance of the glass of the window 378 by controlling the voltage output to the liquid crystal layer according to the transmittance 614. The polarization adjusting device 373 can individually adjust the transmittance of each of the windshield, the left side glass, the right side glass and the rear glass. As a result, it is possible to reduce the amount of incident light from the outside to the inside of the room through the window 378, and it is possible to prevent the inside of the room from being peeped by other moving objects.

<Example of calculation of relative velocity>
In the present embodiment, the relative positional relationship calculation unit 414 calculates, for example, the relative speed of the other moving body with respect to the own vehicle 100 from the time-series image 643 of the other moving body taken by the external camera 374. .. By processing the time-series image 643, a well-known method can be applied to the calculation of the moving speed of the image, that is, the moving speed of another moving body, and thus the description is not repeated here.

<Example of detection of line of sight and gaze time>
The line-of-sight detection unit 415 detects the line of sight of the subject based on the image 643 taken by the external camera 374. Specifically, the subject area is extracted from the image 643, and the eye area and the pupil area are extracted from the subject area. The line of sight is detected from the positional relationship of the pupil region with respect to the eye region. The pupil region is divided into three regions of left, middle, and right in the horizontal direction, and it is determined which of the three divided regions the pupil region exists in. If the pupil area is in the left split area of the eye area, the right line of sight is detected, and if the pupil area is in the split area in the eye area, the front line of sight is detected. However, if the pupil region exists in the right division region of the eye region, the line of sight to the left is detected. The line-of-sight detection unit 415 outputs the detected line-of-sight information. The method of detecting the line of sight is not limited to this.

When the processing unit 430 determines that the line of sight is in the front direction based on the output of the line-of-sight detection unit 415, that is, the line of sight of another moving body is directed to the own vehicle 100, the processing unit 430 determines the duration of the line of sight in the front direction. By counting, the gaze time of the index 6313 is measured. In the present embodiment, the line of sight of the other moving body (that is, the occupant 111 of the vehicle 110) in the front direction is referred to as "detecting the line of sight of the other moving body".

<Example of processing flowchart>
8 and 9 are flowcharts showing an example of the processing according to the present embodiment. These flowcharts are stored in the storage device as a program, read from the storage device by the CPU 300, and executed. The program is repeatedly executed at a predetermined cycle.

With reference to FIGS. 8 and 9, the following third process is performed as a process related to visibility control based on the position of the display for displaying information on the vehicle 100 and the relative positional relationship between the other moving body and the own vehicle 100. The first case to the fourth case of 1 will be described.

FIG. 10 is a diagram schematically showing an example of the interior of the vehicle 100 according to the present embodiment. With reference to FIG. 10, the interior of the vehicle 100 is provided with displays 372-1, 372-2 and 372-3, a device 30, user terminals 371-1 and 371-2, and an in-vehicle camera 375. The window 378 includes a rear glass window 3781 (hereinafter, also referred to as window A), a left side glass window 3782 (hereinafter, also referred to as window B), and a right side glass window 3783 (hereinafter, also referred to as window C). Proximity sensors 376 are provided on the rear side and the left and right sides of the vehicle 100 outdoors (vehicle body). Outside the room, external cameras 3741, 3742, and 3743 are further provided on the rear and left and right sides of the vehicle 100, respectively.

The display 372-1 is arranged so that the screen faces the window A of the rear glass 3701, the display 372-2 is arranged so that the screen faces the window B of the left side glass 3702, and the display 372-3 has the screen facing the right side glass. It is arranged so as to face the window C of 3703. In FIG. 10, the glass of windows A, B and C has a default transmittance.

(First case)
Among the displays in the vehicle shown in FIG. 10, users A and B participate in the meeting with the information of the content 610 displayed only on the display 372-1 (the other displays 372-2 and 372-3 are turned off (OFF)). Explains the case where the device 30 detects the line of sight of another moving body that is behind the vehicle 100 for a long time. In the following, users A and B are also referred to as participants.

With reference to FIG. 8, the camera image analysis unit 412 inputs images captured by the external cameras 3741, 3742, and 3743 (step S3). The proximity detection unit 411 detects that there is another moving body (vehicle 110) behind the vehicle 100 based on the output of the proximity sensor 376 (YES in step S5). When the proximity detection unit 411 determines that there is no moving object (person or vehicle) based on the output of the proximity sensor 376 (NO in step S5), the proximity detection unit 411 returns to step S3.

Based on the output of the proximity sensor 376, the processing unit 430 selects an image captured by the external camera 3741 provided behind the vehicle 100 from the images from the camera image analysis unit 412, and selects the selected image (hereinafter, input). Process).

First, the processing unit 430 determines whether or not the tag 642 is attached to the input image (step S7). Specifically, the processing unit 430 collates the input image with each image 643 in which the flag 641 of the image file 640 is "1", and the image 643 matching the input image is stored in the image file 640 based on the collation result. Judge whether or not. When the processing unit 430 determines that the matching image 643 is stored in the image file 640, that is, determines that the tag 642 has already been attached to the input image (NO in step S7), the processing unit 430 determines the input image. The image file 640 is stored so that the tag 642 is attached, and the process proceeds to step S15.

The processing unit 430 collates the input image with each image 643 in which the flag 641 of the image file 640 is "1", and determines that the matching image 643 is not stored in the image file 640 based on the collation result, that is, the input image. If it is determined that the tag 642 is not attached to the file (YES in step S7), the process proceeds to step S9.

In step S9, the mobile tag generation unit 413 collates the input image with the discarded image 643 in which the flag 641 is "0", and based on the collation result, does the input image have a history of being given the tag 642? Judge whether or not. As a result of this collation, if it is determined that there is a matched image 643 (YES in step S9), the moving body tag generation unit 413 attaches the tag 642 of the matched image 643 to the input image, and the tag 642 is attached. The input image is stored in the image file 640 as an image 643 (step S13). On the other hand, when the moving body tag generation unit 413 determines that there is no matching image 643 (NO in step S9), the moving body tag generation unit 413 attaches a new tag 642 to the input image, and the tag 642 is attached. The input image is stored in the image file 640 as an image 643 (step S11).

In step S15, the processing unit 430 determines whether the tag 642 of the image 643 held in the image file 640 (that is, the flag 641 is “1”) is the same as the tag 642 attached to the input image (step S15). S15). If the processing unit 430 determines that they are the same (YES in step S15), the process proceeds to step S21.

The processing unit 430 calculates the leakage possibility degree 654 for each tag 642 held in the image file 640 (steps S21 to S25).

Specifically, the relative positional relationship calculation unit 414 calculates the relative velocity of each of the retained tags 642 from the time-series image 643, and the line-of-sight detection unit 415 calculates the relative velocity of each of the retained tags 642 of the time series. “Detecting the line of sight of another moving object” from image 643 (step S21).

For each tag, the processing unit 430 "detects the line of sight of another moving object" and, from the relative speed, the index 6311 of the relative speed low time, the index 631 of the relative distance short time, the index 6313 of the gaze time, and the number of times of line sight detection. The index 6314 is calculated (step S23), and the leakage possibility degree 654 is calculated from each of the calculated index values (step S25). The processing unit 430 stores the calculated data in the leakage possibility table 630.

The processing unit 430 searches the leak possibility table 630, and determines whether or not there is a tag 642 having a leak possibility 654 of "high" based on the search result (step S27).

When the processing unit 430 determines that there is a tag 642 having a leakage possibility of 654 of "high" (YES in step S27), the tag 642 is a new tag having a leakage possibility of 654 of "high". It is determined whether or not the tag is (step S29). When the processing unit 430 determines that the tag 642 is not a new tag (NO in step S29), the processing unit 430 calculates the tag 642 as an index 6314 for the number of line-of-sight detections, an index 6312 for the relative distance short time, and the previous execution cycle. These index values are compared with each other, and based on the result of the comparison, it is determined whether or not the index 6314 of the number of times the line of sight is detected and the index 6312 of the relative distance short time have changed (step S31).

When the processing unit 430 determines that the index 6314 and the index 6312 have not changed from the index values calculated in the previous cycle (NO in step S31), the processing unit 430 displays the display based on the user operation on the device 30. It is determined whether or not the use of the 372 meeting is completed, that is, whether or not the display 372 is turned off (step S39).

When the processing unit 430 does not determine the end of use (NO in step S39), the process returns to step S3, but when it determines the end of use (YES in step S39), the processing unit 430 sets a control value for controlling visibility to an initial value. At the same time, the data of the internal processing is deleted (step S41). In the present embodiment, the visibility control value includes the transmittance 614 or the brightness value of the image displayed on the display 372. The initial value of the transmittance 614 is a default value, and the brightness value corresponds to a value indicating the standard brightness of the image brightness from 0 to 256 gradations.

On the other hand, the processing unit 430 determines that the tag 642 having a leakage possibility 654 of "high" is a new tag (YES in step S29), or the processing unit 430 determines that the index 6314 and the index 6312 are When it is determined that the index value has changed from the index value calculated in the previous cycle (NO in step S31), the device 30 executes the visibility change process (step S33). After that, the process proceeds to step S39.

The visibility change process will be described with reference to FIG. In the visibility change process of FIG. 9, the process is performed on the display device inside the vehicle 100 and capable of displaying the content 610. Such a display device includes a display device that can communicate with the device 30 (for example, a display 372, a user terminal 371, etc.) and a display medium that cannot communicate with the device 30 (for example, a mobile terminal 379 owned by an individual user, paper). Documents (printed matter from MFP377), etc.) are included. In FIG. 9, another moving body corresponding to the image 643 of the tag 642 showing a leakage possibility of 654 of "high" is also referred to as a "specific other moving body".

First, the adjustment method determination unit 418 identifies the display device and the content 610 (step S47). Specifically, the adjustment method determination unit 418 is such that the screen can be seen from a specific other moving body (hereinafter, also referred to as “visible display device”) or the screen is hidden from the display devices in the vehicle. The display device at the position (hereinafter, also referred to as "hidden display device") is specified. In addition, the content 610 to be displayed in the conference is specified.

For example, the adjustment method determination unit 418 extracts a display having a measure (position and orientation) output from the second analysis unit 42, in which the direction of the specific other moving object and the orientation of the screen substantially match. , Identify the extracted display as a visible display device. In this case, the display 372 is specified as a visible display device. Further, the adjustment method determination unit 418 extracts and extracts a display having a measurement (position and orientation) output from the second analysis unit 42 and whose screen orientation is different from that of the specific other moving object. Identify the displayed display as a hidden display device.

The adjustment method determination unit 418 searches the storage unit 500 for the content 610 specified based on the user operation, and acquires the sensitivity 611 of the searched content 610 (step S49).

The adjustment method determination unit 418 determines whether or not there is display information that can be seen from other moving objects, depending on whether or not there is content 610 that is hit by the search in step S49 (step S51). When the adjustment method determination unit 418 determines that there is no display information visible from other moving objects (NO in step S51), the process proceeds to step S65. On the other hand, if the adjustment method determination unit 418 determines that there is display information visible from another moving body (YES in step S51), can the visibility control be performed on the visible display device specified in step S47? Whether or not it is determined (step S53). For example, if the visible display device is a device in which the device 30 cannot be controlled (for example, a mobile terminal 379 that does not communicate with the device 30), the visible display device is determined to be a device in which the visibility cannot be controlled (for example). NO in step S53), the process proceeds to step S67.

The adjustment method determination unit 418 determines that the visible display device is a display device that can be controlled by the device 30 (for example, a user terminal 371, a display 372, etc.) and that the visibility can be controlled (YES in step S53). ..

The adjustment method determination unit 418 determines in step S47 whether or not the hidden display device has been specified (step S55).

When the adjustment method determination unit 418 determines that the hidden display device has been identified (YES in step S55), the second step is to determine whether the hidden display device is oriented so that the screen can be viewed by one or more participants. The feature amount output from the analysis unit 42 is determined (step S57). Specifically, the adjustment method determination unit 418 determines whether or not the faces of one or more participants are facing the screen of the hidden display device based on the feature amount output from the second analysis unit 42.

When the adjustment method determination unit 418 determines that the faces of one or more participants are facing the screen of the hidden display device (YES in step S57), the adjustment method determination unit 418 uses the communication control unit 420 to determine the face. A control signal for lighting the hidden display device is output in order to display the content 610 (step S59). As a result, the display device of the content 610 can be switched to a hidden display device among the display devices in the vehicle so that one or more participants can see the screen.

Based on the feature amount output from the second analysis unit 42, the adjustment method determination unit 418 has the faces of all the participants facing each other, that is, the hidden display on the screen of the hidden display device lit in step S59. When the device determines that the screen is in a position where all participants can see it (YES in step S61), the device sends a control signal for turning off the visible display device specified in step S47 via the communication control unit 420. Output (step S63).

The adjustment method determination unit 418 determines whether or not the output of the line-of-sight detection unit 415 indicates “detects the line of sight of another moving body” (step S65). That is, when the line of sight of the moving body behind the vehicle 100 is still directed to the vehicle 100 (YES in step S65), the transmittance control unit 419 is the vehicle 100 and the vehicle 110 behind (another moving body). The transmittance 614 for preventing peeping from the window A between the and is determined and output. The transmittance control unit 419 reads the corresponding transmittance 614 by searching the transmittance table 620 based on the transmittance 611 acquired in step S49, and outputs the transmittance 614 of the window A. As a result, the polarization adjusting device 373 applies a voltage to the liquid crystal layer of the window A so that the glass of the window A has a transmittance of 614 based on the density 611.

On the other hand, the adjustment method determination unit 418 does not indicate that the output of the line-of-sight detection unit 415 "detects the line of sight of another moving body", that is, the line of sight of the moving body behind the vehicle 100 is not directed to the vehicle 100. If it is determined (NO in step S65), the visibility change process is terminated and the process returns to the process of FIG.

As described above, when the leakage possibility 654 is high for the moving body around the vehicle 100, the display device for displaying the content 610 is switched to the hidden display device. Even after switching, when the state of "detecting the line of sight of another moving object" is still present, the transmittance of the window 378 between the vehicle 100 and the other moving object is the transmittance based on the density 611 of the content 610. It is changed to 614 (the transmittance becomes smaller).

FIG. 11 is a diagram schematically showing a state in which the visibility is adjusted in the (first case) according to the present embodiment. As shown in FIG. 11 from the state of FIG. 10, the possibility of leakage 654 is high due to the relative positional relationship between the self-moving body and another moving body (vehicle 110) existing around the self-moving body (vehicle 100). It changes to a state that can be seen. At this time, the visibility is changed. This change in visibility switches the display destination of the content 610 to a hidden display device (for example, displays 372-2 and 372-3) as shown in FIG. 11, or moves by itself according to the density 611 of the content 610. Includes reducing the transmittance 614 of the glass 3701 of the window A between the body and the other mobile. As a result, it is possible to reduce the possibility that the displayed content 610 is peeped by another moving body.

(Second case)
In this (second case), a case where another moving object on the side of the vehicle 100 is detected for a long time while displaying the content 610 on the display 372-1 will be described.

FIG. 12 is a diagram schematically showing another example of the interior of the vehicle 100 according to the present embodiment. FIG. 13 is a diagram schematically showing a state in which the visibility is adjusted in the (second case) according to the present embodiment. In FIG. 12, the MFP 377 is installed in the vehicle, but the description is not repeated because the other configurations are the same as those in FIG.

In FIG. 12, of the displays 372 to 1372-3 in the vehicle, only the display 372-1 is lit to display the content 610. In this case, as shown in FIG. 13, the vehicle 110 on the right side of the own vehicle 100 runs in parallel with the vehicle 100 for a certain period of time.

In the (second case) as well, in the same manner as in the (first case), the process of FIG. 8 is attached with the tag 642 to the image 643 captured by the outside camera 3743 on the right side of the vehicle body of the vehicle 110, and the image file 640 At the same time, the index 631 and the leakage possibility degree 654 are calculated for the other moving body of the image 643 in the tag 642 and stored in the index value table 650. Further, the visibility change process of FIG. 9 is performed.

The device 30 performs the processes of steps S47 to S61 of FIG. 9 in the same manner as in (first case). The adjustment method determination unit 418 cannot specify the hidden display device (NO in step S55), or the screen of the hidden display device cannot be seen by any of the participants (NO in step S57, NO in step S61). If it is determined, the process proceeds to step S69.

In step S69, the adjustment method determination unit 418 determines whether the density 611 of the content 610 acquired in step S49 is equal to or higher than a certain level (step S69). When it is determined that the machine density 611 is above a certain level (YES in step S69), the adjustment method determination unit 418 displays (or turns off) only the page number of the content 610 on the lit display 372-1. The display of the 610 is interrupted (step S71), and the participant turns on the hidden display device capable of viewing the screen to display the content 610 (step S73). Also, the MFP 377 is controlled to print the content 610 on paper 380 for participants who cannot see the screen of the hidden display device (step S75).

As a result, when the device 30 that captures the information of the external camera 3743 and the proximity sensor 376 determines that the other vehicle 110 on the right side is running in parallel for a certain period of time, the device 30 starts from the moving body (vehicle 110). Since the visible information is blocked, the visibility is reduced as shown in FIG. In FIG. 13, only the page number of the content 610 is displayed on the display 372-1. The display 372-1 is a hidden display device in which the screen cannot be seen from another moving body running in parallel with the self-moving body (vehicle 100). The display 372-2 in front of the user A lights up to display the content 610. The display 372-3, which is a display device visible to the user B, does not turn on the display 372-3 because the screen can be seen from another moving body, and instructs the MFP 377 to print the content 610. As a result, the user B can confirm the content 610 printed on the paper 380. In (second case), since the other moving body is located on the side of the self-moving body, the possibility of "detecting the line of sight of the other moving body" is low, so that the device 30 has the transmittance of the window. Does not control.

(Third case)
In this (third case), while displaying "low" content 610 such as a Web page on the display 372-1, "another" with other moving objects behind the vehicle 100 for a long time. The case where "detecting the line of sight of a moving body" is detected will be described.

FIG. 14 is a diagram schematically showing another example of the interior of the vehicle 100 according to the present embodiment. FIG. 15 is a diagram schematically showing a state in which the visibility is adjusted in the present embodiment (third case). In FIG. 14, the display 372-3 is not installed in the vehicle, but the description is not repeated because the other configurations are the same as those in FIG.

In FIG. 14, only the display 372-1 out of the displays 372-1 and 372-2 in the vehicle is lit to display the content 610 of the Web page. In this case, as shown in FIG. 15, the vehicle 110 follows the vehicle 100 for a certain period of time behind the own vehicle 100.

In the (third case) as well, by performing the process of FIG. 8 in the same manner as in the (first case), the device 30 is the other moving body imaged by the external camera 3741 behind the vehicle body of the vehicle 100. The image 643 is stored in the image file 640 with the tag 642 attached. The device 30 calculates the index 631 and the leakage possibility degree 654 for the other moving body by processing the image 643 to which the tag 642 is attached, and stores the calculation result in the index value table 650. The device 30 further performs the visibility change process of FIG.

The apparatus 30 performs the processes of steps S47 to S55 of FIG. 9 in the same manner as in (first case). The adjustment method determination unit 418 identifies the display 372-2 as a hidden display device in which one or more participants can see the screen (YES in step S55, YES in step S57). The adjustment method determination unit 418 transmits a lighting control signal to the display 372-2 in order to display the content 610 (Web page) on the display 372-2.

The adjustment method determination unit 418 determines that the display 372-2, which is a hidden display device, is not in a position where all the participants can see the screen (NO in step S61), and proceeds to step S69.

The adjustment method determination unit 418 determines that the sensitivity 611 of the Web page, which is the displayed content 610, is not above a certain level (YES in step S69). Based on the determination result of the density 611, the adjustment method determining unit 418 transmits a brightness control signal 616 for reducing the brightness of the display 372-1 which is a visible display device to the display 372-1 via the communication control unit 420. Output (step S77). The luminance control signal 616 includes, for example, a signal that changes the voltage value or pulse width of the luminance signal (voltage signal or pulse signal) that determines the brightness of the screen of the display 372. After that, the process proceeds to step S65. Therefore, the screen of the display 372 can be darkened by outputting the luminance control signal 616 that reduces the luminance.

As a result, if the display device on which all the participants can see the screen cannot be specified (NO in step S61), as shown in FIG. 15, the adjustment method determination unit 418 is a display device which is a visible display device 372-. By reducing the brightness of the screen of No. 1, the visibility of the displayed information can be reduced.

(Fourth case)
In (fourth case), the device 30 returns the visibility of the displayed content 610 to the default when the possibility of peeping from other moving objects of the content 610 displayed on the display 372 disappears. Each part is controlled so as to.

Specifically, with reference to FIG. 8, the processing unit 430 determines that among the tags 642 of the image 643 held in the image file 640, there is a tag that is not the same as the tag 642 attached to the input image. (NO in step S15), the process proceeds to step S17.

In step S17, the processing unit 430 discards the image 643 of the moving body that is not photographed by the external camera 374, that is, the moving body that has disappeared from the periphery of the vehicle 100. Specifically, the processing unit 430 sets the flag 641 of the tag 642 determined to be not the same in step S15 to “0”. As a result, the processing unit 430 can discard the image 643 of the moving body in the image file 640, which disappears from the periphery and has no possibility of peeping.

When the processing unit 430 determines that there is no tag 642 having a leakage possibility 654 of "high" based on the search result of the leakage possibility table 630 (NO in step S27), the adjustment method determination unit 418 adjusts. Based on whether or not the quantity 613 and the luminance control signal 616 are output, it is determined whether or not the current visibility indicates low (step S35).

When the processing unit 430 determines that the current visibility does not indicate low (NO in step S35), the process proceeds to step S39. On the other hand, if it is determined that the current visibility indicates low (YES in step S35), the processing unit 430 sets the visibility to the original value "high" (step S37). Specifically, the adjustment method determination unit 418 sets the transmittance 614 to the default value, stops the output of the luminance control signal 616, or returns the luminance value of the pixel of the display control data 615 to the default value. As a result, the screen or display image of the display becomes bright, and the transmittance of the window 378 becomes the default, and the visibility of the information displayed on the display becomes high. After that, the process proceeds to step S39.

<System equipped with information processing device 30>
FIG. 16 is a diagram showing a configuration of a network system including the information processing device 30 according to the present embodiment. In FIG. 16, a plurality of mobile bodies (vehicles 100) detect their own positions by communicating with GPS satellites 700 by a GPS receiver 350, and manage the detection position of the network 720 via the nearest base station. Send to server 710. Therefore, the management server 710 can manage the position of each moving object in chronological order.

In the above embodiment, the device 30 acquires the relative positional relationship between the other moving body (vehicle 110) and the self-moving body (vehicle 100) from the output of the proximity sensor 376 or the image output by the external camera 374. However, the acquisition method is not limited to this. For example, in FIG. 16, the device 30 of the vehicle 100 communicates with the management server 710 via the network interface 360, and the position 711 of the self-moving body and the position 712 of another moving body existing around the self-moving body. Is received, and the received positions 711 and 712 are processed, so that the above relative positional relationship (direction and distance) can be calculated. Further, the relative speed can be calculated by processing the positions 711 and 712 of the time series to be received.

Alternatively, the management server 710 may calculate a relative positional relationship (direction and distance) from the position 711 of the self-moving body and the position 712 of another moving body, and transmit the calculated relative positional relationship to the device 30.

<Configuration of management server 710>
FIG. 17 is a diagram schematically showing an example of the hardware configuration of the management server 710 according to the present embodiment. The management server 710 is an embodiment of the "information processing device". With reference to FIG. 17, the management server 710 includes a CPU 701, a storage unit 702, a network controller 703, and a memory interface 707. The storage unit 702 includes a ROM 704 and a RAM 705 for storing programs and data executed by the CPU 701, and an HDD 706 for storing various types of information. The RAM 705 includes an area for storing various information and a work area for executing a program on the CPU 701. The network controller 703 includes a circuit such as a NIC for communicating with the information processing device 30 via the network 720. The memory interface 707 includes a driver circuit to which the storage medium 708 is detachably mounted to read data or a program from the mounted storage medium 708 or write data or a program to the storage medium 708. The storage medium 708 has the same characteristics as the storage medium 345.

In the present embodiment, the functions of the processing unit 430 and the adjustment method determination unit 418 included in the information processing apparatus 30 are realized by a program executed by the CPU 701 of the management server 710. In this case, the CPU 701 acquires the positions of the moving bodies in time series, and calculates the relative positional relationship (distance and direction between the moving bodies) from the acquired positions. The CPU 701 calculates an adjustment amount 613 for changing the visibility of information based on the density 611 received from the information processing device 30 and the calculated relative positional relationship, and transmits the adjustment amount 613 to the information processing device 30. As a result, the transmittance control unit 419 or the image output control unit 417 of the information processing device 30 generates the transmittance 614 or the display control data 615 for controlling the visibility according to the adjustment amount 613 received from the management server 710. be able to.

Further, the information processing device 30 transmits the image captured by the outside camera 374 or the inside camera 375 to the management server 710. The management server 710 can store the image file 640 in the storage unit 702 and generate the index value table 650 by processing the image received from the information processing device 30 in the same manner as the processing unit 430. The CPU 701 calculates the adjustment amount 613 for controlling the visibility by using the leakage possibility degree 654 of the generated index value table 650, and transmits it to the information processing apparatus 30. As a result, the transmittance control unit 419 or the image output control unit 417 of the information processing device 30 controls the transmittance 614 or the transmittance 614 for controlling the visibility according to the adjustment amount 613 based on the leakage possibility degree 654 received from the management server 710. Display control data 615 can be generated.

<Content display and audio output>
The above-mentioned conference may include a video conference, a chat conference, and the like. In these meetings, along with the display of information, the voice of a call with a remote terminal can be output from a speaker (not shown) in the vehicle 100. In the visibility change process, the processing unit 430 controls the display 372 in the vehicle 100 so as to interrupt the display, and outputs the voice of the call from the speaker. In this way, when the display of the display device is interrupted in the vehicle 100, the captured image (video) of the in-vehicle camera 375 is transmitted to the other terminal and displayed on the display of the other terminal. After that, when the leakage possibility degree 654 changes from "high" to "low", the display 372 resumes displaying the information of the content 610.

In the above-mentioned video conference or chat conference, an image of the face of the other party displayed on the display 372 can be displayed, and depending on the other party (person), the displayed face image is related to the sensitivity of information. Therefore, the display 372 is changed to a display 372 that is difficult to see from the outside of the vehicle (for example, switching from the display 372-1 to the display 372-2 or 372-3) or the sound is output so that the facial images of the members participating in the conference cannot be seen from the outside of the vehicle. However, the information can be protected from peeping by turning off the image display.

<Modification example>
In this embodiment, the situation in which the content 610 is output in the moving body is not limited to the conference. Specifically, this embodiment can also be applied to a situation in which a user performs personal work while outputting content 610 as remote work. The situation of personal work may include, for example, the case where the user moves to a business trip destination or a commuting destination while working in the vehicle 100.

Further, in the above embodiment, the content 610 is wirelessly downloaded to the user terminal 371 in the moving body via or without the device 30, but the user terminal 371 is the content 610. The route to obtain is not limited to this. For example, the content 610 may be stored in the user terminal 371 even before the user gets on the moving body.

Further, the acquisition route of the density 611 by the density acquisition unit 410 is not limited to the route acquired from the attribute information 609 indicating the density added to the content 610. In another acquisition route, for example, the type of data communicated by the content 610 can be treated as the attribute information 609 indicating the sensitivity. In this case, when the machine density acquisition unit 410 determines that the communication data of the content 610 is the data in the in-house server from the attribute information 609 indicating the machine density, the machine density 611 is large, and the communication data is open to the public on the Web. When it is determined to be data, it is determined that the machine density 611 is small.

Further, in another acquisition route, the captured image obtained by capturing the image of the content displayed on the display 372 with the in-vehicle camera 375 can be treated as the attribute information 609 indicating the density. In this case, the density acquisition unit 410 performs image recognition processing on the captured image, and based on the result of the image recognition processing, determines whether or not the title of the content image contains characters such as "confidential" or "secret". For example, it is determined by pattern matching or the like, and the machine density 611 is determined based on the determination result.

Further, as another acquisition route, the sensitivity acquisition unit 410 obtains a subject image included in the image of the content displayed on the display 372, for example, the content image displayed on the display 372 is an image of a video conference (conference participants). If (is displayed), the machine density 611 is determined to be high.

Further, as another acquisition route, the machine density 611 may be acquired from the information obtained by scanning the print information of the paper 380. For example, a specific character (character indicating confidentiality such as "confidentiality" or "confidentiality") or a specific picture (stamp indicating confidentiality such as "confidentiality" or "confidentiality") contained in the scanned and read information. ) Etc. are included. In addition, the path (URL: Uniform Resource Locator) indicating the location (storage area) where the content 610 is stored, the information identifier (file name), the information type (file extension), and the attribute information 609 indicating the sensitivity. May be. The machine density acquisition unit 410 can acquire the machine density 611 from such attribute information 609. In addition, when the above path or information type represents the work content (work content of accounting, human resources, product development, etc.) of the user using the information, the work content is included as attribute information 609 indicating the sensitivity. You can also do it.

Further, in the above-described embodiment, the change in visibility is realized by switching the display device, changing the brightness of information, and changing the transmittance of the window by one or a combination of two or more. You can also.

<Program>
In the present embodiment, a program for causing the information processing apparatus 30 to execute the above-described processing is provided. Such a program includes at least a program of processing according to the flowchart of FIG. 8 or FIG. 9 described above. As a program product, it is recorded on a computer-readable storage medium such as a storage medium 345, a flexible disk, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card attached to the computer of the information processing apparatus 30. It can also be provided. Alternatively, the program can be provided by recording on a storage medium such as HDD 310 built in the computer. The program can also be provided by downloading via the network 720. The program can be executed by one or more processors such as a CPU 300, or by a combination of a processor and a circuit such as an ASIC, FPGA.

Further, in the present embodiment, a program for causing the management server 710 to execute the process described above is provided. Such a program includes at least a program of processing according to the flowchart of FIG. 8 or FIG. 9 described above. Recorded on a computer-readable storage medium such as a storage medium 708 attached to the computer of the management server 710, a flexible disk, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also do it. Alternatively, the program can be provided by recording on a storage medium such as HDD 706 built in the computer. The program can also be provided by downloading via the network 720. The program can be executed by one or more processors such as CPU 701, or by a combination of processors and circuits such as ASIC, FPGA.

The program may be a program module provided as a part of the OS of the computer, which calls necessary modules in a predetermined array at a predetermined timing and causes the processor to execute the process. In that case, the program itself does not include the above module and the process is executed in cooperation with the OS. A program that does not include such a module may also be included in the program of each embodiment.

Further, the program according to the present embodiment may be provided by being incorporated into a part of another program. Even in that case, the program itself does not include the modules included in the other program, and causes the processor to execute the process in cooperation with the other program. A program incorporated in such another program may also be included in the program according to the present embodiment.

<Effect of embodiment>
In the present embodiment, the information of the content 610 displayed in the mobility office provided in the vehicle of the vehicle 100, which is a mobile body for telework, can be protected from the peeping of other mobile bodies.

The protection from peeping is the relative positional relationship between the other moving body (more specifically, the occupant 111 of the vehicle 110) existing around the self-moving body (vehicle 100) and the self-moving body and the content 610. This is carried out by changing the visibility of the information according to the machine density 611. As a result, when there is a high possibility that the information is peeped by another moving body due to the relative positional relationship, the peeping can be prevented by lowering the visibility.

Therefore, in the mobility office, the user can concentrate on the work without being aware of the security of the content 610 to be handled.

It should be considered that the embodiments disclosed this time are exemplary in all respects and not restrictive. The scope of the present invention is shown by the scope of claims, not the above description, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

30 Information processing equipment, 41 1st analysis unit, 42 2nd analysis unit, 50 Driving control system, 100, 110 Vehicles, 111 occupants, 350 GPS receivers, 371 user terminals, 372 displays, 373 polarization adjusters, 374,3741 , 3742,3743 Outside camera, 375 Inside camera, 376 Proximity sensor, 378,3781,3782,3783, A, B, C windows, 379 mobile terminal, 380 paper, 400 system program, 410 density acquisition unit, 411 proximity Detection unit, 412 camera image analysis unit, 413 moving object tag generation unit, 414 relative positional relationship calculation unit, 415 line-of-sight detection unit, 416 drawing unit, 417 image output control unit, 418 adjustment method determination unit, 419 transmission rate control unit, 420 Communication control unit, 430 processing unit, 500 storage unit, 501 application program, 610 content, 611 density, 612 relative positional relationship, 613 adjustment amount, 614 transmission rate, 615 display control data, 616 brightness control signal, 620 density Table, 630 Leakage Potential Table, 631, 6311, 6312, 6313, 6314 Indicators, 632 Additions, 640 Image Files, 641 Flags, 642 Tags, 643 Images, 650 Indicator Values Table, 654 Leakage Potential, 700 GPS Satellites , 710 management server, 711,712 location, 720 network, 900 cable, 3701, 3702, 3703 glass.

Claims (20)

A positional relationship acquisition means for acquiring a relative positional relationship between another moving body existing around the first moving body and the first moving body, and
An attribute acquisition means for acquiring attribute information indicating the sensitivity of information that can be output by a display device provided in the first moving body, and an attribute acquisition means.
A visibility changing means for changing the visibility of information output by the display device is provided.
The visibility changing means is
An information processing device that changes the visibility of the information according to the relative positional relationship and the density indicated by the attribute information of the information. The information processing apparatus according to claim 1, wherein the relative positional relationship includes a distance from the first moving body to the other moving body and a direction of the other moving body from the first moving body. The information processing apparatus according to claim 1 or 2, wherein the relative positional relationship further includes the degree to which the other moving body is close to the first moving body. The other mobiles include humans
An external camera that captures the surrounding area and
A means for detecting the line of sight of the person from the image of the person included in the image captured by the external camera is further provided.
The information processing device
The degree of possibility that the information output by the display device is visually recognized from the line of sight of the person is acquired.
The visibility changing means further
The information processing apparatus according to any one of claims 1 to 3, wherein the visibility of the information is changed according to the relative positional relationship, the density, and the degree of possibility of being visually recognized. The degree of possibility of being visually recognized is based on the time when the person stares at the first moving body and the frequency at which the person's line of sight to the first moving body is detected. Information processing device. The information processing device according to any one of claims 1 to 5, wherein the change in the visibility of the information output by the display device includes a change in the output mode of the information. A plurality of the display devices are provided in the first moving body.
The information processing device according to claim 6, wherein the change in the output mode includes switching of a display device that outputs the information. The information processing device according to claim 7, wherein a display device that outputs the information is determined from the plurality of display devices based on the orientation of each of the plurality of display devices and the relative positional relationship. An internal camera for photographing the inside of the first moving body is further provided.
The information processing device according to claim 8, wherein the orientation of each display device is detected from an image captured by the internal camera. The relative positional relationship includes the distance from the first moving body to the other moving body and the direction of the other moving body from the first moving body.
The orientation of each display device includes the orientation of the screen included in the display device.
The information according to claim 9, wherein among the display devices, the display device whose screen orientation is different from the direction of the other moving body from the first moving body is determined as a display device for outputting the information. Processing equipment. The orientation of each user is detected from the images of one or more users in the first moving body taken by the internal camera.
The information processing device according to claim 9, wherein a display device that outputs the information is determined based on the orientation of each display device, the relative positional relationship, and the orientation of each user. Among the plurality of display devices, the information indicates that the display device whose screen orientation is different from the orientation of the other moving object from the first moving object and whose user's orientation faces the screen. The information processing device according to claim 11, which is determined as a display device for outputting the above. The information processing apparatus according to any one of claims 6 to 12, wherein the change in the output mode includes a change in the brightness of the information output by the display device. An image processing device for printing the information is provided in the first moving body.
The information processing apparatus according to any one of claims 6 to 13, wherein the modification of the output mode includes printing the information by the image processing apparatus. The first moving body has a window and
The visibility changing means is
The information processing apparatus according to any one of claims 1 to 14, wherein the transmittance of the glass of the window is changed according to the relative positional relationship and the density based on the attribute of the information. A sensor that senses the other moving body in the vicinity is provided.
The positional relationship acquisition means
The information processing apparatus according to any one of claims 1 to 15, wherein the relative positional relationship is acquired from the position information received from the server that manages the position of each moving body or the output of the sensor. The visibility according to any one of claims 1 to 16, including the ease in which information output from the other moving body by the display device in the first moving body can be visually grasped. Information processing device. A server that manages the location of mobiles and
Including an information processing device provided in the first mobile body communicating with the server.
The information processing device
A positional relationship acquisition means for receiving the relative positional relationship between the first moving body and another moving body existing around the first moving body from the server, and
An attribute acquisition means for acquiring attributes corresponding to the sensitivity of information that can be output by a display device provided in the first moving body, and
A visibility changing means for changing the visibility of information output by the display device is provided.
The visibility changing means is
A system that changes the visibility of the information according to the relative positional relationship and the density based on the attribute of the information. Information processing method executed by a computer
A step of acquiring a relative positional relationship between another moving body existing around the first moving body and the first moving body, and
A step of acquiring attribute information indicating the sensitivity of information that can be output by a display device provided in the first moving body, and
A step of changing the visibility of the information output by the display device is provided.
In the step of changing the visibility,
An information processing method for changing the visibility of the information according to the relative positional relationship and the density indicated by the attribute information of the information. A program for causing a computer to execute the information processing method according to claim 19.

Images