JP6981743B2 - Information processing equipment, information processing methods and information processing programs - Google Patents

Description

The present application belongs to a technical field such as an information processing apparatus that controls updating of information output by an output means.

With the spread of so-called mobile computing in recent years, its users can obtain a wide variety of information output by terminal devices. Such information includes weather information, exchange information, stock price information, transportation operation information, information posted on SNS (Social Networking Service), POI (Point of Interest) information displayed on the map of the navigation device, etc. , Contains information that is updated from time to time.

Further, Patent Document 1 below discloses a technique for distributing information that more reflects the user's preference in consideration of the user's preference and the situation at that time.

Japanese Unexamined Patent Publication No. 2007-272616

Here, in the above-mentioned terminal device for presenting information to the user and the technique described in Patent Document 1, it is common to present the information to be updated at any time to the user while sequentially updating it according to the update. However, for example, if the information displayed on the display device by the navigation device of a moving object such as a car is to be updated in real time regardless of the driving situation, the intention of the passenger, etc., the driver is updated, for example. There is a problem that you may not be able to concentrate on driving because you are distracted by the information.

Therefore, the present application has been made in view of such circumstances, and one example of the problem is to control the update of information according to the situation when presenting the information to be updated at any time to the driver of the mobile body or the like. Thereby, it is an object of the present invention to provide an information processing device or the like capable of concentrating a driver on driving.

In order to solve the above problems, the invention according to claim 1 relates to an output information acquisition means for acquiring output information displayed and updatable on a display means provided in the moving body, and movement in the moving body. A state information acquisition means for acquiring state information indicating a control state, and a control means for controlling whether or not to update an updated portion in the output information displayed on the display means based on the acquired state information. wherein the control means, wherein when the update of the availability is negative, Ru is configured to maintain the display of the updated portion in the pre-update state.

In order to solve the above problems, the invention according to claim 7 acquires output information that can be displayed and updated on a display means provided in a moving body in an information processing method executed by an information processing apparatus. An output information acquisition step, a state information acquisition step of acquiring state information indicating a control state related to movement in the moving body, and an update in the output information displayed on the display means based on the acquired state information. viewed including a control step, the controlling whether to update portions, the in the control step, the case updating of the availability is negative, configured to maintain the display of the updated portion in the pre-update state.

In order to solve the above problems, the invention according to claim 8 causes the computer connected to the display means to function as the information processing apparatus according to any one of claims 1 to 6.

It is a block diagram which shows the outline structure of the information processing apparatus which concerns on embodiment. It is a figure which shows the screen example in the display of the navigation apparatus which concerns on embodiment. It is a block diagram which shows the outline structure of the navigation device which concerns on embodiment. It is an external view which illustrates the case where the arrangement of the display and the like in the navigation apparatus which concerns on an Example is seen from a driver's seat. It is a flowchart which shows the whole operation example of the navigation device which concerns on Example. It is a flowchart which shows the detail of the operation example of the navigation device which concerns on Example.

A mode for carrying out the present application will be described with reference to FIG.

As shown in FIG. 1, the information processing apparatus 1 according to the embodiment includes output information acquisition means 111A, state information acquisition means 111B, control means 111C, ambient environment information acquisition means 111D, and detection means 111E. It is provided and is connected to an external output means 2.

In this configuration, the output information acquisition means 111A acquires output information that can be output and updated by the output means 2 provided in the moving body. The output information that can be updated and output to the output means 2 includes weather information, exchange information, stock price information, transportation operation information, information posted to SNS, and the like.

The state information acquisition unit 111B acquires state information indicating a control state related to movement in the moving body. The moving body is, for example, an automobile, a bicycle, a railroad, a ship, an aircraft, or the like. The control state is, for example, the degree to which the judgment of the user of the moving body (for example, the driver when the moving body is a vehicle) or the driving technique is involved in the movement of the moving body. It is the state of so-called automatic driving in the moving body.

Then, the control means 111C controls whether or not the output information can be updated based on the state information acquired by the state information acquisition means 111B. Here, "update" of the output information means
i) A process of updating the output information already output to the output means 2 to new output information (for example, a process of updating the already output exchange information A to another exchange information B), and
ii) A process for controlling whether or not to output output information that has not yet been output to the output means 2 (that is, the output means 2 is new from a state in which no output information is output to the output means 2). Switching to the state where output information is output, etc.)
Both are included (and so on).

Therefore, according to the information processing apparatus 1 according to the embodiment, whether or not the output information can be updated is controlled based on the control state regarding the movement in the moving body, so that it is possible to finely and appropriately control whether or not the output information can be updated. It can be done and the driver can concentrate on driving.

Further, in the information processing apparatus 1 according to the embodiment, the control state of the mobile body is a state of automation of the operation of the mobile body in which a plurality of levels are preset, and the state information acquired by the state information acquisition means 111B is , It is configured to be state information indicating which level of automation the current automation of mobile operation is.

Therefore, the control state for the movement of the moving object is the state of the automation of the operation in which multiple levels are defined, and the state information indicates which level of the automation of the current operation of the moving object is. It is possible to finely and appropriately control whether or not the output information can be updated according to the level of automation of the operation of the moving body, and it is possible to concentrate the driver on the operation.

Further, in the information processing apparatus 1 according to the embodiment, the control state of the moving body is a fully automated operation state in which all of acceleration, steering, and braking in the operation are automated and the driver is not involved in the operation at all, or the complete operation state. It is one of the operating states of the moving body other than the automated operating state, and the state information acquired by the state information acquiring means 111B is the state information indicating the operating state, and the control means 111C is the above-mentioned operation. It is controlled to prohibit the update of the output information when the state information indicates that the state is the operating state of the moving object other than the fully automated operating state.

Therefore, the control state related to the movement of the moving body is either a fully automated operating state or an operating state of a moving body other than the fully automated operating state, and the state information is the state information indicating the operating state of either of them, and the movement is performed. Since it is controlled to prohibit the update of the output information when it is shown that the operating state of the body is the operating state of the moving body other than the fully automated operating state, it is possible to update the output information in detail and appropriately. It can be controlled and the driver can concentrate on driving.

Furthermore, in the information processing apparatus 1 according to the embodiment, the ambient environment information acquisition means 111D acquires the ambient environment information regarding the ambient environment of the moving body.

Then, the control means 111C outputs information based on the control state of the moving body indicated by the state information acquired by the state information acquisition means 111B and the surrounding environment related to the surrounding environment information acquired by the surrounding environment information acquisition means 111D. Controls whether or not the update is possible.

Therefore, since it is possible to control whether or not the output information can be updated based on the control state of the moving body and the surrounding environment, it is possible to control whether or not the output information can be updated more finely and appropriately. You can concentrate.

Further, in the information processing apparatus 1 according to the embodiment, the control state of the moving body is a fully automated driving state in which all of acceleration, steering, and braking in the operation of the moving body are automated and the driver is not involved in the driving at all. It is any of the operating states of the moving body other than the fully automated operating state, and the state information acquired by the state information acquisition means 111B is the state information indicating any of the above operating states.

Then, the control means 111C controls to update the output information when the operating state of the moving body is indicated by the state information, and the operating state is other than the fully automated operating state. When the operating state is indicated by the status information, and the ambient environment information indicates that the ambient environment related to the ambient environment information acquired by the ambient environment information acquisition means 111D is not suitable for updating the output information. Controls to prohibit updating of output information.

Therefore, the control state related to the movement of the moving body is either a fully automated operating state or an operating state of a moving body other than the fully automated operating state, and the state information is the state information indicating any of the operating states, and the movement is performed. It is controlled to update the output information when the operating state of the body is indicated to be a fully automated operating state, and it is indicated that the operating state is an operating state other than the fully automated operating state. Since the update of the output information is prohibited when it is shown that the surrounding environment is not suitable for the update of the output information, it is possible to finely and appropriately control whether or not the output information can be updated, and the driver concentrates on driving. Can be made to.

Furthermore, in the information processing apparatus 1 according to the embodiment, the detection means 111E detects the movement of a passenger other than the driver of the mobile body.

Then, when the output information is the target of the operation detected by the detection means 111E, the control means 111C can update the output information regardless of the surrounding environment related to the surrounding environment information acquired by the surrounding environment information acquisition means 111D. Control to do.

Therefore, when the output information is the target of the movement of a passenger other than the driver, it is controlled so that the output information can be updated regardless of the surrounding environment. If there is, the output information can be updated appropriately.

Next, specific examples corresponding to the above-described embodiments will be described with reference to FIGS. 2 to 6. The embodiment described below is an example in which the above-described embodiment is applied to an in-vehicle device mounted on a vehicle (an example of a “moving body”). Here, as the in-vehicle device according to the embodiment described below, for example, a navigation device for guiding the movement of the vehicle on which the in-vehicle device is mounted, and content such as a moving image or SNS posting information in the vehicle are displayed. Display devices and the like can be mentioned.

(I) Outline of the in-vehicle device according to the embodiment First, an outline of the characteristic information updating function of the in-vehicle device NV according to the embodiment will be described. The information update function is a function for controlling the update when the output information updated with the passage of time is displayed on the display.

The vehicle-mounted device NV according to the embodiment acquires time information, exchange information, and SNS posting information, which are output information updated with the passage of time. The timing of acquiring each information may be periodic, or may be every time the information is updated. The SNS posting information is, for example, information indicating a posted article including a keyword set by the user. That is, when the keyword "Hokkaido" is set, the in-vehicle device NV acquires information indicating a posted article about Hokkaido.

Next, the in-vehicle device NV displays the acquired output information in individual areas as shown in FIG. Specifically, the time information is displayed in the time display area 401 of the screen 400, the exchange information is displayed in the exchange display area 402, and the SNS posting information is displayed in the posting information display area 403. At this time, if the surrounding environment of the vehicle on which the in-vehicle device NV is mounted is not appropriate for updating the information at the time of movement, the in-vehicle device NV will acquire new SNS posting information even if it newly acquires the SNS posting information. Does not update the SNS posting information displayed in the posting information display area 403. Here, when the above-mentioned surrounding environment is not appropriate for updating information when the vehicle is moving, for example, when the surroundings are heavy rain, the road currently being driven is congested, or the vehicle is currently traveling. This refers to the case where the road is a very narrow road and the surrounding environment is such that the driver of the vehicle is subjected to, for example, a psychological, physical or mental load. Further, in the in-vehicle device NV, when the SNS posting information is the target of the user's operation, that is, when the user's line of sight is directed to the SNS posting information, or the posting information on which the SNS posting information is displayed. Even when the user is performing an operation on the display area 403 (for example, a scroll operation), even if the SNS posting information is newly acquired, it is displayed in the posting information display area 403 by the new SNS posting information. Do not update SNS posting information. On the other hand, in the in-vehicle device NV, regarding the time information, regardless of whether or not the surrounding environment of the vehicle indicates that the situation is not appropriate for updating the information when the vehicle is moving, and the time information is the user. When new time information is acquired regardless of whether or not it is the target of the operation of, the time information displayed in the time display area 401 or the like is updated by the new time information (exchange information and exchange display area 402). The same applies to). That is, the in-vehicle device NV displays the latest information regarding the time information.

Further, the in-vehicle device NV controls whether or not the output information can be updated according to the level of automation of the operation of the vehicle in which the in-vehicle device NV is mounted. At this time, the level of automation can be basically set arbitrarily, and examples thereof include levels 1 to 4 illustrated in Table 1 below.

The level of automation shown in Table 1 is the "Public-Private ITS Concept / Roadmap 2016-2020 on Expressways" announced by the Intelligent Transport Systems Society Promotion Strategy Headquarters on May 20, 2016. This is the level of automation defined on page 5 of "Toward the Realization of Unmanned Automated Driving Mobile Services in Limited Areas". And in the definition shown in Table 1, the system that realizes the automation of Level 1 shown in Table 1 is the "safe driving support system", and realizes the automation of Level 2 and Level 3 shown in Table 1. It is said that the system is a "quasi-automated driving system" and the system that realizes level 4 automation shown in Table 1 is a "safety automatic driving system". The classification of "information-providing type" in Table 1 includes "safe driving support device (vehicle-mounted device)" that alerts the driver in the information-providing type. Also, at any level of automation in Table 1, the driver of the vehicle is allowed to intervene in the control of the automated driving system at any time. That is, for example, in level 4 automation, the driver can stop the automatic driving system by pressing the system release stop button or the like, if necessary. However, if the driver intervenes in the automated driving system in level 4 automation, the level 4 automation will cease at that point.

(II) Configuration of the in-vehicle device according to the embodiment Next, the configuration of the in-vehicle device NV according to the embodiment will be described with reference to FIG. As shown in FIG. 3, the in-vehicle device NV according to the embodiment includes a control unit 211, a storage device 212 including an HDD, an input device 213, a display unit 214, a bus line 215, and an input / output interface unit 220. , Vehicle speed sensor 221, angular speed sensor 222, acceleration sensor 223, steering angle sensor 224, GPS (Global Positioning System) receiving unit 225, data transmission / reception unit 226, line-of-sight detection camera 227, and outside camera 228. It is configured to include an external sensor 229. As an example of the arrangement of the input device 213, the display unit 214 including the screen 400, the line-of-sight detection camera 227, and the vehicle exterior sensor 229, as shown in FIG. 4, for example, the vehicle exterior sensor as viewed from the driver's seat in the vehicle. It is preferable that the 229 is provided outside the vehicle, the input device 213 is provided at the position of the steering wheel H, and the display unit 214 and the line-of-sight detection camera 227 are further provided at the position of the front panel FP beside the steering wheel H. be. When there is an updated portion in the image HD of the head-up display displayed (projected) at the position of the line of sight through the windshield FG as seen from the driver, the update control according to the embodiment can be applied. ..

In the above configuration, the vehicle speed sensor 221 detects the current speed of the vehicle by using, for example, a speed detection process using a vehicle speed pulse or the like acquired from a vehicle equipped with the in-vehicle device NV, and outputs speed data. .. The angular velocity sensor 222 detects, for example, the angular velocity of the vehicle, for example, a change in direction, and outputs angular velocity data and relative orientation data per unit time. The acceleration sensor 223 detects, for example, the acceleration of the vehicle in the front-rear direction, and outputs acceleration data or the like per unit time. The steering angle sensor 224 detects the steering angle of the vehicle and outputs steering angle data and the like. The GPS receiving unit 225 receives the navigation radio waves from the GPS satellites, and outputs the latitude, longitude, altitude data, the absolute orientation data in the traveling direction of the vehicle, the GPS speed data, and the like, which are the position information of the own vehicle, as GPS positioning data. The data transmission / reception unit 226 performs processing related to transmission / reception of data to / from the server device via the network. The line-of-sight detection camera 227 is a camera provided in the vehicle of a vehicle equipped with an in-vehicle device NV, and is a camera for detecting the line of sight of a user (referred to as a driver and a passenger; the same applies hereinafter), and has taken a picture. The image is output to the control unit 211. The out-of-vehicle camera 228 is provided outside the vehicle of the vehicle on which the in-vehicle device NV is mounted, and is a camera for detecting the surrounding environment of the vehicle, and outputs the captured image to the control unit 211. The vehicle exterior sensor 229 is a sensor that detects the temperature, humidity, rainfall, etc. outside the vehicle, and outputs the detection result to the control unit 211 via the input / output interface unit 220 and the bus line 215.

The storage device 212 stores various programs such as an operating system and an application program. The various programs may be acquired from a server device or the like via a network, or may be a recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a USB (Universal Serial Bus) memory. It may be possible to read and execute what is recorded in.

Further, the storage device 212 stores map image data for displaying a map on the display unit 214, map information used when searching for a route, road link information, and the like. Further, the storage device 212 stores information indicating so-called hiyari hat points such as intersections, railroad crossings, and confluences of highways where accidents are likely to occur. Further, the storage device 212 stores the operation history information indicating the operation history of the user's in-vehicle device NV or the line-of-sight movement history information indicating the movement history of the user's line of sight. At this time, the operation history information and the line-of-sight movement history information are stored together with the identification information indicating which user is the user. The identification information is identified by the control unit 211 based on the captured image output by the line-of-sight detection camera 227.

In addition to these, the storage device 212 is used as road information related to the above map information and road link information, such as road type information indicating a road type (for example, a type such as a highway, a general road, or a one-way road), or a road. Road width information indicating the width, road shoulder presence / absence information indicating the presence / absence of a road shoulder on each road, road shoulder width information indicating the width when the road shoulder is present, lane number information indicating the number of lanes (lanes) on each road, and each road. Central lane position information indicating the position of the central lane, parking space presence / absence information indicating the presence / absence of parking space for each road, parking space position information indicating the position of the parking space if there is the parking space, etc. are stored. Further, the storage device 212 stores parking lot information including parking lot type information indicating a parking lot type (service area, shopping mall parking lot, etc.), parking lot position information indicating the position of each parking lot, and the like. At this time, the parking lot position information includes position information indicating the longitude / latitude of the vertices of each side constituting the parking lot when the corresponding parking lot is viewed as a plane shape (range). Based on the information, it is configured so that the area connecting each vertex can be recognized as a parking lot. More specifically, for example, if the plane shape (range) of the corresponding parking lot is rectangular, the parking lot position information is within the range of the four points based on the position information indicated by the longitude / latitude of the four vertices. Is configured to be recognized as a parking lot.

The information stored in the storage device 212 may be stored in a server device (not shown) outside the vehicle-mounted device NV, and may be appropriately received and used.

The input device 213 is composed of a touch sensor, a touch panel, a keyboard, a mouse, a pressure detection sensor, a jog dial, and other controllers, receives an input operation of a user, and transmits an operation signal indicating the operation content to the control unit 211. do.

The display unit 214 displays various display data under the control of the control unit 211. The display unit 214 includes a graphics controller 214a, a buffer memory 214b made of a memory such as VRAM (Video RAM), a display 214c made of a liquid crystal display or the like, and the like. In this configuration, the graphics controller 214a controls the entire display unit 214 based on the control data sent from the control unit 211 via the bus line 215. Further, the buffer memory 214b temporarily stores image information that can be displayed immediately. Then, the image is displayed on the display 214c based on the image data output from the graphics controller 214a.

The control unit 211 includes a CPU 211a that controls the entire control unit 211, a ROM 211b that stores a control program that controls the control unit 211 in advance, and a RAM 211c that temporarily stores various data. The control unit 211 is connected to the vehicle speed sensor 221, the angular velocity sensor 222, the acceleration sensor 223, the steering angle sensor 224, and the GPS receiving unit 225 via the bus line 215 and the input / output interface unit 220, and is output from each. Based on speed data, angular velocity data and relative orientation data, steering angle data, GPS positioning data, absolute orientation data of the vehicle's traveling direction, acceleration data, etc., the entire in-vehicle device NV is controlled, and various display units such as the display unit 214 are controlled. It controls each operation of the components.

The control unit 211 acquires time information from the system clock, and acquires exchange information and SNS posting information from a server device (not shown). As the exchange information, information indicating the exchange rate between currencies set by the user is acquired, and as the SNS posting information, information indicating the posted article including the keyword set by the user is acquired. The control unit 211 acquires the time information and the exchange rate at predetermined intervals, and acquires the SNS posted information every time a new posted article is uploaded to a server device (not shown).

The control unit 211 specifies the configuration of the screen currently displayed on the display 214c. For example, the position and display contents of the part to be updated on the screen (for example, the time display area 401, the exchange display area 402, and the posted information display area 403 in FIG. 2), and the position of the part that can be operated by the user in the screen. Etc. are specified. Further, the control unit 211 specifies which information to be updated is the information for updating the acquired information. On the other hand, the control unit 211 identifies the surrounding environment such as the weather outside the vehicle and the road condition based on the captured image output by the vehicle outside camera 228 and the detection result by the vehicle outside sensor 229, respectively. Further, the control unit 211 specifies the direction of the user's line of sight based on the captured image output by the line-of-sight detection camera 227. Specifically, it is specified which user is looking at which of the time display area 401, the exchange rate display area 402, and the posted information display area 403 on the screen displayed on the display 214c.

Then, the control unit 211 determines whether or not to update the display contents of the time display area 401, the exchange display area 402, and the posting information display area 403 based on the acquired time information, exchange information, and SNS posting information. For example, whether or not to update the part to be updated (hereinafter, may be referred to as "updated part") by the acquired information based on at least one of the following rules (1) to (5). Can be determined.
(1) If the acquired information is information for updating the updated part to which the user's line of sight is directed, the update by the acquired information is postponed (update at that timing is prohibited). The same shall apply hereinafter.).
(2) If the acquired information is information for updating the updated part that is the target of the user's operation, the update by the acquired information is postponed.
(3) if a current position of Hiyari hat point the user is a driver of the vehicle to the car mounting device NV is mounted, conditions of the more detailed embodiments described below (hereinafter, (Referred to as "detailed conditions according to the embodiment") and the current level of automation of the operation of the vehicle (see Table 1) are taken into consideration, and the update based on the acquired information is postponed. On the other hand, even if the current position is the hiyari hat point, if the user is a passenger other than the driver, the update is performed regardless of the level of automation.
(4) When the current surrounding environment is not appropriate for updating information when the vehicle equipped with the in-vehicle device NV is moving, that is, when the surroundings are heavy rain as described above, the road currently being driven. If the vehicle is congested, or if the road currently being driven is a very narrow road and the user is the driver, the detailed conditions according to the embodiment and the level of automation are taken into consideration. After that, the update by the acquired information is postponed. On the other hand, even if the current surrounding environment is not appropriate for updating the information when the vehicle is moving, if the user is the passenger, the update is performed regardless of the level of automation.
(5) The acquired information is information for updating the updated portion in which the user's operation is performed (the line of sight is directed) within an arbitrarily set time, and the above user is described above. If you are a driver, you will not be able to update with the acquired information. On the other hand, even if the acquired information is information for updating the updated portion in which the user's operation was performed (the line of sight was directed) within an arbitrarily set time, the above-mentioned user If you are a passenger, the update will be performed.

However, if the acquired information is information that is preferable to display the latest information such as time information, even if the above rules (1) to (5) are met (that is, the user's operation). Whether or not the information is subject to the above, whether or not the surrounding environment is appropriate for updating information when the vehicle is moving, or regardless of the level of automation described above), the information will always be updated based on the acquired information. On the other hand, when the SNS posted information corresponds to the above rules (1) to (5) (that is, when it is the target of the user's operation, or when the surrounding environment is not appropriate for updating the information when the vehicle moves. In the case of), the update by the acquired information will be postponed according to the level of automation.

(III) Operation Example of Vehicle-mounted Device According to Example Next, an operation example of the vehicle-mounted device NV according to the embodiment will be described with reference to the flowchart of FIG. It is assumed that the calibration of the line-of-sight detection of the occupant of the vehicle by the line-of-sight detection camera 227 has been completed. Further, the control unit 211 detects the line of sight of the user, stores the movement history of the line of sight in the storage device 212, and stores the operation history in the storage device 212 when the operation by the user is performed.

First, the control unit 211 acquires output information (time information, exchange information, or SNS posting information) (step S11). Next, the control unit 211 specifies an update portion (time display area 401, exchange display area 402, or posted information display area 403) to be updated by the output information acquired in the process of step S11 (step S12). For example, the control unit 211 specifies the time display area 401 as the update part if the acquired output information is time information, and specifies the post information display area 403 as the update part if the acquired output information is SNS posting information. do.

Next, the control unit 211 determines whether or not the output information acquired in the process of step S11 is information that does not require update delay (step S13). In this embodiment, for convenience of explanation, it is assumed that the time information is output information that does not require update delay, while the exchange information and SNS posting information are not output information that does not require update delay (that is, output that requires update delay). Information). When the control unit 211 determines that the acquired output information is information (time information) that does not require update delay (step S13: YES), the control unit 211 identifies the acquired output information (time information) in the process of step S12. The information in the updated portion (time display area 401) is updated (step S24), and the process proceeds to step S11. On the other hand, when the control unit 211 determines that the acquired output information is not information that does not require update delay (that is, when it is determined that it is exchange information or SNS posting information) (step S13: NO), then it is used. The person's current line-of-sight information and operation information are acquired (step S14).

Next, the control unit 211 acquires user information indicating a user of the in-vehicle device NV based on an image from the line-of-sight detection camera 227, information from a seat sensor (not shown), and the like (step S15). The user information in this case includes, for example, whether or not the driver is sitting in the driver's seat, or whether or not a passenger other than the driver is sitting in the passenger seat or the back seat.

Next, the control unit 211 determines whether or not the driver's line of sight is directed to the updated portion specified in the process of step S12, based on the line-of-sight information acquired in the process of step S14 (step S16). At this time, when the control unit 211 determines that the driver's line of sight is directed to the update portion (step S16: YES), the control unit 211 uses the output information acquired in step S11 to move to the update portion specified by the process of step S12. The update of the displayed information is postponed (step S25), and the process proceeds to step S11. As a result, even if new output information is acquired for the updated portion to which the driver is looking, the information of the updated portion is not updated by the output information, so that the driver's understanding of the content of the output information is deepened. On the other hand, when the control unit 211 determines that the driver's line of sight is not directed to the update portion (step S16: NO), then the driver's operation target is based on the operation information acquired in the process of step S14. Is determined whether or not is the update portion specified in the process of step S12 (step S17). At this time, for example, if the output information acquired in the process of step S11 is SNS posting information and the driver is performing a scrolling operation on the posting information display area 403, it is determined as "YES".

When the control unit 211 determines that the operation target of the driver is the update portion specified in the process of step S12 (step S17: YES), the control unit 211 identifies the driver by the process of step S12 based on the output information acquired in step S11. The update of the information displayed in the updated portion is postponed (step S25), and the process proceeds to the process of step S11. As a result, even if new output information is acquired for the updated portion operated by the driver, the information of the updated portion is not updated by the output information, so that the driver's understanding of the content of the output information is deepened. On the other hand, when the control unit 211 determines that the driver's current operation target is not the update portion specified in the process of step S12 (step S17: NO), then the driver's operation history information and line-of-sight movement history Information, current location information, and surrounding environment information are acquired (step S18). Specifically, the control unit 211 acquires the driver's operation history information and the line-of-sight movement history information from the storage device 212, acquires the latitude, longitude, and altitude data output by the GPS receiving unit 225 as the current position information, and acquires the outside camera. The surrounding environment information is acquired by analyzing the image of the outside of the vehicle output by 228 and the detection result output by the outside sensor 229. The surrounding environment information is information indicating whether or not the current surrounding environment is in an inappropriate situation for updating information when the vehicle is moving, and the control unit 211 outputs a photographed image and the outside of the vehicle by the outside camera 228. Based on the detection results output by the sensor 229, it is calculated and acquired based on the weather outside the vehicle, the road conditions, and the like. For example, if it is heavy rain, the road currently being driven is congested, or the road currently being driven is a very narrow road, it is not appropriate for updating information when the vehicle is moving. Surrounding environment information indicating that is acquired. The control unit 211 transmits the current position of the own vehicle to a server device (not shown) that holds information indicating the weather and road conditions for each position via the network, and the server device corresponds to the current position. You may acquire the relevant information and calculate the surrounding environment information based on the relevant information. Further, the control unit 211 uses a network for a server device that calculates inappropriate information indicating the degree of information update when the environment around the position is not appropriate for updating the information when the vehicle moves for each position. The current position of the own vehicle may be transmitted, and inappropriate information may be acquired from the server device as ambient environment information.

Next, the control unit 211 determines whether or not the level of automation in the current driving state of the vehicle is level 4 shown in Table 1 above, that is, when the vehicle equipped with the in-vehicle device NV is in a fully automated driving state. It is determined whether or not the vehicle is moving (step S19). For the determination in step S19, for example, automatic driving state information output from an automatic driving control unit (not shown) can be used. The detection process itself at this level of automation can use the same method as before. In the determination of step S19, when the level of automation in the current driving state of the vehicle is level 4 shown in Table 1 above (step S19: YES), the control unit 211 shifts to step S24 and is a necessary update portion. Update.

On the other hand, in the determination of step S19, if the level of automation is a level other than the above level 4 (step S19: NO,), then the control unit 211 is based on the user information acquired in the above step S15. , It is determined whether or not the current user of the vehicle-mounted device NV is a driver (step S20). In the determination of step S20, when the current user of the in-vehicle device NV is a passenger other than the driver (step S20: NO), the control unit 211 proceeds to step S24 to update the necessary update portion. On the other hand, in the determination of step S20, when the current user of the in-vehicle device NV is the driver (step S20: YES), the control unit 211 next obtains the driver's operation history information and the line of sight acquired in the process of step S18. Based on the movement history information, it is determined whether or not the updated portion specified in the process of step S12 is the updated portion that has been the target of the operation or the line of sight is directed within a predetermined time from the present (step S21). .. For example, the control unit 211 determines whether or not the update portion is the target of the operation or the line of sight is directed from the present to 30 seconds before. When the control unit 221 determines that the operation target or the update portion to which the line of sight is directed within a predetermined time (step S21: YES), the output information acquired in step S11 is used in step S12. The update of the information displayed in the update portion specified by the process is postponed (step S25), and the process proceeds to the process of step S11. As a result, even if new output information is acquired for the updated part that the driver was looking at until a predetermined time ago or was the target of the operation, the information of the updated part is not updated by the output information. When the driver turns his gaze to the information to view the information again, he can view the same output information as before. On the other hand, when the control unit 211 determines that the operation target is not the update part to which the line of sight is directed within a predetermined time (step S21: NO), then the current position acquired in the process of step S18 is obtained. Based on the information and the information indicating the hiyari hat point stored in the storage device 212, it is determined whether or not the current position is at or near the hiyari hat point (for example, within 50 meters from the hiyari hat point; the same applies hereinafter). Step S22).

In the determination of step S22, when it is determined that the current position is at or near the hiyari hat point (step S22: YES), the control unit 211 next indicates the level of automation in the current driving state of the vehicle in Table 1 above. Determining which level except level 4 (see step S19) shown, that is, at which level of automation other than the fully automated driving state the vehicle equipped with the in-vehicle device NV is moving. (Step S26). As for the determination in step S26, for example, the automatic traveling state information and the like can be used in the same manner as in the determination in step S19. In the determination of step S26, when the level of automation in the current driving state of the vehicle is level 3 shown in Table 1 above (step S26: 3), the control unit 211 shifts to step S23 described later. On the other hand, in the determination of step S26, when the level of automation in the current driving state of the vehicle is level 1 or level 2 shown in Table 1 above (steps S26: 1 and 2), the control unit 211 then steps. With respect to the update of the information displayed in the update portion specified by the process of step S12 by the output information acquired in S11, it is determined to suspend the information based on the detailed conditions according to the embodiment (step S27). In the determination of step S27, when the update of the information based on the detailed condition is postponed (step S27: YES), the control unit 211 suspends the update of the information (step S25) and shifts to the process of step S11. do. As a result, if the current position is the hiyari hat point, the level of automation is low, and the update of information is postponed based on the detailed conditions, even if new output information is acquired, the update portion is based on the output information. The information is not updated, so the driver can concentrate on driving. On the other hand, when the control unit 211 does not suspend the update of information (that is, updates the information) based on the detailed conditions in the determination of step S27 (step S27: NO), the process proceeds to step S23 described later.

On the other hand, when it is determined in step S22 that the current position is not at or near the hiyari hat point (step S22: NO), the control unit 211 determines the surrounding environment based on the ambient environment information acquired in the process of step S18. Is not appropriate for updating information when the vehicle is moving, it is determined whether or not the situation is high (step S23).

If it is determined in step S23 that the surrounding environment is not of a high degree (step S23: NO), the control unit 211 is based on the output information (exchange information or SNS posting information) acquired in the process of step S11. The information of the update portion (exchange display area 402 or posted information display area 403) specified in the process of step S12 is updated (step S24), and the process proceeds to the process of step S11.

On the other hand, in the determination of step S23, when it is determined that the degree of the surrounding environment is not appropriate for updating the information when the vehicle is moving (step S23: YES), the control unit 211 is next. In addition, the level of automation in the current driving state of the vehicle is any level except level 4 (see step S19) shown in Table 1 above, that is, the vehicle equipped with the in-vehicle device NV is fully automated. It is determined again at which level of automation other than the running state whether or not the vehicle is moving (step S28). As for the determination in step S28, for example, the automatic driving state information and the like can be used in the same manner as in the determination in step S19 or step S26. In the determination of step S28, when the level of automation in the current driving state of the vehicle is level 2 or level 3 shown in Table 1 above (steps S28: 2, 3), the control unit 211 shifts to step S24. .. On the other hand, in the determination of step S28, when the level of automation in the current driving state of the vehicle is level 1 shown in Table 1 above (step S28: 1), the control unit 211 next obtains the output information in step S11. With respect to the update of the information displayed in the update portion specified by the process of step S12, a decision of suspension is made based on the detailed conditions according to the same embodiment as in step S27 (step S29). In the determination of step S29, when the update of the information based on the detailed condition is postponed (step S29: YES), the control unit 211 suspends the update of the information (step S25) and shifts to the process of step S11. do. As a result, when the surrounding environment has a high degree of the above, the level of automation is low, and the update of information is postponed based on the detailed conditions, even if new output information is acquired, it is updated by the output information. The information in the part is not updated, so the driver can concentrate on driving. On the other hand, when the control unit 211 does not suspend the update of the information (that is, updates the information) based on the detailed conditions in the determination of the step S29 (step S29: NO), the control unit 211 shifts to the step S24.

The determination in step S28 is based on the premise that the control unit 211 can determine the degree based on the captured image output by the vehicle exterior camera 228 and the detection result output by the vehicle exterior sensor 229. On the other hand, a special case in which the control unit 211 cannot determine the above degree based on the captured image output by the vehicle exterior camera 228 and the detection result output by the vehicle exterior sensor 229, for example, due to an excessively strong storm. In this case, it is preferable that the control unit 211 shifts to the step S29 for all the automation levels other than the level 4, that is, does not perform (skips) the determination itself of the step S28 as the determination of the step S28.

Next, the determination of the suspension based on the detailed conditions according to the embodiment in steps S27 and S29 will be specifically described with reference to FIG. Since the determination of the postponement based on the detailed conditions according to the embodiment in step S27 and the determination of the postponement based on the detailed conditions in the step S29 are the same, these are collectively referred to with reference to FIG. explain.

As shown in FIG. 6, when the determination in step S26 is "1, 2" (in the case of step S27), or when the determination in step S28 is "1" (in the case of step S29). In each, the control unit 211 first acquires the road information and the parking lot information from the storage device 212 (step SA), and then mounts the in-vehicle device NV based on the current position information from the GPS receiving unit 225. The current position of the vehicle is detected (step SB). Next, the control unit 211 determines whether or not the vehicle is currently located off the road based on the current position detected in step SB (step SC).

Here, the "off-road" in accordance with the embodiment, for example, the Road Traffic Law in (1960 June 25th Act No forth in item), the car mounting device N V is a vehicle equipped with A point or area where parking or stopping is permitted. More specifically, the term "outside the road" means, for example, the following points or areas.
・ "Roadside zone" specified by the Road Traffic Act, excluding "parking prohibited roadside zone" and "pedestrian-only roadside zone" specified by the Road Traffic Act
・ When a sidewalk is separately provided along the roadway, the area of the roadway outside the outside line of the roadway when viewed from the center line ・ So-called parking lot or parking space (for example, a time-limited parking space on the road, etc.) )
In the determination of step SC, when the vehicle is not currently located off the road (that is, the vehicle is located on a road other than the road) (step SC: NO), control is performed. The unit 211 sets “YES” as the determination in step S27 or the determination in step S29, and proceeds to step S25 in FIG.

On the other hand, in the determination of step SC, when the vehicle is currently located off the road (step SC: YES), the control unit 211 next bases the position of the vehicle detected in step SB and the like. Then, it is determined whether or not the vehicle is currently stopped (step SD). In the determination of step S-D, when the vehicle is not currently stopped (that is, the vehicle is moving) (step S-D: NO), the control unit 211 determines the determination in step S27 or the determination in step S29. Is set to "YES", and the process proceeds to step S25.

On the other hand, in the determination of step S-D, when the vehicle is currently stopped (step S-D: YES), the control unit 211 sets "NO" as the determination of step S27 or the determination of step S29, and the above step. The process proceeds to S23 (in the case of step S27) or step S24 (in the case of step S29).

By performing the operation example of the in-vehicle device NV including the determination of step S26 and the determination of step S28 described above centering on the control unit 211, for example, in the determination of step S16, the driver's line of sight is directed to the updated portion. The level of automation in the current driving state of the vehicle is shown in Table 1 above when the driver's operation target is not the update part (see FIG. 5 step S17: NO). At level 4 (see step S19: YES), since the vehicle is in a fully automated driving state, the information in the updated portion is updated (see step S24 in FIG. 5).

Further, for example, in the determination of step S16, the driver's line of sight is not directed to the update portion (see step S16: NO in FIG. 5), and the operation target of the driver is not the update portion (see step S17: NO in FIG. 5). ), The level of automation in the current driving state of the vehicle is level 3 shown in Table 1 above (FIG. 5 step S26: NO), and if there is no congestion on the road and the weather is fine (FIG. 5 step S23). : NO), even if the current position of the vehicle at the timing when the output information for update is acquired in step S11 is at or near the hiyari hat point (see step S22: YES in FIG. 5), it is considered that there is no problem. The information in the updated portion is updated (see step S24 in FIG. 5).

Further, for example, in the determination of step S16, the driver's line of sight is not directed to the updated portion (see step S16: NO in FIG. 5), and the operation target of the driver is not the updated portion (see step S17: NO in FIG. 5). ), If the level of automation in the current driving state of the vehicle is level 3 shown in Table 1 above (step S28: 2, 3 in FIG. 5), there is no congestion on the road, but the vehicle is driven by the outside sensor 229. Even if the amount of rainfall that hinders the above is detected (see step S23: YES in FIG. 5), it is considered that there is no problem, so the information in the updated portion is updated (see step S24 in FIG. 5).

As described above, the control unit 211 (“output information acquisition means”, “state information acquisition means”, “control means”, “environmental environment information acquisition means” and “detection means” of the vehicle-mounted device NV according to the embodiment. In the control of updating the output information by one example), the possibility of updating the output information is controlled based on the control state regarding the movement in the vehicle, so that it is possible to finely and appropriately control the possibility of updating the output information, and the driver can control the update. Can be focused on driving.

Further, in the control of whether or not the output information can be updated by the control unit 211, the control state is a state of automation of vehicle driving in which a plurality of levels are preset (see Table 1), and is a state acquired by the control unit 211. Since the information indicates what level of automation the current vehicle driving automation is, it is possible to finely and appropriately control whether or not the output information can be updated according to the level of vehicle driving automation. The driver can concentrate on driving.

Further, in the control of whether or not the output information can be updated by the control unit 211, whether or not the output information can be updated is controlled based on the control state of the vehicle and the surrounding environment. It can be controlled and the driver can concentrate on driving.

Furthermore, in the control of whether or not the output information can be updated by the control unit 211, it is controlled to update the output information when it is indicated that the driving state of the vehicle is a fully automated driving state, while the driving state is automated. Update of output information when it is automation corresponding to level 1 of (see step S28: 1 in FIG. 5) and it is shown that the surrounding environment is not suitable for updating output information (see step S23: YES in FIG. 5). Therefore, it is possible to finely and appropriately control whether or not the output information can be updated, and the driver can concentrate on driving.

Further, in the control of whether or not the output information can be updated by the control unit 211, when the output information is the target of the operation of a passenger other than the driver (FIG. 5, step S20: NO), the output information is updated regardless of the surrounding environment. Since it is controlled so as to be possible, the output information can be appropriately updated when it is the target of the movement of a passenger other than the driver.

In the control of whether or not the output information can be updated by the control unit 211, the control state of the vehicle is either a fully automated driving state corresponding to level 4 of automation or an automatic driving state other than the fully automated driving state. Output information when the state information acquired by the control unit 211 is the state information indicating one of the driving states, and it is shown that the driving state of the vehicle is the driving state of the vehicle other than the fully automated driving state. In the above-mentioned special case of controlling so as to prohibit the update of the output information, it is possible to finely and appropriately control whether or not the output information is updated, and the driver can concentrate on the driving.

Further, in the above embodiment, it is determined in the process of step S22 whether or not the current position is the hiyari hat point, and in the process of step S23, whether or not the surrounding environment is not appropriate for updating the information when the vehicle moves. However, even if the current position is the hiyari hat point, it is considered that the surrounding environment is not appropriate for updating information when the vehicle is moving. Therefore, the "surrounding environment" of the present invention is determined. "Not appropriate for updating information when moving" includes the case where the current position is a hiyari hat point.

(IV) Modification Example Next, a modification of the above embodiment will be described. In addition, each modification described below can be combined appropriately.

(IV.1) First Modification Example In the above embodiment, the display 214c is exemplified as a device for outputting information, but in addition to this, another output device (for example, HUD (Head-Up Display). See FIG. 4). May be provided to control the update of the information output by the plurality of output devices. In this case, the control unit 211 can specify the configuration of the screen displayed on the display 214c and the HUD.

(IV.2) Second Modified Example In the above embodiment, the line of sight of the user (driver, passenger) is detected based on the captured image output by the line-of-sight detection camera 227, but the line of sight of the user is detected. It may be detected based on the data output by the electrooculogram sensor.

(IV.3) Third Modification Example In the above embodiment, it is determined whether or not the current position is the hiyari hat point in the process of step S22, but whether or not the current position is close to the hiyari hat point is determined. It may be determined. As a result, when the current position is close to the hiyari hat point or the current position is the hiyari hat point, the update is postponed and the user (driver) can concentrate on driving.

(IV.4) Fourth Modification Example In the above embodiment, after the update is postponed in the process of step S25, the process proceeds to step S11 and the next output information is acquired. Therefore, in the process of the latest step S11. The output information will be discarded without being updated by the acquired output information, but the output information acquired in the process of step S11 must be updated by the output information acquired in the process of step S11. Is stocked in the storage device 212, and when the process of step S24 is executed, the stocked output information is used for updating (FIFO (First In First Out)) in order from the oldest output information. May be good.

(IV.5) Fifth Modification Example The above embodiment has described the case where the information processing device is an in-vehicle device NV mounted on a vehicle, but it is applied to any device that moves with a moving body and outputs information. be able to. For example, it can be applied to a PC (personal computer), a notebook PC, a smartphone, a tablet, or the like.

(IV.6) Sixth Modification Example In the flowchart of FIG. 5 according to the above embodiment, steps S16 and S17, and steps S18 to S23 and steps S26 to S29 are included in the respective processing (step) groups. You may replace them while maintaining the order of.

1 Information processing device 111A Output information acquisition means 111B Status information acquisition means 111C Control means 111D Surrounding environment information acquisition means 111E Detection means 2 Output means 211 Control unit 211a CPU
211b ROM
211c RAM
212 Storage device 213 Input device 214 Display unit 214a Graphics controller 214b Buffer memory 214c Display 215 Bus line 220 Input / output interface unit 221 Vehicle speed sensor 222 Angle speed sensor 223 Acceleration sensor 224 Steering angle sensor 225 GPS receiver 226 Data transmission / reception unit 227 Line-of-sight detection Camera 228 External camera 229 External sensor NV In-vehicle device

Claims (8)

Output information acquisition means for acquiring output information that is displayed and updatable on the display means provided in the mobile body, and
A state information acquisition means for acquiring state information indicating a control state related to movement in the moving body, and
Based on the acquired state information, a control means for controlling whether or not the update portion of the output information displayed on the display means can be updated, and a control means.
Equipped with
Wherein, the case updating of whether is negative, the information processing apparatus characterized that you keep the display of the updated portion in the pre-update state. In the information processing apparatus according to claim 1,
An information processing apparatus characterized in that the output information in which the display of the update portion is maintained in the state before the update is the output information set as the output information for which the update should be postponed. In the information processing apparatus according to claim 1 or 2.
The control means is an information processing apparatus characterized in that the possibility of updating is controlled based on the acquired state information and the output information. The information processing apparatus according to any one of claims 1 to 3.
The control state is a state of automation of the operation of the moving body in which a plurality of levels are preset.
The information processing device is characterized in that the state information is state information indicating which level of automation the current automation of the operation of the moving body is. The information processing apparatus according to any one of claims 1 to 4.
The control state is a fully automated operation state in which all of acceleration, steering, and braking in the operation of the moving body are automated and the driver of the moving body is not involved in the driving at all, or the movement other than the fully automated driving state. It is one of the driving conditions of the body,
The state information is state information indicating any of the above operating states.
Wherein when it pre SL operating state is the operating state of the movable body other than the fully automated operation state Ru Tei indicated by the state information, Ru forego updating of output information being the display An information processing device characterized by being controlled in such a manner. The information processing apparatus according to any one of claims 1 to 5.
The surrounding environment information acquisition means for acquiring the surrounding environment information regarding the surrounding environment of the moving body, and
A detection means for detecting the movement of a passenger other than the driver of the moving body, and
Further prepare
The control means controls whether or not the displayed output information can be updated based on the control state indicated by the acquired state information and the surrounding environment related to the acquired surrounding environment information. ,
The control state is a fully automated operation state in which all of acceleration, steering, and braking in the operation of the moving body are automated and the driver of the moving body is not involved in the driving at all, or the movement other than the fully automated driving state. It is one of the driving conditions of the body,
The state information is state information indicating any of the above operating states.
The control means is
When the state information indicates that the operation state is the fully automated operation state, the output information displayed is controlled to be updated.
The state information indicates that the operating state is an operating state other than the fully automated operating state, and the surrounding environment information indicates that the surrounding environment is not suitable for updating the output information. In that case, control so as not to update the output information displayed above,
When the output information is the target of the detected operation, the output information is controlled so as to be able to be updated regardless of the surrounding environment regarding the acquired surrounding environment information. Information processing device. In the information processing method executed in the information processing device
An output information acquisition process for acquiring output information that is displayed and updatable on the display means provided in the mobile body, and
A state information acquisition step of acquiring state information indicating a control state related to movement in the moving body, and
Based on the acquired state information, a control step for controlling whether or not to update the updated portion in the output information displayed on the display means, and
Only including,
In the control step, an information processing method characterized in that the display of the updated portion is maintained in the state before the update when the update is possible or not. An information processing program characterized in that a computer connected to the display means functions as the information processing device according to any one of claims 1 to 6.

Images