WO2023067689A1 - 異常検出装置及び異常検出方法 - Google Patents

異常検出装置及び異常検出方法 Download PDF

Info

Publication number
WO2023067689A1
WO2023067689A1 PCT/JP2021/038607 JP2021038607W WO2023067689A1 WO 2023067689 A1 WO2023067689 A1 WO 2023067689A1 JP 2021038607 W JP2021038607 W JP 2021038607W WO 2023067689 A1 WO2023067689 A1 WO 2023067689A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen display
display
screen
detection device
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/038607
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
智 市川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nissan Motor Co Ltd
Original Assignee
Nissan Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nissan Motor Co Ltd filed Critical Nissan Motor Co Ltd
Priority to EP21961342.9A priority Critical patent/EP4422171B1/en
Priority to US18/701,846 priority patent/US12547497B2/en
Priority to CN202180103204.6A priority patent/CN118104233A/zh
Priority to PCT/JP2021/038607 priority patent/WO2023067689A1/ja
Priority to JP2023554120A priority patent/JP7619472B2/ja
Publication of WO2023067689A1 publication Critical patent/WO2023067689A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/04—Diagnosis, testing or measuring for television systems or their details for receivers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1415—Saving, restoring, recovering or retrying at system level
    • G06F11/1438—Restarting or rejuvenating
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/805—Real-time
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/10—Special adaptations of display systems for operation with variable images
    • G09G2320/103—Detection of image changes, e.g. determination of an index representative of the image change
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2330/00—Aspects of power supply; Aspects of display protection and defect management
    • G09G2330/12—Test circuits or failure detection circuits included in a display system, as permanent part thereof
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2358/00—Arrangements for display data security
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2380/00—Specific applications
    • G09G2380/10—Automotive applications

Definitions

  • the abnormality detection device 4 has a function of detecting a so-called screen display freeze state among screen display abnormalities.
  • the screen display freeze state is a state in which the screen display does not respond to the passenger's operation even if the passenger operates the operation device 2 .
  • a method for detecting a frozen state of screen display will be described later.
  • the outline of the screen display system 100 is as described above.
  • the term "application” is synonymous with the term “application software” which means software designed for a specific use or purpose.
  • the term “button” is synonymous with the term “push switch” that opens and closes by moving the operating portion in its axial direction by pressing with the finger of the passenger.
  • the navigation system 32 is a system for providing route guidance to passengers, and has a navigation application 32A as an application related to the screen display of the center display 12.
  • a screen transition instruction is input from the abnormality detection device 4, the navigation system 32 generates an image corresponding to the operation content of the passenger.
  • the navigation system 32 outputs screen configuration information generated by the navigation application 32 ⁇ /b>A to the abnormality detection device 4 .
  • the user operation detection unit 41 detects the operation of the passenger when the operation device 2 is operated by the passenger.
  • the user operation detection section 41 includes an operation data acquisition section 411 and an operation monitoring section 412 .
  • the operation data acquisition unit 411 acquires, from the operation device 2, operation data including at least the type of the operation device 2 operated by the passenger and details of the operation by the passenger.
  • the operation monitoring unit 412 identifies the details of the operation performed by the occupant by using the acquisition of the operation data as a trigger.
  • the operation monitoring unit 412 outputs user operation data including details of operations performed by the passenger to the screen display management unit 42 .
  • the screen output unit 43 When the screen display data is input from the screen display management unit 42 , the screen output unit 43 outputs the input screen display data to the display 1 .
  • the target area extraction unit 441 may extract the target area step by step from the screen display of the display 1. For example, the target area extracting unit 441 identifies a screen area whose display content does not change regardless of the operation of the occupant from screen display data corresponding to the entire screen display of the display 1, and extracts a screen area corresponding to the entire screen display of the display 1. Screen display data corresponding to the specified screen area is removed from the display data. Next, the target area extraction unit 441 extracts screen display data corresponding to a part of the screen display from the removed screen display data. Note that the method for extracting the target region described above is an example, and the method for extracting the target region is not limited.
  • the screen display freeze detection unit 45 starts determining whether or not the screen display has transitioned. Specifically, when the capture instruction is input to the screen display data monitoring unit 44, the screen display freeze detection unit 45 causes the screen display data monitoring unit 44 to display the CRC data calculation processing is executed for the screen display data. Further, when a monitoring start instruction is input to the screen display data monitoring unit 44, the screen display freeze detection unit 45 transfers the screen display data saved in the screen display buffer by the screen display management unit 42 to the screen display data monitoring unit 44. Output. Then, the screen display freeze detection unit 45 causes the screen display data monitoring unit 44 to perform CRC data calculation processing on the output screen display data.
  • the screen display freeze detection unit 45 compares the screen display data when the occupant operates the operation device 2 with the screen display data after a predetermined period of time has passed, thereby determining whether the screen display of the display 1 has changed. determine whether In this embodiment, the screen display freeze detection unit 45 separates screen display data corresponding to the target area when the passenger operates the operation device 2 and screen display data corresponding to the target area after a predetermined period of time has elapsed. By comparing, it is determined whether or not the screen display has changed. Specifically, in this embodiment, the screen display freeze detection unit 45 compares the CRC data of the target area when the occupant operates the operation device 2 with the CRC data of the target area after a predetermined period of time has passed.
  • FIG. 5 is an example of a flowchart showing processing executed by the screen display data monitoring unit 44 and the screen display freeze detection unit 45.
  • step S ⁇ b>31 the screen display data monitoring unit 44 determines whether or not a screen capture instruction has been obtained from the screen display management unit 42 .
  • the screen capture instruction output from the screen display management unit 42 is the screen capture instruction output in step S15 of FIG. If the determination is affirmative, the process proceeds to step S32. On the other hand, if a negative determination is made, the screen display data monitoring unit 44 waits in step S31 until an affirmative determination is made.
  • step S35 the screen display freeze detection unit 45 outputs a calculation instruction to cause the screen display data monitoring unit 44 to execute the target area extraction process.
  • the screen display data monitoring unit 44 executes a target area extraction process on the screen display data saved in the screen display buffer in step S18 of FIG.
  • the screen display data monitoring unit 44 selects, among the screen display of the display 1, the target screen area for determining whether or not the screen display of the display 1 is in a frozen state, in accordance with the target area extracted in step S32. Extract as a region.
  • the target area extracted in step S32 and the target area extracted in step S35 have the same position on the screen display of the display 1, and the size and shape of the screen area.
  • step S36 the screen display data monitoring unit 44 calculates CRC data for the screen display data extracted in step S35.
  • an abnormality detection method using a watchdog timer As a method for determining whether an abnormality has occurred in the system functions, for example, an abnormality detection method using a watchdog timer has been conventionally known.
  • a monitoring signal is periodically generated inside the system, and an anomaly is detected depending on the presence or absence of a response to the signal.
  • the watchdog timer is initialized, but processing within the system does not progress due to a response to a monitoring signal. This type of failure cannot be detected by the watchdog timer anomaly detection method.
  • the recovery processing unit 56 determines that the screen display is not maintained in a frozen state. If the recovery processing unit 56 makes an affirmative determination, the process proceeds to step S54, and if a negative determination is made, the recovery processing unit 56 terminates the processing of the flowchart shown in FIG. In order to reduce the computational load of the abnormality detection device 4, it is preferable that the CRC data comparison process be performed using the CRC data of the target area, as in the first embodiment.
  • the recovery processing unit 56 outputs an instruction to restart the target system to the target system.
  • recovery processing for canceling the frozen state of the screen display is executed, and the frozen state of the screen display can be eliminated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
PCT/JP2021/038607 2021-10-19 2021-10-19 異常検出装置及び異常検出方法 Ceased WO2023067689A1 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP21961342.9A EP4422171B1 (en) 2021-10-19 2021-10-19 Failure detection device and failure detection method
US18/701,846 US12547497B2 (en) 2021-10-19 2021-10-19 Abnormality detection device and abnormality detection method
CN202180103204.6A CN118104233A (zh) 2021-10-19 2021-10-19 异常检测装置和异常检测方法
PCT/JP2021/038607 WO2023067689A1 (ja) 2021-10-19 2021-10-19 異常検出装置及び異常検出方法
JP2023554120A JP7619472B2 (ja) 2021-10-19 2021-10-19 異常検出装置及び異常検出方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/038607 WO2023067689A1 (ja) 2021-10-19 2021-10-19 異常検出装置及び異常検出方法

Publications (1)

Publication Number Publication Date
WO2023067689A1 true WO2023067689A1 (ja) 2023-04-27

Family

ID=86058932

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/038607 Ceased WO2023067689A1 (ja) 2021-10-19 2021-10-19 異常検出装置及び異常検出方法

Country Status (5)

Country Link
US (1) US12547497B2 (https=)
EP (1) EP4422171B1 (https=)
JP (1) JP7619472B2 (https=)
CN (1) CN118104233A (https=)
WO (1) WO2023067689A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119369932A (zh) * 2024-12-30 2025-01-28 长城汽车股份有限公司 车辆屏幕的控制方法、电子设备及车辆

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119537119B (zh) * 2025-01-16 2025-07-04 荣耀终端股份有限公司 冻屏检测方法及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003222596A (ja) * 2002-01-30 2003-08-08 Nissan Motor Co Ltd 情報提供装置の画面遷移検査装置及び方法
JP2008193145A (ja) * 2007-01-31 2008-08-21 Ntt Communications Kk 映像異常検出装置、映像伝送装置、映像異常検出方法、及び映像伝送方法
JP2009073386A (ja) 2007-09-21 2009-04-09 Hitachi Ltd ナビゲーション利用自動車制御装置および制御方法
JP2016074290A (ja) * 2014-10-06 2016-05-12 株式会社デンソー 車両用モニタシステム
JP2018107588A (ja) * 2016-12-26 2018-07-05 ルネサスエレクトロニクス株式会社 画像処理装置および半導体装置
WO2018225210A1 (ja) * 2017-06-08 2018-12-13 三菱電機株式会社 異常検出装置及び異常検出方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6694695B2 (ja) 2015-10-29 2020-05-20 株式会社デンソーテン 画像処理装置、及び、画像処理方法
US11131987B2 (en) * 2018-03-15 2021-09-28 Xinxin Wang Method and system for preventing and detecting hazardously misleading information on safety-critical display
KR102153718B1 (ko) 2019-06-12 2020-09-08 주식회사 텔레칩스 화면 멈춤을 초래하는 정지 프레임을 결정하는 차량 클러스터 장치 및 그 방법
KR102663270B1 (ko) * 2022-01-25 2024-05-07 현대모비스 주식회사 차량의 디스플레이 장치의 화면 정지 오류를 검출하는 방법 및 장치

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003222596A (ja) * 2002-01-30 2003-08-08 Nissan Motor Co Ltd 情報提供装置の画面遷移検査装置及び方法
JP2008193145A (ja) * 2007-01-31 2008-08-21 Ntt Communications Kk 映像異常検出装置、映像伝送装置、映像異常検出方法、及び映像伝送方法
JP2009073386A (ja) 2007-09-21 2009-04-09 Hitachi Ltd ナビゲーション利用自動車制御装置および制御方法
JP2016074290A (ja) * 2014-10-06 2016-05-12 株式会社デンソー 車両用モニタシステム
JP2018107588A (ja) * 2016-12-26 2018-07-05 ルネサスエレクトロニクス株式会社 画像処理装置および半導体装置
WO2018225210A1 (ja) * 2017-06-08 2018-12-13 三菱電機株式会社 異常検出装置及び異常検出方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4422171A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119369932A (zh) * 2024-12-30 2025-01-28 长城汽车股份有限公司 车辆屏幕的控制方法、电子设备及车辆

Also Published As

Publication number Publication date
CN118104233A (zh) 2024-05-28
US12547497B2 (en) 2026-02-10
US20240419553A1 (en) 2024-12-19
JP7619472B2 (ja) 2025-01-22
EP4422171B1 (en) 2025-12-03
JPWO2023067689A1 (https=) 2023-04-27
EP4422171A1 (en) 2024-08-28
EP4422171A4 (en) 2024-11-20

Similar Documents

Publication Publication Date Title
US9910660B2 (en) Operating system replacement for in-vehicle computing system
US11492011B2 (en) Autonomous driving control device and method for autonomous driving control of vehicles
JP6011379B2 (ja) 改竄検知システム、電子制御ユニット
JP6073497B2 (ja) 表示制御装置、情報表示方法および情報表示システム
JP2015032314A5 (https=)
JP6567642B2 (ja) オペレーティングシステム起動加速
JP7619472B2 (ja) 異常検出装置及び異常検出方法
US10960898B2 (en) Method and arrangement for interacting with a suggestion system having automated operations
US10399494B2 (en) Vehicle-mounted warning system
JP6577566B2 (ja) オペレーティングシステム起動加速
US10379871B2 (en) Operating system startup acceleration
US7317385B2 (en) In-vehicle animation bypass system and method
US12570304B2 (en) Electronic device, vehicle, notification control method, and storage medium
KR102035314B1 (ko) 차량 인포테인먼트 장치 및 이의 제어 방법
US12065087B2 (en) Vehicle device
JP2009119895A (ja) 車両運転支援装置および車両運転支援方法
US9868397B2 (en) Display control device, and display control method
JP4631183B2 (ja) 車両用診断装置、診断処理プログラム及び診断処理手順記憶媒体
JP2020032830A5 (ja) 車両用表示装置、表示方法及びプログラム
KR101171260B1 (ko) 네비게이션용 인터페이스 장치
US20230325231A1 (en) Information processing apparatus, information processing system, and information processing method
EP4563386B1 (en) Apparatus for detecting warning light and displaying alternative warning light, and method for the same
JP2010018224A (ja) 制御システム
JP2012027539A (ja) 電子機器
CN119567845A (zh) 一种基于物理按键的驾驶辅助方法、装置、设备及介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21961342

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023554120

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 202180103204.6

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 18701846

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 202447030937

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2021961342

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021961342

Country of ref document: EP

Effective date: 20240521

WWG Wipo information: grant in national office

Ref document number: 2021961342

Country of ref document: EP

WWG Wipo information: grant in national office

Ref document number: 18701846

Country of ref document: US