CN113051946B - Detection system and detection method - Google Patents

Detection system and detection method Download PDF

Info

Publication number
CN113051946B
CN113051946B CN202110349876.7A CN202110349876A CN113051946B CN 113051946 B CN113051946 B CN 113051946B CN 202110349876 A CN202110349876 A CN 202110349876A CN 113051946 B CN113051946 B CN 113051946B
Authority
CN
China
Prior art keywords
display device
image
acquisition
content
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110349876.7A
Other languages
Chinese (zh)
Other versions
CN113051946A (en
Inventor
吴少敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN202110349876.7A priority Critical patent/CN113051946B/en
Publication of CN113051946A publication Critical patent/CN113051946A/en
Application granted granted Critical
Publication of CN113051946B publication Critical patent/CN113051946B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
    • G06K7/10792—Special measures in relation to the object to be scanned
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
    • G06K7/10821—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404—Methods for optical code recognition
    • G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
    • G06K7/1417—2D bar codes

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Electromagnetism (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application provides a detection system and a detection method, wherein an acquisition device in the detection system can acquire an image set of a display device of electronic equipment in an output state, the electronic equipment can be positioned in an acquisition range of the acquisition device through a bearing device, and the image set comprises at least one image; the processing device in the detection system can process the image to obtain a processing result, and the processing result indicates the perceived state of the display device in the acquisition direction of the acquisition device.

Description

Detection system and detection method
Technical Field
The application belongs to the technical field of display detection, and particularly relates to a detection system and a detection method.
Background
In the related art, a display device of an electronic apparatus in an output state can output content, and an object in a visual angle range of the display device can acquire the content output by the display device, where the content output by the display device can be protected by special processing, for example, by blurring processing and/or reducing the visual angle range, so as to change the state of the display device for displaying the content, but the performance of the display device is such that whether to change the state of the display content and/or the visual angle range of the display device needs to be verified manually.
Disclosure of Invention
The application provides a detection system and a detection method.
In one aspect, the present application provides a detection system comprising:
the electronic equipment comprises an acquisition device, a load bearing device and a display device, wherein the acquisition device is used for acquiring an image set of the display device of the electronic equipment in an output state, and the load bearing energy of the electronic equipment through the load bearing device is positioned in an acquisition range of the acquisition device, wherein the image set comprises at least one image;
and the processing device is connected with the acquisition device and is used for processing the image to obtain a processing result, wherein the processing result indicates the perceived state of the display device in the acquisition direction of the acquisition device.
Optionally, the acquisition range of the acquisition device comprises a target space position;
when the bearing device is positioned at the target space position, the display device of the electronic equipment in the output state, which is borne by the bearing device, faces to a first direction;
wherein the orientation of the acquisition device and the reversal of the first direction satisfy a deviation condition.
Optionally, the collecting device includes a first collecting component and a second collecting component, where the first collecting component and the second collecting component are axisymmetrically arranged relative to a display light axis in a first direction, and the first direction is an orientation of the display device;
Or (b)
The acquisition device comprises a first acquisition component, a second acquisition component and a third acquisition component, wherein the first acquisition component and the second acquisition component are arranged in axis symmetry relative to the display light in the first direction, and the direction of the third acquisition component are opposite to each other in the first direction so as to meet the same condition;
or (b)
The detection system further comprises a movement device, the acquisition device is connected with the movement device, the movement device controls the acquisition device to switch between a first posture and a second posture, wherein the first posture is a posture which is towards the direction opposite to the first direction and meets the deviation condition, and the second posture is a posture which is towards the direction opposite to the first direction and meets the same condition.
Optionally, the detection system further includes:
the first output device is used for outputting a target image, and the spatial positions of the first output device and the acquisition device relative to the display device meet the same condition;
the target image is an image meeting a switching condition, and the switching condition is a condition that the electronic equipment switches the perceived state of the display device.
Optionally, the detection system further includes: a second output means for outputting a reference image, wherein the reference image is an image that does not satisfy a switching condition;
Wherein the first output device and the second output device are different devices or the first output device and the second output device are two parts of the same output device; and/or the reference image and the target image comprise images of the same content type.
In another aspect, the present application provides a detection method, including:
obtaining an image set of a display device of electronic equipment in an output state, wherein the bearing energy of the electronic equipment through a bearing device is positioned in the acquisition range of an acquisition device, and the image set comprises at least one image;
processing the image to obtain a processing result, wherein the processing result indicates a perceived state of the display device in a collection direction of the collection device.
Optionally, the obtaining the image set of the display device of the electronic apparatus in the output state includes: acquiring at least one image of the display device with the acquisition device in a first pose, the display device displaying first content in a first mode;
the processing the image to obtain a processing result includes: and identifying the image to obtain an identification result, and if the identification result shows that the image does not contain the first content, determining that the first content is in an unaware state when the acquisition device is in the first gesture, wherein the first mode of the display device meets the display requirement.
Optionally, the obtaining the image set of the display device of the electronic apparatus in the output state includes: acquiring at least one first image of the display device by using an acquisition device in a first posture, and acquiring at least one second image of the display device by using an acquisition device in a second posture, wherein the display device is in a second mode;
the processing the image to obtain a processing result includes: identifying the first image to obtain a first identification result, and identifying the second image to obtain a second identification result;
if the first identification result indicates that the first image has no content displayed by the display device and the second identification result indicates that the content in the second image is matched with the content displayed by the display device, determining that a second mode of the display device meets the display requirement;
the electronic equipment comprises a collecting device, a bearing device, a display device, a first gesture and a second gesture, wherein the collecting device comprises a target space position in a collecting range, the bearing device is positioned at the target space position, the display device of the electronic equipment in an output state, which is borne by the bearing device, faces to a first direction, the direction of the collecting device in a first gesture and the reverse direction of the first direction meet the deviation condition, and the direction of the collecting device in a second gesture and the reverse direction of the first direction meet the same condition.
Optionally, the obtaining the image set of the display device of the electronic apparatus in the output state includes: acquiring at least one third image of the display device with the acquisition device in the first posture, the display device displaying second content in a second mode;
acquiring at least one fourth image of the display device with the acquisition device in the first pose, the display device displaying third content in a third mode;
the processing the image to obtain a processing result includes: identifying the third image to obtain a third identification result, and identifying the fourth image to obtain a fourth identification result;
if the third identification result indicates that the second content is not in the third image and the fourth identification result indicates that the content in the fourth image is matched with the third content, determining that a second mode and a third mode of the display device meet display requirements; the display requirements include that the perceived range of the third mode is greater than the perceived range of the second mode;
the electronic equipment comprises a collecting device, a bearing device, a display device, a first gesture and a second gesture, wherein the collecting device comprises a target space position in a collecting range, the bearing device is located at the target space position, the display device of the electronic equipment in an output state, which is borne by the bearing device, faces to a first direction, and the direction of the collecting device in the first gesture and the direction of the first direction meet a deviation condition.
Optionally, the obtaining the image set of the display device of the electronic apparatus in the output state includes: acquiring at least one third image of the display device with the acquisition device in the first posture, the display device displaying second content in a second mode;
acquiring at least one fourth image of the display device with the acquisition device in the first pose, the display device displaying third content in a third mode;
acquiring at least one fifth image of the display device with the acquisition device in a second pose, the display device displaying fourth content in the second mode;
acquiring at least one sixth image of the display device with the acquisition device in the second pose, the display device displaying fifth content in the third mode;
the processing the image to obtain a processing result includes: identifying the third image to obtain a third identification result, identifying the fourth image to obtain a fourth identification result, identifying the fifth image to obtain a fifth identification result, and identifying the sixth image to obtain a sixth identification result;
if the third recognition result indicates that the second content is not in the third image, the fourth recognition result indicates that the content in the fourth image is matched with the third content, the fifth recognition result indicates that the content in the fifth image is matched with the fourth content, and the sixth recognition result indicates that the content in the sixth image is matched with the fifth content, determining that a second mode and a third mode of the display device meet display requirements; the display requirements include that the perceived range of the third mode is greater than the perceived range of the second mode;
The electronic equipment comprises a collecting device, a bearing device, a display device, a first gesture and a second gesture, wherein the collecting device comprises a target space position in a collecting range, the bearing device is positioned at the target space position, the display device of the electronic equipment in an output state, which is borne by the bearing device, faces to a first direction, the direction of the collecting device in a first gesture and the reverse direction of the first direction meet the deviation condition, and the direction of the collecting device in a second gesture and the reverse direction of the first direction meet the same condition.
According to the detection system and the detection method, the acquisition device in the detection system can acquire the image set of the display device of the electronic equipment in the output state, the bearing energy of the electronic equipment through the bearing device is positioned in the acquisition range of the acquisition device, and the image set comprises at least one image; the processing device in the detection system can process the image to obtain a processing result, and the processing result indicates the perceived state of the display device in the acquisition direction of the acquisition device.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a detection system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a display device according to an embodiment of the present application;
fig. 3 is a schematic diagram of an application scenario of a detection system according to an embodiment of the present application;
fig. 4 is a schematic diagram of another application scenario of the detection system provided in the embodiment of the present application;
fig. 5 is a schematic diagram of still another application scenario of the detection system provided in the embodiment of the present application;
FIG. 6 is a schematic diagram of a third collection assembly according to an embodiment of the present application;
FIG. 7 is a schematic diagram of another detection system according to an embodiment of the present application;
FIG. 8 is a schematic structural diagram of yet another detection system according to an embodiment of the present application;
FIG. 9 is a schematic diagram of a further detection system according to an embodiment of the present application;
FIG. 10 is a flow chart of a detection method according to an embodiment of the present application;
FIG. 11 is a flowchart of another detection method according to an embodiment of the present application;
FIG. 12 is a flow chart of yet another detection method provided by an embodiment of the present application;
FIG. 13 is a flow chart of yet another detection method provided by an embodiment of the present application;
fig. 14 is a flowchart of still another detection method according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Referring to fig. 1, an optional structure of a detection system provided in an embodiment of the present application may include: a collection device 10 and a processing device 20.
The acquisition device 10 is configured to acquire an image set of a display device of an electronic device in an output state, where a carrying capacity of the electronic device through the carrying device is within an acquisition range of the acquisition device, and the image set includes at least one image.
In this embodiment, the electronic device includes a display device, where the display device outputs content when the electronic device is in an output state, and the display device may output predefined content, for example, the predefined content includes, but is not limited to, at least one of a specific image, a specific character, and the like, and for convenience in recognition, the display device may output a barcode or the like, for example, the display device outputs at least one two-dimensional code.
The display device can display one two-dimensional code in all areas, if the acquisition device 10 is positioned in the visible angle range of the display device, the acquisition device 10 can capture the two-dimensional code displayed by the display device, but the acquisition device 10 is positioned at the edge of the visible angle range, the two-dimensional code acquired by the acquisition device 10 is not clear or has the problems of deformation and the like, so that three vertexes in the two-dimensional code acquired by the acquisition device 10 are incomplete, and the two-dimensional code acquired by the acquisition device 10 cannot be identified; and the position of the acquisition device 10 exceeds the visible angle range, the acquisition device 10 cannot acquire the two-dimensional code, and the two-dimensional code cannot be identified, so that the visible angle range of the display device can be determined.
At present, most of the sizes of the display devices show a trend of becoming larger, for example, the width of the display devices is larger and larger, when the acquisition device 10 acquires at a fixed detection position, the angles of the detection positions where the acquisition device 10 is located relative to the left side and the right side of the display devices are obviously different, and thus when the display devices display a two-dimension code, the two-dimension code is wrong due to the angle problem, and the two-dimension code cannot be identified. Therefore, the display device can display a plurality of independent identifiable objects, such as a plurality of independent two-dimensional codes, the plurality of independent two-dimensional codes can be sequentially displayed from the left side to the right side of the display device, whether all the content cannot be identified or part of the content cannot be identified is determined by identifying the plurality of independent two-dimensional codes, and part of the content can be the content far from the detection position where the acquisition device 10 is located.
When the display device displays a plurality of independently identifiable objects, it may display a plurality of predefined content, which may be the same or different, e.g., the display device may display a sequence of characters of 123456789.
The display device may also display content in a multi-line manner, for example, in combination with displaying a plurality of independently identifiable objects as described above, by considering its own height, i.e., the display device may display content in a multi-line, multi-column manner, i.e., the display device outputs an array of independently identifiable objects.
Taking an example that a display device outputs a plurality of independent two-dimensional codes, the plurality of two-dimensional codes can be the same or different, the plurality of two-dimensional codes can be mutually and independently displayed (namely, the plurality of two-dimensional codes are not overlapped when displayed), and the plurality of independent two-dimensional codes are output in an array form, as shown in fig. 2, a schematic diagram of the display device of the electronic equipment provided by the embodiment of the application for displaying 12 two-dimensional codes is shown, the 12 two-dimensional codes are uniformly distributed in a display area of the display device, as shown in fig. 2, the 12 two-dimensional codes are in 4*3 arrangement display, wherein 4*3 indicates that the 12 two-dimensional codes are divided into 3 rows, and each row of 4 two-dimensional codes. And the interval between any two-dimensional codes in the 12 two-dimensional codes shown in fig. 2 is the same/close, and two-dimensional codes are also displayed at the edge positions of the display area, so that the 12 two-dimensional codes can be distributed in all areas of the display area.
The points to be described here are: the image acquired by the acquisition device 10 may contain a plurality of two-dimensional codes, when the two-dimensional codes in one image are identified, each independent two-dimensional code with complete content can be identified from the image, and each independent two-dimensional code with complete content can be identified, for example, each independent two-dimensional code with complete content can be identified sequentially from left to right.
Of course, the display device of the electronic apparatus may display other contents, for example, different portions of the same object may be displayed at different positions of the display area of the display device, where one display mode is to divide one object into N equally to obtain N partial contents, and N partial contents are displayed at different positions of the display area, where N is a natural number greater than 1. For example, an image of a person is divided into 8 equal parts, 8 parts of the person are obtained, the 8 parts are displayed at different positions of a display area, and in the display process, the interval between any two parts of the 8 parts is the same/close, and meanwhile, the display is performed at the edge position of the display area. In addition, the display device may display one object in its entire area, that is, the object may occupy the entire display area of the display device, and the present embodiment is not limited to how and what content the display device displays.
The acquisition device 10 may be a device with an information acquisition function, for example, the acquisition device 10 may be a camera or the type of the acquisition device 10 is matched with the content displayed by the display device, for example, the display device displays a two-dimensional code, the acquisition device may be a scanning gun, and the two-dimensional code is scanned by the scanning gun, so as to realize the acquisition of the display device of the electronic equipment in an output state. The acquisition device 10 performs image acquisition on an object located in an acquisition range of the electronic device, and if the display device of the electronic device in an output state is loaded into the acquisition range of the acquisition device 10 through the loading device, the acquisition device 10 can acquire the electronic device to obtain at least one image of the electronic device. In the process of collecting the content by the collecting device 10, whether the content displayed by the display device of the electronic equipment can be collected by the collecting device 10 is determined at least by one of the position relation between the collecting device 10 and the display device and the perceived range of the display device.
For example, if the acquisition device 10 is located in the perceived range of the display device, the display area of the display device can be viewed from the position where the acquisition device 10 is located, under this condition, the acquisition device 10 can acquire the content displayed by the display device, and the corresponding image acquired by the acquisition device 10 contains the content displayed by the display device; if the acquisition device 10 is located outside the perceived range of the display device, it is possible to view the electronic apparatus from the acquisition device 10 but not the display area of the display device, under which condition the acquisition device 10 cannot acquire the content displayed by the display device, and the corresponding image acquired by the acquisition device 10 does not have the content displayed by the display device.
The display device of the electronic device in the output state may be collected once when the display device is determined to be located in the collection range, or the collection device 10 periodically/uninterruptedly collects the collection range, so that the collection device 10 can collect at least one image of the display device.
The display device of the electronic equipment in the output state can be borne in the acquisition range through the bearing device, the bearing device at least has a supporting and fixing function so as to support and fix the display device of the electronic equipment in the output state in the acquisition range, the bearing device is in contact with the first surface of the electronic equipment when the display device is supported and fixed through the bearing device, and the display device is positioned on the second surface of the electronic equipment, so that the content displayed by the display device cannot be covered by the bearing device.
For example, the carrier device may be a carrier, which has a carrier surface, by means of which the electronic device is supported and held in the acquisition range. In this embodiment, the carrying device may further have a transmission function, for example, to transmit the display device of the electronic apparatus in the output state from one location to the collection range. For example, the carrying device may be a device with a transmission function, such as a conveyor belt, a mechanical arm, or the like, the carrying device such as the conveyor belt and the mechanical arm is used to transmit the display device of the electronic device in the output state to the acquisition range, and then the acquisition device 10 is used to acquire the image set of the display device of the electronic device in the output state, so that the detection system is used to detect the display device in the production process of the display device.
In this embodiment, one relationship between the acquisition device and the display device is: the acquisition range of the acquisition device comprises a target space position; when the bearing device is positioned at the target space position, the display device of the electronic equipment in the output state, which is borne by the bearing device, faces to the first direction; wherein the orientation of the acquisition device and the reversal of the first direction satisfy a deviation condition.
The target spatial position is used as one spatial position in the acquisition range of the acquisition device and is used for indicating that the orientation of the display device is required to be in a first direction when the display device is positioned at the target spatial position, so that a user positioned in the first direction can see the content displayed by the display device. That is, the first direction indicates the visual direction of the display device, e.g., the first direction is an outward direction or indicates that the display device is not in contact with the carrying surface of the carrying device, and the user is able to see the content displayed in the display device in the first direction.
In the present embodiment, regardless of the orientation of the display device or the orientation of the pickup device, the position of the pickup device is set by the relationship between the orientation of the pickup device and the reverse direction of the first direction with the orientation of the center line as the orientation. Wherein the deviating condition is used to indicate a deviating angle of the orientation of the collecting device with respect to the reverse direction of the first direction, etc., e.g. the deviating condition is more than 45 degrees and less than 90 degrees, such that the angle between the orientation of the collecting device and the reverse direction of the first direction fulfils the condition of more than 45 degrees and less than 90 degrees.
And the processing device 20 is connected with the acquisition device 10 and is used for processing the image to obtain a processing result, wherein the processing result indicates the perceived state of the display device in the acquisition direction of the acquisition device 10.
The processing device 20 may be connected to the acquisition device 10 in a wireless manner and/or in a wired manner, so that the processing device 20 can acquire at least one image acquired by the acquisition device 10, and the processing device 20 processes the image to obtain a processing result indicating a perceived state of the display device in an acquisition direction of the acquisition device 10. The acquisition direction of the acquisition device 10 indicates the orientation of the acquisition device 10, and electronic devices located within the acquisition range of the downward orientation of the acquisition device 10 can be acquired by the acquisition device 10.
In this embodiment, the perceived state of the display device in the acquisition direction of the acquisition device 10 indicates that the electronic apparatus is located within the acquisition range of the acquisition device, and if the content displayed by the display device can be perceived/acquired, it is indicated that the content displayed by the display device can be viewed from the position where the acquisition device 10 is located. In the case where the content displayed by the display device can be perceived/acquired, the perceived state can also indicate a display state corresponding to the content displayed by the display device, for example, in a blurred display state or a clear display state, when the electronic device is located within the acquisition range of the acquisition device, and/or the perceived state can also indicate whether the content displayed by the display device can be correctly analyzed when the electronic device is located within the acquisition range of the acquisition device.
For example, as shown in fig. 2, at least one two-dimensional code is displayed in the display device, and in the process of displaying the two-dimensional code in the display device, the acquisition device 10 acquires at least one image corresponding to the display device; the processing device 20 processes the image, and if the processing device 20 determines that the two-dimensional code (which may be part of the two-dimensional code) exists in the image, the two-dimensional code displayed by the display device is determined to be acquired, so as to obtain a perceived state indicating that the content displayed by the display device is perceived/acquired; the processing device 20 may also scan and identify the two-dimensional code in the image to determine whether the two-dimensional code can be used, and if the two-dimensional code is determined to be usable, it is indicated that the two-dimensional code acquired by the acquisition device 10 can be correctly analyzed, and a perceived state indicating that the content displayed by the display device can be correctly analyzed can be obtained. If the processing means 20 determines that there is no two-dimensional code in the image, a perceived state is obtained that indicates that the content displayed by the display means is not perceived/acquired (which may be regarded as the content displayed by the display means being in an unaware state).
Since the processing result can indicate the perceived state of the display device in the acquisition direction of the acquisition device 10, the perceived state can indicate that the content displayed by the display device can be perceived/acquired, etc., the detection system provided in this embodiment can be applied to the following three application scenarios:
An application scene is shown in fig. 3, in which the visible angle range of the display device is detected in the application scene shown in fig. 3, and in the process of detecting the visible angle range, the display device can display a picture. The collecting direction of the collecting device 10 faces the display device, the collecting device 10 can move at least on the left side and the right side of the display device to collect respectively from different positions on the left side and the right side of the display device, as indicated by a dotted line in fig. 3, the collecting device 10 can be moved manually or by a mechanical device or the like to assist the collecting device 10, and the distance of each movement can be the same or different. The image acquired by the acquisition device 10 is transmitted to the processing device for processing, and if the processing result indicates that the content can be perceived, the acquisition device 10 is indicated to be in the visible angle range of the display device, so that the visible angle range of the display device can be determined by the processing device 20.
For example, the acquisition device 10 moves from the left side of the display device to the right side; if the processing result is not perceived from the content to the content perceived, the processing means 20 records the position where the content is perceived, and then if the processing result is perceived from the content to the content is not perceived, the processing means 20 records the position where the content is perceived again, and determines the visible angle range of the display means based on the two recorded positions corresponding to 180 degrees from the left side to the right side of the display means. And if the viewing angle range of the display device is known, the processing device 20 can also determine whether the detected viewing angle range deviates from the viewing angle range of the display device after determining the viewing angle range of the display device, so as to implement verification of the viewing angle range of the display device.
Another application scenario is shown in fig. 4, where the display device has two modes, where the perceived range of one of the two modes is larger than the perceived range of the other mode, and the detection system detects whether the two modes of the display device have such a relationship. The reduction of the perceived range is the control of the light direction by the liquid crystal deflection in the display device, thereby achieving the adjustment of the perceived range.
In fig. 4 the display device is shown in one of two modes in which the perceived range of the display device is larger than in the other mode in which the acquisition device 10 is arranged within the perceived range of the display device, the acquisition device 10 acquiring images and processing by the processing device 20. After maintaining this mode for a period of time or after the processing means 20 has obtained the processing result, the display means is adjusted to another mode in which the position of the acquisition means 10 may be unchanged, and then the image is acquired by the acquisition means 10 and processed by the processing means 20. If the processing result of the processing device 20 is changed from that the content can be perceived to that the content is not perceived, it is determined that the perceived range of the display device in the two modes is different, and the perceived range of the mode in which the display device is located at the previous acquisition is larger than the perceived range of the mode in which the display device is located at the next acquisition, the content which can be acquired into the display device is identified by the track of the acquisition device in fig. 4, and it is known from fig. 4 that the shorter the track is, the smaller the perceived range is.
For the application scenario shown in fig. 4, the peep-proof function of the detection display device can be applied, and the peep-proof function achieves the purpose of preventing others from peeping the content displayed by the display device by reducing the perceived range (visible angle range) of the display device. If the peep-proof function of the display device is started, the perceived range of the display device is reduced; if the peep-proof function of the display device is closed, the perceived range of the display device is restored to the default perceived range, and the perceived range is increased relative to the perceived range when the peep-proof function is opened. The process of detecting the peep-proof function of the display device by using the detection system is as follows:
the acquisition device 10 is set in a default perceived range of the display device but is not perceived in a perceived range when the peep-proof function is turned on any more, for example, the display device is 45 degrees peep-proof, and 45 degrees peep-proof indicates that if the peep-proof function of the display device is turned on, the content displayed by the display device cannot be seen 45 degrees (in the visual direction) in front of the left and right of the display device, and then the acquisition device 10 may be set at an angle of 45 ° in front of the left and right of the display device.
In the two modes of the peep-proof function being turned on and the peep-proof function being turned off, the acquisition device 10 will acquire the display device, and the same processing device 20 will process the image to obtain the processing result. If the processing result of the processing device 20 indicates that the content displayed by the display device can be perceived when the peep-proof function is closed, but the content displayed by the display device can not be perceived when the peep-proof function is opened, the peep-proof function of the display device is determined to be effective, and the peep-proof function of the display device is detected.
In another application scenario, as shown in fig. 5, a special display function of the display device is detected by using the detection system in the application scenario shown in fig. 5, where the special display function can achieve the peep-proof function by changing a display state of the display device, and the change of the display state is different from the reduction of the perceived range of the display device, and is achieved by changing a display mode of the display device, such as performing fuzzy display.
In the application scenario shown in fig. 5, other users exist besides the user of the electronic device, so that the content displayed by the display device can be viewed by other users besides the user, and content leakage is caused, and in this case, the display device can blur the content. The acquisition device 10 is located in the perceived range of the display device, so that the acquisition device 10 can acquire the content displayed by the display device. The processing means 20 processes the image and may determine that a particular display function of the display means is valid if the processing result indicates that the content is in a blurred display state. In order to improve accuracy, the capturing device 10 may capture an image when the special display function is not activated, and if the processing result obtained by the processing device indicates that the display device is switched from the clear display state to the blurred display state, the special display function of the display device is determined to be effective, so as to prevent the problem that the detection is ineffective due to the display content of the display device being a blurred image.
The detection system comprises a detection device, wherein the detection device is used for detecting the image set of the display device of the electronic equipment in an output state, the electronic equipment can be positioned in the acquisition range of the detection device through the bearing device, and the image set comprises at least one image; the processing device in the detection system can process the image to obtain a processing result, the processing result shows the perceived state of the display device in the acquisition direction of the acquisition device, and the automatic detection of the display device of the electronic equipment in the output state is realized.
In this embodiment, the acquisition device 10 may employ the following manner:
one way of acquiring the device 10 is that the acquiring device 10 comprises a first acquiring assembly and a second acquiring assembly, which are arranged axisymmetrically with respect to a display light axis of a first direction, which is an orientation of the display device. Wherein the display light can be the central line of display device, and the display light is the axis that first collection subassembly and second collection subassembly position set up the time phase, and based on the first collection subassembly of display light and second collection subassembly axisymmetric setting, as above-mentioned figure 2 shows, two scanning guns are first collection subassembly and second collection subassembly, and two collection subassembly axisymmetric settings to detect through two collection subassemblies. If two collection assemblies are utilized to detect the visual angle range of the display device, the left and right can be collected simultaneously through the two collection assemblies, so that the detection efficiency can be improved. Of course, the application scenario shown in fig. 4 and fig. 5 may also be detected by using two acquisition components, which will not be described in detail in this embodiment.
When the first collection assembly and the second collection assembly are arranged symmetrically relative to the display light axis, the orientation of the first collection assembly and the orientation of the second collection assembly can also meet the deviation condition with the reaction of the first direction, such as the deviation condition is used for indicating the deviation angle and the like of the orientation of the collection device relative to the reverse direction of the first direction, the deviation condition is more than 45 degrees and less than 90 degrees, and thus the included angle between the orientation of the first collection assembly and the orientation of the second collection assembly and the reverse direction of the first direction meets the condition that the included angle is more than 45 degrees and less than 90 degrees.
The display device is provided with 45-degree peep prevention for explanation, and the display device displays at least one two-dimensional code, as shown in fig. 2, the first acquisition component and the second acquisition component are respectively one scanning gun, the two scanning guns are symmetrically arranged based on the display light axis, and the included angle between the two scanning guns and the reverse direction of the first direction is larger than 45 degrees, such as close to 45 degrees.
The display device defaults to have the peep-proof function closed, and is carried to the acquisition range through the carrying device, for example, the target space position of the acquisition range. Triggering the scanning guns on the left side and the right side to start scanning when the display device is positioned in the acquisition range (or in the target space position in the acquisition range), and determining that the peep-proof function is closed and effective if the processing device determines that the two scanning guns can identify any two-dimensional code (the content can be perceived); and then the display device starts the peep-proof function, the scanning guns on the left side and the right side continue scanning, and if the processing device determines that any two-dimensional code is not recognized by both the scanning guns (the content is not perceived), the peep-proof function is determined to be started effectively, and then the peep-proof function of the display device is determined to be effective. Wherein, the scanning gun can maintain a scanning process for a certain time, such as two seconds, and the processing device processes the two-second scanned image.
Another way of the collecting device 10 is that the collecting device comprises a first collecting component, a second collecting component and a third collecting component, the first collecting component and the second collecting component are arranged in a line symmetry manner relative to the display light axis of the first direction, and the direction of the third collecting component and the direction of the first direction meet the same condition.
In this embodiment, the third collecting assembly is added to the collecting device 10, and the third collecting assembly is arranged in such a manner that the direction of the third collecting assembly and the reverse direction of the first direction satisfy the same condition. As shown in fig. 6, the orientation of the third collection assembly points in a reverse direction of the first direction such that the orientation of the third collection assembly is capable of aligning with a display area of the display device. The detection system including the third acquisition component can be at least applied to the application scenarios shown in fig. 4 and 5, so as to acquire the content being displayed in the display area when the display device is in at least one of the two modes or adopts a special display function, and detect the display device by combining the images acquired by the remaining two acquisition components.
Taking the above-mentioned example of detecting the peep-proof function of the display device in the application scenario shown in fig. 4, the third collecting assembly collects the display device in two modes of opening the peep-proof function and closing the peep-proof function, and the same processing device 20 also processes the image to obtain the processing result. If the processing result of the processing device 20 indicates that the content displayed by the display device can be perceived when the peep-proof function is closed and when the peep-proof function is opened, it is indicated that the display device is in a normal use state, and the first acquisition component and the second acquisition component do not acquire the content when the peep-proof function is opened because the peep-proof function is effectively caused, so that the problem that the first acquisition component and the second acquisition component cannot acquire the content when the peep-proof function is opened due to abnormal display of a part of the area of the display device can be eliminated, and the detection accuracy is improved.
In yet another manner of the acquisition device 10, the detection system further includes a movement device 30, as shown in fig. 7, where the acquisition device 10 is connected to the movement device 30, and the movement device 30 controls the acquisition device 10 to switch between a first posture and a second posture, where the first posture is a posture that satisfies a deviation condition toward a direction opposite to the first direction, and the second posture is a posture that satisfies the same condition toward the direction opposite to the first direction.
In this embodiment, the capturing device 10 has a first posture and a second posture, and the first posture and the second posture are related to the first direction in which the capturing device faces the display device, specifically please refer to the above description. And the switching of the acquisition device 10 between the first and second posture is controlled by the movement device 30. In the present embodiment, the orientation of the pickup device 10 may be reversed toward the first direction of the display device, and the pickup device 10 is controlled to move from the left side to the right side of the display device, or from the right side to the left side, or from the left/right side to the neutral line position of the display device by the movement device 30, so that the pickup device 10 can be switched between the first posture and the second posture.
The gesture of the motion device 30 controlling the acquisition device 10 may be adjusted according to a display mode of the display device, for example, the display device includes two modes, where a perceived range of one mode is greater than a perceived range of the other mode, for example, the display device includes two modes of turning on the peep preventing function and turning off the peep preventing function, and then the motion device 30 controlling the acquisition device 10 to be in the first gesture when the peep preventing function is turned on and when the peep preventing function is turned off. In order to improve the detection accuracy, the movement device 30 may control the acquisition device 10 to be maintained in the first posture and the second posture for a certain time, respectively, when the peep preventing function is turned on and the peep preventing function is turned off, so as to acquire images of the display device from different aspects.
The detection of the visible angle range of the display device is currently performed manually, and the detection of the perceived range of the adjusted visible angle range is also performed manually, and the detection system shown in fig. 1 to 7 can automatically detect the visible angle range of the display device through the acquisition device 10 and the processing device 20 to detect whether the visible angle range meets the standard, for example, whether the visible angle range of the display device reaches the maximum visible angle range, and the maximum visible angle range may be given in the configuration parameters of the display device. If the viewing angle range of the display device is adjusted, the adjusted display device is acquired by the acquisition device 10, and then the processing device 20 processes the image to determine whether the perceived range of the adjusted display device meets the display requirement, wherein the display requirement is a comparison result of the perceived range of the display device before and after adjustment, and if the perceived range after adjustment is greater than the viewing angle range before adjustment, whether the display of the display device meets the requirement can be determined by detecting the acquisition device 10 and the processing device 20, which can be seen in the description related to fig. 4.
The above adjustment of the viewing angle range can be achieved through the peep preventing function of the display device, and besides the peep preventing function can change the viewing angle range, some peep preventing functions can also adjust the display of the display device to achieve the peep preventing purpose, as shown in fig. 5, the peep preventing purpose can be achieved through the blurring display, and whether the display device can achieve the peep preventing purpose through the blurring display can also be automatically detected through the detection system shown in fig. 1 to 7.
The starting and closing of the peep-proof function can be manually operated by a user, and in the embodiment, a detection system for automatically operating the peep-proof function can be provided, the detection system can automatically start the peep-proof function and automatically close the peep-proof function, and whether the display device achieves the peep-proof purpose after the peep-proof function is automatically started can be detected, so that the efficiency is improved. As shown in fig. 8, another detection system provided by the embodiment of the present application is shown, where the detection system shown in fig. 8 can automatically enable the peep-proof function and automatically close the peep-proof function.
The detection system shown in fig. 8 further includes: a first output means 40 for outputting a target image, wherein the target image is an image satisfying a switching condition that the electronic device switches the perceived state of the display means.
When the first output device 40 outputs the target image, the electronic apparatus switches the display device to the perceived state, so as to change the display of the display device, for example, reduce the perceived range of the display device or display the content in a special display mode, for example, the special display mode may be a blurring display, reduce the risk of leakage of the content displayed by the display device, and when the blurring display is performed, the blurring display may be performed on the private content displayed by the display device, such as a password.
The target image used for triggering the electronic equipment to switch the display device can be a human face, which is equivalent to that a first output device is used for outputting a human face image, and the application scene of the content displayed by the display device is simulated to be checked by a user. If the electronic device detects that the first output device outputs a face image, the electronic device can be regarded as the current peeping display device, so that the display device is controlled to be switched to a perceived state, the display device is switched to the perceived state, the display device is described to automatically start the peeping function, the peeping function can adjust (reduce) the perceived range of the display device or the display device can display in a special display mode to achieve the peeping prevention purpose, and the special display mode can be fuzzy display. The display device may automatically turn off the peep-proof function if the first output device 40 does not output the target image.
For the detection system shown in fig. 8, the relationship between the first output device 40 and the acquisition device 10 may be: the positional relationship of the first output device 40 and the collecting device 10 is not relevant, and the first output device 40 and the collecting device 10 may each set their respective positions according to the display device. For example, the first output device 40 is located in the first direction of the display device or near the first direction, where the first output device 40 can be aligned with/near to the display device, so as to be able to see the content displayed by the display device.
For the detection system shown in fig. 8, the relationship between the first output device 40 and the acquisition device 10 may be: the spatial positions of the first output device 40 and the collecting device 10 relative to the display device satisfy the same condition, e.g. the orientation of the first output device 40 and the orientation of the collecting device 10 satisfy the deviation condition from the reverse direction of the first direction, which is the orientation of the display device, i.e. the orientations of the first output device 40 and the collecting device 10 are both deviated from the reverse direction of the first direction by a certain angle, which may be the same or different, e.g. the angles of deviation of the two are the same or are close, so that the first output device and the collecting device may be arranged in an overlapping or adjacent manner, e.g. both are located in 45 degrees directions on both sides. In this relationship, the first output device 40 is equivalent to a human face, the acquisition device 10 is equivalent to a human eye, and after the first output device outputs the target image, the electronic device controls the display device to switch to a perceived state, for example, controls the display device to start the peep-proof function, so as to ensure that the content displayed by the display device cannot be perceived at the position where the first output device 40 is located, and realize automatic detection of effectiveness of the peep-proof function, where the peep-proof function can adjust (shrink) the perceived range of the display device or display the display device in a special display mode to achieve the peep-proof purpose, and the special display mode may be a blurred display.
In order to possibly inform the display device to be switched to a perceived state, the electronic device is provided with at least one acquisition device, the acquisition device in the electronic device is also oriented to a first direction, the output of the first output device is acquired through the acquisition device on the electronic device, and if the acquisition device on the electronic device acquires a target image, the electronic device is instructed to switch the display of the display device.
The detection system further comprises a first output device 40, wherein the first output device 40 is used for outputting a target image, the target image is an image meeting a switching condition, and the switching condition is a condition that the electronic equipment switches the perceived state of the display device, so that the scene of the target image in the display device is simulated by the detection system, and the purpose of controlling the electronic equipment to switch the display device through the target image is achieved.
In this embodiment, the detection system shown in fig. 8 automatically controls the peep-proof function when simulating a target image (e.g., a stranger's face). In the case of the simulation of automatically controlling the peep-proof function based on the target image, a reference image may be output, and the display device that the reference image is not, is switched to the perceived state, so that the reference image may be regarded as a face image of a user of the display device, and the switching of the display device is controlled by performing at least one of the detection of the number and the biometric feature, for example, the detection of whether the second face is present or not, and whether the second face is at least one of the default faces, on the image under the environment where the display device is located. An alternative construction of a corresponding detection system is shown in fig. 9, the detection system further comprising: and a second output device 50 for outputting a reference image, wherein the reference image is an image that does not satisfy the switching condition, and switching of the display device is controlled by combining with the first output device 40.
The reference image output by the second output device 50 may be regarded as the display device being used by the user of the electronic apparatus, and the target image output by the first output device may be regarded as the possibility that other users than the user have peeping the display device, so as to simulate whether the other users peeping the display device when the user uses the electronic apparatus through the first output device 40 and the second output device 50, and if the display device is instructed to switch by the electronic apparatus.
In the present embodiment, the first output device 40 and the second output device 50 do not need to display images at the same time, for example, only the first output device 40 may output a target image, for example, the first output device displays a strange face image; or the second output device 50 outputs the reference image when the first output device 40 outputs the target image, and the reference image may be a reference face image, and the reference face image may be a default face image to represent the user of the electronic device; or at least three images are output by the first output device 40 and/or the second output device 50, for example, the first output device 40 and/or the second output device 50 outputs at least two face images to simulate the existence of multiple scenes in the display device, and the embodiment is not limited to detecting whether the first output device 40 and the second output device 50 output images and the number of output images in the working process of the system.
The reference image and the target image include images of the same content type, for example, the reference image and the target image are both face images but faces contained in the face images are different to distinguish the reference image and the target image by the faces. The relationship between the first output device 40 and the second output device 50 may be: the first output device 40 and the second output device 50 are different devices, and the first output device and the second output device which are mutually independent can be positioned at the same position or at different positions to simulate different application scenes; or the first output device and the second output device are two parts of the same output device, such as dividing an output area of the same output device into two areas, one area outputting a reference image and the other area outputting a target image.
With the detection system shown in fig. 9, if the electronic device is instructed to control the display device to switch to the perceived state, the display device may display in a special display manner, such as a blurred display. The corresponding acquisition device 10 is located in the perceived range of the display device, so that the acquisition device 10 can acquire the content displayed by the display device. The processing means 20 processes the image and may determine that a particular display function of the display means is valid if the processing result indicates that the content is in a blurred display state. In order to improve accuracy, the capturing device 10 may capture an image when the special display function is not activated, and if the processing result obtained by the processing device indicates that the display device is switched from the clear display state to the blurred display state, the special display function of the display device is determined to be effective, so as to prevent the problem that the detection is ineffective due to the display content of the display device being a blurred image.
Referring to fig. 10, an optional flow of a detection method provided by an embodiment of the present application may include the following steps:
101: an image set of a display device of the electronic equipment in an output state is obtained, wherein the bearing energy of the electronic equipment through the bearing device is located in the acquisition range of the acquisition device, and the image set comprises at least one image. At least one image in the image set can be acquired by utilizing the acquisition device, and a display device of the electronic equipment in an output state in the acquisition process is borne in an acquisition range of the acquisition device through the bearing device. For a description of the acquisition device, the display device and the carrying device, please refer to the above embodiments.
102: the image is processed to obtain a processing result, wherein the processing result indicates a perceived state of the display device in a capturing direction of the capturing device.
The perceived state of the display device in the acquisition direction of the acquisition device indicates that the content displayed by the display device can be perceived/acquired when the electronic equipment is positioned in the acquisition range of the acquisition device, and if the content displayed by the display device can be perceived/acquired, the content displayed by the display device can be observed from the position where the acquisition device is positioned. In the case where the content displayed by the display device can be perceived/acquired, the perceived state can also indicate a display state corresponding to the content displayed by the display device, for example, in a blurred display state or a clear display state, when the electronic device is located within the acquisition range of the acquisition device, and/or the perceived state can also indicate whether the content displayed by the display device can be correctly analyzed when the electronic device is located within the acquisition range of the acquisition device.
Displaying at least one two-dimensional code in the display device shown in the above figure 2, wherein the acquisition device acquires at least one image corresponding to the display device in the process of displaying the two-dimensional code by the display device; processing the image by a processing device, and if the processing device determines that the two-dimensional code (which can be part of the two-dimensional code) exists in the image, determining that the two-dimensional code displayed by the display device can be acquired, and obtaining a perceived state indicating that the content displayed by the display device can be perceived/acquired; the processing device can also scan and identify the two-dimensional code in the image to determine whether the two-dimensional code can be used, and if the two-dimensional code is determined to be used, the two-dimensional code acquired by the acquisition device can be correctly analyzed, and a perceived state indicating that the content displayed by the display device can be correctly analyzed can be obtained. If the processing device determines that the two-dimensional code is not in the image, a perception state (which can be regarded as that the content displayed by the display device is in an unaware state) indicating that the content displayed by the display device is not perceived/acquired is obtained.
According to the detection mode, the image set of the display device of the electronic equipment in the output state is obtained, wherein the bearing capacity of the electronic equipment through the bearing device is located in the acquisition range of the acquisition device, the image set comprises at least one image, the image is processed to obtain a processing result, the processing result shows the perceived state of the display device in the acquisition direction of the acquisition device, and the automatic detection of the display device of the electronic equipment in the output state is realized.
Referring to fig. 11, which is a schematic diagram illustrating an alternative flow of another detection method according to an embodiment of the present application, the method may include the following steps:
201: at least one image of the display device is acquired with the acquisition device in the first pose, and the display device displays the first content in the first mode.
In the process of acquiring at least one image of the display device, the display device displays the first content in a first mode, wherein the first mode may be to reduce a perceived range of the display device (i.e., reduce a visual angle range of the display device) to display the first content, the maximum visual angle range may be a default perceived range of the display device, and the reduced perceived range of the display device may be a reduction of the default perceived range, for example, the perceived range of the display device may be reduced by turning on the peep-proof function, and whether the peep-proof function is effective is detected by acquiring the image in the first mode.
When the acquisition device is used for acquiring at least one image of the display device, the relation between the acquisition device and the display device is as follows: the acquisition range of the acquisition device comprises a target space position, the bearing device is positioned at the target space position, the display device of the electronic equipment borne by the bearing device faces to the first direction, and the direction of the acquisition device in the first posture and the reverse direction of the first direction meet the deviation condition.
And in order to be able to verify the first mode of the display device, the settings of the acquisition device also need to be adjusted according to the first mode. For example, if the first mode indicates that the peep-proof function is turned on, and the peep-proof function is 45 degrees peep-proof, the deviation condition may be greater than 45 degrees and less than 90 degrees, for example, may be close to 45 degrees.
202: and identifying the image to obtain an identification result, and if the identification result shows that the image does not have the first content, determining that the first content is in an unaware state when the acquisition device is in the first gesture, wherein the first mode of the display device meets the display requirement, and the display requirement can be the maximum visual angle range or the reduced perceived range of the display device.
In the process of identifying the image to obtain an identification result, comparing the content identified by the identification result with first content displayed by the display device, if the content identified by the identification result is identical to the content pointed by the first content, indicating that the content identified by the identification result is matched with the content pointed by the first content, wherein the first content is in a perceived state, otherwise, indicating that the first content is in an unaware state. If the first content is a content such as a two-dimensional code which can jump to a certain content, the content which the first content jumps to is compared in the comparison process, and if the first content is a content which the face and the like cannot jump to, the first content is compared in the comparison process.
In this embodiment, the first mode may represent detecting the maximum visual angle range of the display device, and in the first mode of the display device, the maximum visual angle range of the display device is automatically detected, and in the first mode, the display device displays the first content and the visual range of the first content is the maximum visual angle range of the display device, and the first content may be a predefined content, such as at least one of a specific image, a specific character, and the like, and for the description of the first content, please refer to the above embodiment.
Under the requirement of detecting the maximum visual angle range of the display device, besides being in the first posture, the acquisition device can be arranged at the edge of the maximum visual angle range, for example, in a scene of detecting the maximum visual angle range, part of acquisition areas of the acquisition device are overlapped with the maximum visual angle range, and the rest of acquisition areas are located outside the maximum visual angle range, so that part of contents with the first contents are in images acquired by the acquisition device. If the identification result of the image indicates that part of the content of the first content exists in the image, the content can be acquired within the maximum visual angle range, but the content can not be acquired beyond the maximum visual angle range, and the detection accuracy is improved.
Under the demand of detecting the maximum visual angle range of the display device, the detection position of the acquisition device can also be changed, for example, the acquisition direction of the acquisition device faces the display device, the acquisition device can move at least on the left side and the right side of the display device so as to acquire respectively from different positions on the left side and the right side of the display device, for example, the movement of the acquisition device is indicated by a dotted line in fig. 3, the movement of the acquisition device can be artificial movement or auxiliary movement of the acquisition device through a mechanical device and the like, and the distance of each movement can be the same or different. And if the identification result of the plurality of images indicates that the first content is switched from being perceived to not being perceived and appears twice, two boundaries of the visible angle range of the display device can be determined according to the identification result, so that the maximum visible angle range of the display device is detected, and then the maximum visible angle range is compared with the default maximum visible angle range to determine whether the first content meets the standard.
Referring to fig. 12, an optional flow of a further detection method provided by an embodiment of the present application may include the following steps:
301: at least one first image of the display device is acquired with the acquisition device in the first posture, and at least one second image of the display device is acquired with the acquisition device in the second posture, wherein the display device is in the second mode.
In the process of acquiring at least one image of the display device, the display device displays the content in a second mode, wherein the second mode can be to reduce the perceived range of the display device (i.e. reduce the visual angle range of the display device) to display the content, for example, the perceived range of the display device can be reduced by starting the peep-proof function, and whether the peep-proof function is effective or not can be detected by acquiring the image in the second mode.
The electronic equipment comprises a first gesture and a second gesture, wherein the first gesture is characterized in that the acquisition range of the acquisition device comprises a target space position, the bearing device is positioned at the target space position, a display device of the electronic equipment in an output state borne by the bearing device faces to a first direction, the direction of the acquisition device in the first gesture and the reverse direction of the first direction meet the deviation condition, and the direction of the acquisition device in the second gesture and the reverse direction of the first direction meet the same condition.
302: the first image is identified to obtain a first identification result, and the second image is processed to obtain a second identification result.
303: and if the first identification result indicates that the first image has no content displayed by the display device and the second identification result indicates that the content in the second image is matched with the content displayed by the display device, determining that the second mode of the display device meets the display requirement.
If the first recognition result shows that the content displayed by the display device does not exist in the first image, the acquisition device in the first gesture in the process of displaying the content by the display device in the second mode is indicated to not acquire the content displayed by the display device, if the second recognition result shows that the content in the second image is matched with the content displayed by the display device, the acquisition device in the second gesture in the process of displaying the content by the display device in the second mode is indicated to acquire the content displayed by the display device, and the acquired content is consistent with the displayed content, so that the fact that the content is not acquired by the first gesture is caused by problems of the display device, but is caused by the fact that the second mode is reduced is acted, the second mode of the display device is determined to meet display requirements, and detection accuracy is improved.
Referring to fig. 13, an optional flow of a further detection method provided by an embodiment of the present application may include the following steps:
401: at least one third image of the display device is acquired by the acquisition device in the first posture, and the display device displays the second content in the second mode.
402: at least one fourth image of the display device is acquired with the acquisition device in the first pose, and the display device displays third content in a third mode.
The electronic equipment comprises a collecting device, a bearing device, a display device, a first gesture and a second gesture, wherein the collecting device comprises a target space position in a collecting range, the bearing device is positioned at the target space position, the display device of the electronic equipment in an output state, which is borne by the bearing device, faces to a first direction, and the direction of the collecting device in the first gesture and the direction of the first direction meet a deviation condition. When the acquisition device is in the first posture, the mode of the display device is switched, so that the acquisition device can acquire images in different modes respectively in the first posture.
403: the third image is identified to obtain a third identification result, and the fourth image is identified to obtain a fourth identification result.
404: if the third recognition result indicates that the third image does not have the second content and the fourth recognition result indicates that the content in the fourth image is matched with the third content, determining that the second mode and the third mode of the display device meet the display requirement, wherein the display requirement comprises that the perceived range of the third mode is larger than that of the second mode.
If the third recognition result shows that the third image has no content displayed by the display device, the acquisition device in the first gesture in the process of displaying the content by the display device in the second mode does not acquire the content displayed by the display device, and if the fourth recognition result shows that the content in the fourth image is matched with the content displayed by the display device, the acquisition device in the first gesture in the process of displaying the content by the display device in the third mode acquires the content displayed by the display device and the acquired content is consistent with the displayed content, so that the fact that the content is not acquired by the display device in the first gesture in the second mode is not caused by problems is determined, but the fact that the second mode is reduced is acted because the perceived range is reduced is determined, so that the second mode of the display device meets display requirements, and detection accuracy is improved.
Referring to fig. 14, an optional flow of a further detection method provided by an embodiment of the present application may include the following steps:
501: at least one third image of the display device is acquired by the acquisition device in the first posture, and the display device displays the second content in the second mode.
502: at least one fourth image of the display device is acquired with the acquisition device in the first pose, and the display device displays third content in a third mode.
503: at least one fifth image of the display device is acquired with the acquisition device in the second pose, and the display device displays fourth content in the second mode.
504: at least one sixth image of the display device is acquired with the acquisition device in the second pose, and the display device displays the fifth content in the third mode.
505: the third image is identified to obtain a third identification result, the fourth image is identified to obtain a fourth identification result, the fifth image is identified to obtain a fifth identification result, and the sixth image is identified to obtain a sixth identification result.
506: and if the third identification result shows that the third image has no second content, the fourth identification result shows that the content in the fourth image is matched with the third content, the fifth identification result shows that the content in the fifth image is matched with the fourth content, the sixth identification result shows that the content in the sixth image is matched with the fifth content, and it is determined that the second mode and the third mode of the display device meet display requirements. The display requirements include that the perceived range of the third mode is greater than the perceived range of the second mode.
The electronic equipment comprises a first gesture and a second gesture, wherein the first gesture is characterized in that the acquisition range of the acquisition device comprises a target space position, the bearing device is positioned at the target space position, a display device of the electronic equipment in an output state borne by the bearing device faces to a first direction, the direction of the acquisition device in the first gesture and the reverse direction of the first direction meet the deviation condition, and the direction of the acquisition device in the second gesture and the reverse direction of the first direction meet the same condition.
The detection method shown in fig. 14 is a combination of the detection methods shown in fig. 12 and 13, and is not described in detail herein, and by respectively acquiring with the acquisition device in the first posture and the second posture in different modes, it is possible to obtain an image of the display device from multiple aspects to improve the detection accuracy. The display device displays the content in the detection method described in the above embodiments.
It should be noted that, each embodiment in the present specification may be described in a progressive manner, and features described in each embodiment in the present specification may be replaced or combined with each other, and each embodiment is mainly described as different from other embodiments, and identical and similar parts between the embodiments are referred to each other. For the method class embodiment, since it is substantially similar to the system class embodiment, the description is relatively simple, and the relevant points are only referred to in the part of the description of the system class embodiment.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing is merely a preferred embodiment of the present application and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present application, which are intended to be comprehended within the scope of the present application.

Claims (10)

1. A detection system, comprising:
the electronic equipment comprises an acquisition device, a load bearing device and a display device, wherein the acquisition device is used for acquiring an image set of the display device of the electronic equipment in an output state, and the load bearing energy of the electronic equipment through the load bearing device is positioned in an acquisition range of the acquisition device, wherein the image set comprises at least one image;
the processing device is connected with the acquisition device and is used for processing the image to obtain a processing result, wherein the processing result indicates the perceived state of the display device in the acquisition direction of the acquisition device;
wherein, if the perceived status is perceived/acquired, the content displayed by the display device can be watched from the position where the acquisition device is located.
2. The system of claim 1, the acquisition range of the acquisition device including a target spatial location;
when the bearing device is positioned at the target space position, the display device of the electronic equipment in the output state, which is borne by the bearing device, faces to a first direction;
Wherein the orientation of the acquisition device and the reversal of the first direction satisfy a deviation condition.
3. The system of claim 1 or 2, the collection device comprising a first collection assembly and a second collection assembly, the first collection assembly and the second collection assembly being axisymmetrically disposed with respect to a display light axis of a first direction, the first direction being an orientation of the display device;
or (b)
The acquisition device comprises a first acquisition component, a second acquisition component and a third acquisition component, wherein the first acquisition component and the second acquisition component are arranged in axis symmetry relative to the display light in the first direction, and the direction of the third acquisition component are opposite to each other in the first direction so as to meet the same condition;
or (b)
The detection system further comprises a movement device, the acquisition device is connected with the movement device, the movement device controls the acquisition device to switch between a first posture and a second posture, wherein the first posture is a posture which is towards the direction opposite to the first direction and meets the deviation condition, and the second posture is a posture which is towards the direction opposite to the first direction and meets the same condition.
4. The system of claim 1, the detection system further comprising:
The first output device is used for outputting a target image, and the spatial positions of the first output device and the acquisition device relative to the display device meet the same condition;
the target image is an image meeting a switching condition, and the switching condition is a condition that the electronic equipment switches the perceived state of the display device.
5. The system of claim 4, the detection system further comprising: a second output means for outputting a reference image, wherein the reference image is an image that does not satisfy a switching condition;
wherein the first output device and the second output device are different devices or the first output device and the second output device are two parts of the same output device; and/or the reference image and the target image comprise images of the same content type.
6. A method of detection comprising:
obtaining an image set of a display device of electronic equipment in an output state, wherein the bearing energy of the electronic equipment through a bearing device is positioned in the acquisition range of an acquisition device, and the image set comprises at least one image;
processing the image to obtain a processing result, wherein the processing result indicates a perceived state of the display device in a collection direction of the collection device;
Wherein, if the perceived status is perceived/acquired, the content displayed by the display device can be watched from the position where the acquisition device is located.
7. The method of claim 6, the obtaining an image set of a display device of an electronic device in an output state comprising: acquiring at least one image of the display device with the acquisition device in a first pose, the display device displaying first content in a first mode;
the processing the image to obtain a processing result includes: and identifying the image to obtain an identification result, and if the identification result shows that the image does not contain the first content, determining that the first content is in an unaware state when the acquisition device is in the first gesture, wherein the first mode of the display device meets the display requirement.
8. The method of claim 6, the obtaining an image set of a display device of an electronic device in an output state comprising: acquiring at least one first image of the display device by using an acquisition device in a first posture, and acquiring at least one second image of the display device by using an acquisition device in a second posture, wherein the display device is in a second mode;
The processing the image to obtain a processing result includes: identifying the first image to obtain a first identification result, and identifying the second image to obtain a second identification result;
if the first identification result indicates that the first image has no content displayed by the display device and the second identification result indicates that the content in the second image is matched with the content displayed by the display device, determining that a second mode of the display device meets the display requirement;
the electronic equipment comprises a collecting device, a bearing device, a display device, a first gesture and a second gesture, wherein the collecting device comprises a target space position in a collecting range, the bearing device is positioned at the target space position, the display device of the electronic equipment in an output state, which is borne by the bearing device, faces to a first direction, the direction of the collecting device in a first gesture and the reverse direction of the first direction meet the deviation condition, and the direction of the collecting device in a second gesture and the reverse direction of the first direction meet the same condition.
9. The method of claim 6, the obtaining an image set of a display device of an electronic device in an output state comprising: acquiring at least one third image of the display device with the acquisition device in the first posture, the display device displaying second content in a second mode;
Acquiring at least one fourth image of the display device with the acquisition device in the first pose, the display device displaying third content in a third mode;
the processing the image to obtain a processing result includes: identifying the third image to obtain a third identification result, and identifying the fourth image to obtain a fourth identification result;
if the third identification result indicates that the second content is not in the third image and the fourth identification result indicates that the content in the fourth image is matched with the third content, determining that a second mode and a third mode of the display device meet display requirements; the display requirements include that the perceived range of the third mode is greater than the perceived range of the second mode;
the electronic equipment comprises a collecting device, a bearing device, a display device, a first gesture and a second gesture, wherein the collecting device comprises a target space position in a collecting range, the bearing device is located at the target space position, the display device of the electronic equipment in an output state, which is borne by the bearing device, faces to a first direction, and the direction of the collecting device in the first gesture and the direction of the first direction meet a deviation condition.
10. The method of claim 6, the obtaining an image set of a display device of an electronic device in an output state comprising: acquiring at least one third image of the display device with the acquisition device in the first posture, the display device displaying second content in a second mode;
Acquiring at least one fourth image of the display device with the acquisition device in the first pose, the display device displaying third content in a third mode;
acquiring at least one fifth image of the display device with the acquisition device in a second pose, the display device displaying fourth content in the second mode;
acquiring at least one sixth image of the display device with the acquisition device in the second pose, the display device displaying fifth content in the third mode;
the processing the image to obtain a processing result includes: identifying the third image to obtain a third identification result, identifying the fourth image to obtain a fourth identification result, identifying the fifth image to obtain a fifth identification result, and identifying the sixth image to obtain a sixth identification result;
if the third recognition result indicates that the second content is not in the third image, the fourth recognition result indicates that the content in the fourth image is matched with the third content, the fifth recognition result indicates that the content in the fifth image is matched with the fourth content, and the sixth recognition result indicates that the content in the sixth image is matched with the fifth content, determining that a second mode and a third mode of the display device meet display requirements; the display requirements include that the perceived range of the third mode is greater than the perceived range of the second mode;
The electronic equipment comprises a collecting device, a bearing device, a display device, a first gesture and a second gesture, wherein the collecting device comprises a target space position in a collecting range, the bearing device is positioned at the target space position, the display device of the electronic equipment in an output state, which is borne by the bearing device, faces to a first direction, the direction of the collecting device in a first gesture and the reverse direction of the first direction meet the deviation condition, and the direction of the collecting device in a second gesture and the reverse direction of the first direction meet the same condition.
CN202110349876.7A 2021-03-31 2021-03-31 Detection system and detection method Active CN113051946B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110349876.7A CN113051946B (en) 2021-03-31 2021-03-31 Detection system and detection method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110349876.7A CN113051946B (en) 2021-03-31 2021-03-31 Detection system and detection method

Publications (2)

Publication Number Publication Date
CN113051946A CN113051946A (en) 2021-06-29
CN113051946B true CN113051946B (en) 2023-09-19

Family

ID=76516704

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110349876.7A Active CN113051946B (en) 2021-03-31 2021-03-31 Detection system and detection method

Country Status (1)

Country Link
CN (1) CN113051946B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107861620A (en) * 2014-01-13 2018-03-30 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN110297536A (en) * 2019-06-30 2019-10-01 联想(北京)有限公司 A kind of control method and electronic equipment
CN110445926A (en) * 2019-06-30 2019-11-12 联想(北京)有限公司 A kind of processing method and electronic equipment
CN110868563A (en) * 2019-11-30 2020-03-06 联想(北京)有限公司 Electronic equipment and target object tracking method thereof

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9934735B2 (en) * 2012-11-13 2018-04-03 Beijing Lenovo Software Ltd. Display control method and electronic device
CN105334913B (en) * 2014-08-05 2019-02-05 联想(北京)有限公司 A kind of electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107861620A (en) * 2014-01-13 2018-03-30 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN110297536A (en) * 2019-06-30 2019-10-01 联想(北京)有限公司 A kind of control method and electronic equipment
CN110445926A (en) * 2019-06-30 2019-11-12 联想(北京)有限公司 A kind of processing method and electronic equipment
CN110868563A (en) * 2019-11-30 2020-03-06 联想(北京)有限公司 Electronic equipment and target object tracking method thereof

Also Published As

Publication number Publication date
CN113051946A (en) 2021-06-29

Similar Documents

Publication Publication Date Title
US11009945B2 (en) Method for operating an eye tracking device for multi-user eye tracking and eye tracking device
CN108353118B (en) Based on Dual-Aperture zoom digital camera with automatic adjustable focal length visual field
KR100606485B1 (en) Object tracking method and object tracking apparatus
JP3989523B2 (en) Automatic photographing method and apparatus
EP3287844B1 (en) A method in relation to acquiring digital images
JP5967473B2 (en) Imaging apparatus and imaging system
JP5942270B2 (en) Imaging system, camera control device used therefor, imaging method, camera control method, and computer program
CN101814130A (en) Iris identification device by using camera array and multimodal biometrics identification method
EP2712541A1 (en) Tiled image based scanning for head position for eye and gaze tracking
US9865033B1 (en) Motion-based image views
US20150215532A1 (en) Panoramic image capture
US20040179100A1 (en) Imaging device and a monitoring system
WO2014199786A1 (en) Imaging system
JP2006119408A (en) Video display method and device
JP2013013063A (en) Imaging apparatus and imaging system
JP2013013062A (en) Imaging apparatus and imaging system
JP5370380B2 (en) Video display method and video display device
CN113051946B (en) Detection system and detection method
JPH07184089A (en) Video camera
JP2010034652A (en) Multi-azimuth camera mounted mobile terminal apparatus
CN112445342B (en) Display screen control method and device and electronic equipment
CN110751109B (en) Apparatus, method, device and medium for acquiring face image
JP4444746B2 (en) Object tracking method and object tracking device
WO2021199853A1 (en) Information registration device, information registration system, information registration method and program storage medium
CN105306797A (en) User terminal and image shooting method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant