WO2023043327A1 - Camera device - Google Patents

Camera device Download PDF

Info

Publication number
WO2023043327A1
WO2023043327A1 PCT/RU2021/000397 RU2021000397W WO2023043327A1 WO 2023043327 A1 WO2023043327 A1 WO 2023043327A1 RU 2021000397 W RU2021000397 W RU 2021000397W WO 2023043327 A1 WO2023043327 A1 WO 2023043327A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera device
light
light source
camera
present technology
Prior art date
Application number
PCT/RU2021/000397
Other languages
French (fr)
Inventor
Viktor Vladimirovich Karpov
Nikolay Sergeevich Buldakov
Original Assignee
Yandex. Taxi Limited Liability Company
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yandex. Taxi Limited Liability Company filed Critical Yandex. Taxi Limited Liability Company
Priority to PCT/RU2021/000397 priority Critical patent/WO2023043327A1/en
Publication of WO2023043327A1 publication Critical patent/WO2023043327A1/en

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/02Bodies
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2215/00Special procedures for taking photographs; Apparatus therefor
    • G03B2215/05Combinations of cameras with electronic flash units
    • G03B2215/0503Built-in units

Definitions

  • the present technology relates generally to video monitoring devices, and more specifically to a camera device.
  • the at least one light source comprises a plurality of light sources; and the light source aperture is configured for receiving each one of the plurality of light sources.
  • the plurality of light sources is arranged in a line thereof, and the light source aperture is elongated, within the top assembly, for receiving the line of the light sources.
  • the light filter is for obfuscating the output light emitted by the at least one light source.
  • the surface is a part of a vehicle, and wherein the camera sensor is for monitoring an activity associated with a driver of the vehicle.
  • electronic device denotes any computer hardware that is capable of running software appropriate to the relevant task at hand.
  • the term “electronic device” implies that a device can function as a server for other electronic devices and client devices, however it is not required to be the case with respect to the present technology.
  • electronic devices include personal computers (desktops, laptops, netbooks, etc.), smart phones, and tablets, as well as network equipment such as routers, switches, and gateways.
  • Implementations of the present technology each have at least one of the above- mentioned aspects, but do not necessarily have all of them. It should be understood that some aspects of the present technology that have resulted from attempting to attain the above- mentioned object may not satisfy this object and/or may satisfy other objects not specifically recited herein.
  • Figure 1 depicts a top-front-left side perspective view of a camera device, in accordance with certain non-limiting embodiments of the present technology
  • Figure 2 depicts a botom-rear-left side perspective view of the camera device, in accordance with certain non-limiting embodiments of the present technology
  • Figure 6 depicts a partially exploded rear perspective view of a given wall of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology
  • Figure 7 depicts a schematic diagram of a particular implementation of apertures for receiving light sources and a camera sensors within the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology
  • Figure 13 depicts a bottom side elevation view of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology
  • the camera device 100 can be positioned by an operator of the camera device 100, using the mount assembly 104, on a support surface (not depicted), such as one of inner surfaces (for example, that of a windshield) of a vehicle (not depicted).
  • a support surface such as one of inner surfaces (for example, that of a windshield) of a vehicle (not depicted).
  • the camera device 100 may typically be installed at a point forward of a driver (in a direction of travel of the vehicle) and facing towards the driver of the vehicle (both not depicted).
  • the body portion 102 includes a camera device housing
  • the light-absorbing coating 804 can be, without limitation, at least one of a light-absorbing paste, a light-absorbing film, and a light-absorbing foil, as an example.
  • the secondary camera device can be directed towards a passenger of the vehicle.
  • secondary image data generated by the secondary camera device may be representative of an activity associated with the passenger.
  • the processor can be configured to determine his or her current physical condition, such as a condition associated with drunkenness or excessive agitation, as an example.
  • the processor can be configured to determine that the passenger is being too emotional and/or located too close to the driver posing danger thereto.
  • the wireless interface port 1302 may be implemented as a Near Field Communication (NFC) tag associated with the camera device 100.
  • NFC Near Field Communication
  • the local wireless connection between the processor and the given electronic device may be established by placing the given external electronic device within a predetermined distance from the NFC tag (and thus, from the camera device 100).
  • securing the first linking element 122 in a selected one of the plurality of angular position thereof relative to the n second linking element 124 may be executed by causing the locking protrusion 346 to displace back to its initial state where the pinion mechanism 348 thereof is coupled with the similar pinion mechanism of the hollow inside of the second linking element 124.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

A camera device is provided. The camera device comprises a camera device housing having a plurality of walls, the camera device housing including: at least one light source configured to emit output light along an outbound light path; a camera sensor configured to sense light reflected off a surrounding area of the camera device along an inbound light path, the camera sensor including a lens facing outwardly therefrom; and a protective cover disposed in the outbound light path and the inbound light path, the protective cover causing inner reflection of a stray portion of the output light such that the stray portion does not pass therethrough and is incident onto the lens of the camera sensor; and the at least one light source is positioned at a first distance from the protective cover such that to minimize the stray portion, thereby preventing incidence thereof on the lens.

Description

CAMERA DEVICE
FIELD
[0001] The present technology relates generally to video monitoring devices, and more specifically to a camera device.
BACKGROUND
[0002] There are many electronic devices capable of tracking various types of activities associated with a vehicle (or a driver thereof) as it moves. Some of these electronic devices generally include onboard video recorders (such as dash cams) configured to continuously record the view in front of the vehicle, for example, for providing video evidence in case of an accident. Other of these electronic devices may include electronic devices for monitoring a current physical condition of the driver of the vehicle. The latter typically include an onboard camera device pointed at the driver as he/she operates the vehicle. The onboard camera device may be configured to continuously receive imaging data associated with the driver (for example, that of his/her face) and further analyze the imaging data for detecting certain indications of the physical condition of the driver that may be associated with a higher risk of a road accident. For example, the onboard camera device may be configured to detect indications of the driver being fatigued, drowsy or otherwise incapacitated (for example, under an influence of alcohol or other substances). In response to detecting such indications, the onboard camera device may be configured to generate an alert signal informing the driver of his/her physical condition being potentially inappropriate for operating the vehicle or take another remedial action. Thus, the more accurately the onboard camera device is configured to detect the indications of the inappropriate physical condition of the driver as he/she operates the vehicle, the more effectively road accidents may be averted.
[0003] Typically, a given onboard camera device includes a light source emitting outbound light beams to scan surroundings thereof and a camera sensor configured to receive inbound light beams reflected off the surroundings of the given onboard camera device, thereby generating the imaging data indicative of objects and/or subjects located therein - such as the driver of the vehicle. The light source and the camera sensor may further be covered by a protective cover (such as that made of a polymer material or glass) providing, for example, mechanical protection to the components of the given onboard camera device. [0004] However, some of such devices, due to certain design specifics thereof, may provide the imaging data of their surroundings of a poorer quality. For example, the poorer quality of the imaging data may be caused by extraneous light emitted by the light source as part of the outbound light beams. Further, this extraneous light, due to its angle of incidence on the protective cover is unable to go thorough it and can thus be reflected, within inner surfaces of the protective cover, on the camera sensor. Thus, such unwanted illumination of the camera sensor may prevent receiving the inbound light beams from the surroundings of the given camera device reducing the quality of the imaging data. For example, this illumination of the camera sensor may cause a so-called milky glare effect on one or more images generated by the camera sensor resulting in the one or more images being blurred, which affects clarity thereof.
[0005] Certain prior art devices have been proposed to address the above-identified technical problem.
[0006] Korean Patent No.: 100,733,765-Bl issued on June 29, 2007 and entitled “Dome Type Security Camera Mounting the Infrared LED” discloses a dome type security camera with infrared LEDs is provided to discharge heat generated from the infrared LEDs (Light Emitting Diodes) via a heat emission hole to prevent deformation caused by the heat, and obtain high quality images even in the dark situations by mounting a blocking plate and an elastic element for protecting a lens part and an operation space of a camera module from the infrared LED light. A dome type security camera with infrared LEDs includes a plurality of infrared LEDs aligned on a board and mounted at both sides of a camera module. A dome type inner cover has an operation space punched in the center for the operation of the camera module, and a blocking wall fitted between the infrared LEDs for guiding light forward while blocking incident light not to be introduced into a lens part. An elastic element is protruded outward around the operation space, wherein the elastic element closely contacts an inner surface of a dome type outer cover.
[0007] Chinese Patent No.: 102,135,701-A issued on April 10, 2013 and entitled “Camera and Infrared Light-Emitting Diode Adjusting Device” discloses a camera and an infrared lightemitting diode adjusting device. A front plane of a shell is an inclined surface; a front cover and tempered glass are arranged on the front of the shell; an upper cover is arranged on the shell; a convex stretching section is arranged in the center of the inclined surface; more than one infrared light-emitting diode is arranged on two sides of the convex stretching section; an arc-shaped concave table is arranged inside the shell; an arc-shaped extension section is arranged below a camera assembly and corresponds to the arc-shaped concave table inside the shell; the extension section of the camera assembly can adjust the angle of the camera assembly along the arc-shaped concave table; and the camera assembly is positioned in a space formed by the convex stretching section. Besides change of more angles, the convex stretching section is matched with an elastic adhesive tape in a groove, the camera assembly can be prevented from being interfered by the infrared light-emitting diodes in the process of shooting, and the camera assembly is prevented from directly bearing external force impact so as not to be damaged.
SUMMARY
[0008] It is an object of the present technology to ameliorate at least some of the inconveniences of the prior art.
[0009] Developers of the present technology have appreciated that positioning the light source at a certain distance from the protective cover may assist in reducing a stray portion of the outbound light beams. More specifically, the developers have realized that depressing the light source in a respective aperture or positioning it, within the housing of the given onboard camera device, in a recess of a certain depth can decrease the divergence of the outbound light beams and thus prevent inner reflection of the stray portion within the protective cover, thereby preventing incidence thereof on the camera senor.
[0010] By so doing, non-limiting embodiments of the present technology may allow preventing the milky glare effect on the images generated by the camera sensor improving overall quality thereof.
[0011] Therefore, in accordance with a first broad aspect of the present technology, there is provided a camera device. The camera device comprises: a camera device housing having a plurality of walls. The camera device housing includes: at least one light source configured to emit output light outwardly from the camera device housing along an outbound light path, the at least one light source being received in a light source aperture of the camera device housing; a camera sensor configured to sense light reflected off a surrounding area of the camera device along an inbound light path. The camera sensor includes a lens received in a lens aperture of the camera device housing and facing outwardly therefrom. The light source aperture and the lens aperture are defined in a given one of the plurality of walls of the camera device housing. The camera device housing further includes a protective cover disposed in the outbound light path and the inbound light path, the protective cover causing inner reflection of a stray portion of the output light within the protective cover such that the stray portion does not pass through the protective cover and is incident onto the lens of the camera sensor; and the at least one light source being depressed within the light source aperture at a first distance from the protective cover such that to minimize the stray portion of the output light, thereby preventing incidence thereof on the lens of the camera sensor.
[0012] In some implementations of the camera device, the given one of the plurality of walls of the camera device housing further defines a respective baffle protruding from each one of the light source aperture and the lens aperture for further minimizing the stray portion of the output light.
[0013] In some implementations of the camera device, the respective baffle extends from the given one of the plurality of walls to the protective cover of the camera device.
[0014] In some implementations of the camera device the at least one light source comprises a plurality of light sources; and the light source aperture is configured for receiving each one of the plurality of light sources.
[0015] In some implementations of the camera device, the plurality of light sources is arranged in a line thereof, and the light source aperture is elongated, within the top assembly, for receiving the line of the light sources.
[0016] In some implementations of the camera device, the light source aperture is spaced, within the given one of the plurality of walls of the camera device housing, at a second distance from the lens aperture.
[0017] In some implementations of the camera device, the second distance has been determined as being a maximum possible distance within dimensions of the given one of the plurality of walls of the camera device housing for attenuating the stray portion of the output light reflected within the protective cover without passing therethrough.
[0018] In some implementations of the camera device, a portion of an inner surface of the protective cover, has been treated with a light-absorbing coating for further attenuating the stray portion reflected within the protective cover, the portion excluding a surface intersecting the inbound light path and the outbound light path.
[0019] In some implementations of the camera device, the first distance has been determined to minimize a radiation angle of the at least one light source.
[0020] In some implementations of the camera device, the first distance has been determined as a maximum possible distance such that a radiation angle of the at least one light source corresponds to a field of view of the camera sensor.
[0021] In some implementations of the camera device, for receiving the at least one light source, the given one of the plurality of walls further defines a groove protruding inwardly in the camera device housing from the light source aperture, the groove having a depth having been determined based at least on the first distance.
[0022] In some implementations of the camera device, the at least one light source is an infrared light emitting diode.
[0023] In some implementations of the camera device, the protective cover comprises a light filter configured for passing the output light emitted by the at least one light source.
[0024] In some implementations of the camera device, the light filter is for obfuscating the output light emitted by the at least one light source.
[0025] In some implementations of the camera device, the camera device further comprises a mount assembly connected to an other one of the plurality of walls of the camera device housing for mounting the camera device onto a surface.
[0026] In some implementations of the camera device, the surface is a part of a vehicle, and wherein the camera sensor is for monitoring an activity associated with a driver of the vehicle. [0027] In the context of the present specification, "electronic device" denotes any computer hardware that is capable of running software appropriate to the relevant task at hand. In the context of the present specification, the term "electronic device" implies that a device can function as a server for other electronic devices and client devices, however it is not required to be the case with respect to the present technology. Thus, some (non-limiting) examples of electronic devices include personal computers (desktops, laptops, netbooks, etc.), smart phones, and tablets, as well as network equipment such as routers, switches, and gateways. It should be understood that in the present context the fact that the device functions as an electronic device does not mean that it cannot function as a server for other electronic devices. The use of the expression "an electronic device" does not preclude multiple client devices being used in receiving/sending, carrying out or causing to be carried out any task or request, or the consequences of any task or request, or steps of any method described herein.
[0028] In the context of the present specification the term “safety event” associated with driving a vehicle refers broadly to a situation where at least one of the vehicle and a driver thereof behaves in an unexpected manner resulting in an uncontrollable movement of the vehicle, which may cause harm to the driver, the vehicle, and other road users, such as other drivers and pedestrians.
[0029] For purposes of this application, terms related to spatial orientation such as forwardly, rearwardly, upwardly, downwardly, left, and right, are as they would normally be understood by a user or operator of the camera device. Terms related to spatial orientation when describing or referring to components or sub-assemblies of the device, separately from the device should be understood as they would be understood when these components or sub-assemblies are mounted to the device.
[0030] Implementations of the present technology each have at least one of the above- mentioned aspects, but do not necessarily have all of them. It should be understood that some aspects of the present technology that have resulted from attempting to attain the above- mentioned object may not satisfy this object and/or may satisfy other objects not specifically recited herein.
[0031] Additional and/or alternative features, aspects, and advantages of implementations of the present technology will become apparent from the following description, the accompanying drawings, and the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] For a beter understanding of the present technology, as well as other aspects and further features thereof, reference is made to the following description which is to be used in conjunction with the accompanying drawings, where:
[0033] Figure 1 depicts a top-front-left side perspective view of a camera device, in accordance with certain non-limiting embodiments of the present technology;
[0034] Figure 2 depicts a botom-rear-left side perspective view of the camera device, in accordance with certain non-limiting embodiments of the present technology;
[0035] Figure 3 depicts a partially exploded perspective view illustrating at least some components of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
[0036] Figure 4 depicts a partially exploded front perspective view of a given wall of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
[0037] Figure 5 depicts a schematic diagram of light paths within the camera device of Figure 1 , in accordance with certain non-limiting embodiments of the present technology;
[0038] Figure 6 depicts a partially exploded rear perspective view of a given wall of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
[0039] Figure 7 depicts a schematic diagram of a particular implementation of apertures for receiving light sources and a camera sensors within the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
[0040] Figure 8 depicts a schematic diagram of a protective cover of the camera device of Figure 1 treated with a light-absorbing coating, in accordance with certain non-limiting embodiments of the present technology;
[0041] Figure 8 depicts a front side elevation view of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology; [0042] Figure 9 depicts a rear side elevation view of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
[0043] Figure 10 depicts a right-side elevation view of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
[0044] Figure 11 depicts a left side elevation view of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
[0045] Figure 12 depicts a top side elevation view of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology; and
[0046] Figure 13 depicts a bottom side elevation view of the camera device of Figure 1, in accordance with certain non-limiting embodiments of the present technology;
DETAILED DESCRIPTION
[0047] Referring initially to Figures 1, 2, and 3, there is depicted a camera device 100, in accordance with certain non-limiting embodiments of the present technology. As it can be appreciated, the camera device 100 includes a body portion 102. In some non-limiting embodiments of the present technology, the camera device 100 can further include a mount assembly 104. However, it should be noted that implementations of the camera device 100 without the mount assembly 104 are also envisioned by the non-limiting embodiments of the present technology.
[0048] Thus, according to certain non-limiting embodiments of the present technology, the camera device 100 can be positioned by an operator of the camera device 100, using the mount assembly 104, on a support surface (not depicted), such as one of inner surfaces (for example, that of a windshield) of a vehicle (not depicted). To that end, the camera device 100 may typically be installed at a point forward of a driver (in a direction of travel of the vehicle) and facing towards the driver of the vehicle (both not depicted).
[0049] In this regard, according to some non- limiting embodiments of the present technology, the camera device 100 can be configured to (1) receive image data representative of a camera surrounding area (such as a camera surrounding area 520 depicted in Figure 5) of the camera device 100; (2) analyze the received image data; (3) in response to the analyzing rendering a result indicative of a safety event, execute an action associated with the safety event.
[0050] The structure and operation of the camera device 100 will now be described in sections respectively dedicated to the body portion 102 and the mount assembly 104 thereof.
Body Portion
[0051] With continued reference to Figures 1, 2, and 3, according to certain non-limiting embodiments of the present technology, the body portion 102 includes a camera device housing
108 configured to receive a plurality of hardware components for implementing the above- mentioned functionality of the camera device 100, which will be described below. The camera device housing 108 is covered by a top assembly 106. It should be noted that the plurality of hardware components has been omitted in Figure 3 for the sake of clarity and simplicity of the present description and associated illustrations.
[0052] According to certain non-limiting embodiments of the present technology, the camera device housing 108 includes a plurality of sidewalls 109 and a bottom portion 209. As it can be appreciated, the plurality of sidewalls 109 form an open convex surface, whose horizontal cross-section, parallel to the top assembly 106, has a form of a rounded comer square.
[0053] According to the non-limiting embodiments of the present technology, the plurality of sidewalls 109 may define various apertures and ports for receiving at least some of the plurality of hardware components of the camera device 100 and connecting external devices thereto, which will be described in greater detail below. For example, the plurality of sidewalls 109 may define a power port 112 for connecting the camera device 100 to an external electrical power source and with one or more electronic devices (such a smartphone or a tablet, not separately depicted) using a wired connection. It is contemplated that the plurality of sidewalls
109 may have additional ports (not depicted) without departing from the scope of the present technology.
[0054] Also, according to certain non-limiting embodiments of the present technology, for providing free air cooling to the plurality of hardware components of the camera device 100, at least one of the top assembly 106 and the camera device housing 108 may define a plurality of ventilation orifices 309. The plurality of ventilation orifices 309 may vary in shape and number suitable for providing necessary air exchange between the camera device housing 108 and the outside environment. By way of example, and not as a limitation, the plurality of ventilation orifices may be defined in at least one of the plurality of sidewalls 109 substantially covering a surface thereof.
[0055] Further, according to certain non-limiting embodiments of the present technology, the top assembly 106 includes a protrusion 307 extending downwardly therefrom and further defining, on an outer surface thereof, locking indents 306 for attaching the top assembly 106 to the camera device housing 108, thereby assembling the body portion 102 of the camera device 100. The protrusion 307 can be implemented as a square protrusion, but other form factors are also envisioned.
[0056] To that end, the camera device housing 108 may include locking protrusions 308 located along the top of the camera device housing 108, on an inner surface of the plurality of sidewalls 109, and projecting inwardly with respect thereto. Further, by receiving the locking protrusions 308 within the locking indents 306, the top assembly 106 may be attached (and be detachably secured) to the camera device housing 108, such that the protrusion 307 is received by the inner surface of the camera device housing 108. In this regard, it is contemplated that a number of the locking indents 306 may be equal to a number of the locking protrusions 308. It should be noted that the number of the locking protrusions 308 may vary in certain non-limiting embodiments of the present technology comprising, for example, one, two, or three along each of the plurality of sidewalls 109.
[0057] It should further be noted that, before attaching the top assembly 106 to the camera device housing 108, the locking indents 306 may be aligned relative to the locking protrusions 308. To that end, the top assembly 106 may further include support beams 310 projecting downwardly from an inside of the protrusion 307; and the camera device housing 108 may further include sliding guides 312 located in rounded comers defined by the plurality of sidewalls 109 and projecting above the plurality of sidewalls 109 of the camera device housing 108. Thus, alignment of the locking indents 306 of the top assembly 106 relative to the locking protrusions 308 of the camera device housing 108 may be achieved when the support beams 310 of the former are received in the sliding guides 312 of the latter. Also, the sliding guides 312, when received in the top assembly 106, may allow for additional horizontal fixation thereof relative to the camera device housing 108.
[0058] Further, according to certain non-limiting embodiments of the present technology, the bottom portion 209 of the camera device housing 108 may be defined, in the camera device housing 108, by tapering the plurality of sidewalls 109 downwardly. Thus, the bottom portion 209 may define a cone-shaped protrusion 208 located in the center thereof and extending outwardly therefrom. As such, the bottom portion 209 may be configured to receive, in the cone-shaped protrusion 208, the mount assembly 104, which allows connecting the body portion 102 with the mount assembly 104.
[0059] It is also contemplated that the top assembly 106 and the camera device housing 108 may further include mounting members 314 projecting inwardly with respect to the camera device housing 108 (for example, for receiving the plurality of hardware components of the camera device 100). Generally speaking, implementation of each of the mounting members 314 may depend on a respective one of the plurality of hardware components, however, for example, and not as a limitation, the mounting members 314 may include installation enclosures, protrusions defining respective screw holes, mounting brackets, and the like. It is further contemplated that the support beams 310 may also be configured to be used for mounting at least part of the plurality of hardware components of the camera device 100.
[0060] Further, it is contemplated that at least some of the below-described plurality of hardware components of the camera device 100 may be implemented as microchips and thus may be positioned on one or more printed circuit boards. In such embodiments, the camera device housing 108 ma be configured, using the mounting members 314, as an example, for receiving the plurality of hardware components of the camera device 100.
[0061] According to some non-limiting embodiments of the present technology, the camera device 100 may include a processor (not depicted). When the camera device 100 is assembled, the processor is communicatively coupled with the top assembly 106 (for example, by a wired connection).
[0062] It should be noted that, in some embodiments of the present technology, the processor may comprise one or more processors and/or one or more microcontrollers configured to execute instructions and to carry out operations associated with the operation of the camera device 100. In various non-limiting embodiments of the present technology, the processor may be implemented as a single-chip, multiple chips and/or other electrical components including one or more integrated circuits and printed circuit boards. The processor may optionally contain a cache memory unit for temporary local storage of instructions, data, or additional computer information. By way of example, the processor may include one or more processors or one or more controllers dedicated for certain processing tasks of the camera device 100 or a single multi-functional processor or controller.
[0063] Moreover, explicit use of the term "processor" or "controller" should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, network processor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), read-only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage.
[0064] Further, according to some non-limiting embodiments of the present technology, the camera device 100 may include a communication module (not depicted). Such communication module may be configured for implementing one of communication protocols (both wireless and wired) enabling the processor to be connected with other electronic devices or remote servers. Various examples of how the communication module may be implemented include, without being limited to, a Bluetooth™ communication module, a UART™ communication module, a Wi-Fi™ communication module, an LTE™ communication module, and the like.
[0065] According to the non-limiting embodiments of the present technology, communication between the processor and other ones of the plurality of hardware components, such as the communication module, as well as amongst each other, may be implemented by one or more internal and/or external buses (e.g. a PCI bus, universal serial bus, IEEE 1394 “Firewire” bus, SCSI bus, Serial-ATA bus, etc.), to which a respective one of the plurality of hardware components of the camera device 100 is electronically coupled.
[0066] Configuration, components, and a manner of assembling the top assembly 106 will now be described.
Top Assembly
[0067] With reference to Figures 4 and 5, there is depicted a partially exploded view of the top assembly 106 of the camera device 100, and a schematic diagram of light paths therewithin when the top assembly 106 is assembled, respectively, in accordance with certain non-limiting embodiments of the present technology.
[0068] According to certain non-limiting embodiments of the present technology, the top assembly 106 may be configured to capture light reflected off objects located in the camera surrounding area 520, thereby generating image data representative thereof. For example, in those non-limiting embodiments of the present technology where the camera device 100 is positioned on the support surface such that it is directed towards the driver of the vehicle, the image data may be representative of certain current facial features of the driver. However, in other non-limiting embodiments of the present technology where the camera device 100 is positioned on the support surface to be directed outside the vehicle, the image data may be representative of a vehicle surrounding area (not depicted) of the vehicle.
[0069] Thus, according to certain non-limiting embodiments of the present technology, the camera device 100 may include at least one light source 402, communicatively coupled to the processor, configured to emit an output light flow along an outbound light path 502 towards the camera surrounding area 520. Once the output light flow reaches the camera surrounding area 520, it can then be reflected, for example, by an object 510, thereby generating a reflected light flow. Thus, in some non-limiting embodiments of the present technology, the camera device 100 can further include a camera sensor 404 communicatively coupled to the processor, and including a camera lens (not separately labelled) configured to receive the reflected light flow along an inbound light path 504. Further, by processing the reflected light flow, the camera sensor 404 can be configured to generate the image data representative of the object 510 in the camera surrounding area 520.
[0070] In some non-limiting embodiments of the present technology, where the camera device 100 is directed towards the inside of the vehicle, the object 510 can be, without limitation, the driver and a passenger of the driver, as an example. However, in those embodiments where the camera device 100 is directed towards the outside of the vehicle, the object 510 can, for example, be another vehicle, a streetlamp, a pedestrian, a guardrail, and the like.
[0071] As it can be appreciated form Figure 4, in some non-limiting embodiments of the present technology, the top assembly 106 can define a recess 410, wherein the top assembly 106 can further define a light source aperture 406 and a camera lens aperture 408 configured for receiving each one of the at least one light source 402 and the camera lens of the camera sensor 404, respectively, such that both of them are facing outwardly from the top assembly 106, in the direction of the camera surrounding area 520 of the camera device 100.
[0072] Although in the depicted embodiments of Figure 4, both the light source aperture 406 and the camera lens aperture 408 are defined within the recess 410 of the top assembly 106, it should be expressly understood, that such positioning of the at least one light source 402 and the camera sensor 404 might not be the case in each and every embodiment of the present technology. For example, in some non-limiting embodiments of the present technology, the light source aperture 406 may be located on one at the front and at a side of the camera lens aperture 408. In other non-limiting embodiments of the present technology, the light source aperture 406 may be defined in at least one of the plurality of sidewalls 109 of the camera device housing 108.
[0073] According to certain non-limiting embodiments of the present technology, the at least one light source 402 of the camera device 100 may comprise a light emitting diode (LED) configured to emit light of a particular operating wavelength. The operating wavelength of the at least one light source 402 may be in the infrared, visible, and/or ultraviolet portions of the electromagnetic spectrum. For example, the at least one light source 402 may include a LED configured to emit light at an operating wavelength between about 240 nm and 360 nm. Alternatively, the at least one light source 402 may include a LED configured to emit light at a wavelength between about 395 nm to 530 nm or between about 565 nm and about 645 nm. In additional non-limiting embodiments of the present technology, the at least one light source 402 can comprise an infrared LED configured to emit light at wavelengths from around 600 nm to around 990 nm. However, it should be noted that the at least one light source 402 may include LEDs with different operating wavelengths, without departing from the scope of the present technology.
[0074] In a specific non-limiting example, the at least one light source 402 can be implemented as an infrared LED of a type available from BOSTON ELECTRONICS CORPORATION of 91 Boylston St. Brookline, MA 02445 United States. It should be expressly understood that the at least one light source 402 can be implemented in any other suitable equipment.
[0075] Further, in some non-limiting embodiments of the present technology, the at least one light source 402 may include a plurality, such as three, four, five, or even ten, light sources, such as LEDs as described above or a combination of different light sources. In this regard, the recess 410 of the top assembly 106 may define the light source aperture 406 for receiving the plurality of light sources arranged in a pre-determined arrangement thereof. For example, as depicted in Figure 4, the plurality of light sources may be arranged in a line; and thus, the light source aperture 406 can be elongated to receive the line of light sources therein. However, it should be noted that other ways of arrangement the plurality of light sources are also envisioned - for example, a rectangular arrangement where several lines of lights sources are stacked adjacent to each other or even a circular arrangement of the plurality of light sources.
[0076] Further, generally speaking, the camera sensor 404 may be configured, by the processor, to generate the image data of the object 510 in the camera surrounding area 520 by converting the reflected light flow into electrical signals. Non-limiting examples of implementing the camera sensor 404 may include, for example, a charge-couple device (CCD) camera sensor and a complementary metal-oxide-semiconductor (CMOS) camera sensor.
[0077] In some non-limiting embodiments of the present technology, the camera sensor 404 may be configured to generate the image data in a form of an image sequence taken with a predetermined time interval. In other non-limiting embodiments of the present technology, the image data may comprise video image data continuously recorded by the camera sensor 404 during a predetermined period.
[0078] In a specific non-limiting example, the camera sensor 404 can be implemented as a CMOS image sensor of a type available from SONY SEMICONDUCTOR SOLUTIONS CORPORATION of 4-14-1 Asahicho, Atsugishi, Kanagawa, 243-0014, Japan. It should be expressly understood that the camera sensor 404 can be implemented in any other suitable equipment.
[0079] Further, in some non-limiting embodiments of the present technology, the camera lens of the camera sensor 404 may comprise an optical assembly configured for receiving and focusing the reflected light flow, reflected off the object 510. A particular configuration (such as spatial curvature and dimensions thereof) of the camera lens may be said to define a field of view (both horizontally and vertically) of the camera device 100, which can be, according to various non-limiting embodiments of the present technology, in either direction, from 55 to 80 degrees. Thus, as it can be appreciated dimensions and configuration of the camera lens aperture 408 would depend on how the camera lens of the camera sensor 404 is implemented. For example, in those embodiments where the camera lens has a circular form factor, as depicted in Figure 4, the camera lens aperture 408 would also be circular with the dimensions corresponding to the dimensions of the camera lens. However, other form factors of the camera lens, such as square, as an example, are also envisioned without departing from the scope of then present technology. [0080] Further, in some non-limiting embodiments of the present technology, the camera lens aperture 408 can be defined, within the recess 410, relative to the light source aperture 406. For example, the light source aperture 406 and the camera lens aperture 408 may be defined, within the recess 410, such that at least some of respective symmetry lines thereof coincide. More specifically, as depicted in Figure 4, in those embodiments where the light source aperture 406 is of a rectangular form and a camera lens aperture 408 has a circular form, they can be defined, within the recess 410, such that a transverse symmetry axis of the former coincides with at least one symmetry axis of the latter. Further, the camera lens aperture 408 can be defined at a given distance from the light source aperture 406. In some non-limiting embodiments of the present technology, the given distance between the light source aperture 406 and the camera lens aperture 408 can be predetermined, as will be described below.
[0081] According to certain non-limiting embodiments of the present technology, the top assembly 106 of the camera device 100 may further include a protective cover 110. As it can be appreciated form Figures 4 and 5, the protective cover 110 can be received in the recess 410 such that it is disposed in the outbound light path 502 and in the inbound light path 504 associated with the camera device 100. For example, as depicted in Figure 4, the protective cover 110 can be received in the recess 410 of the top assembly 106 such that it is flush therewith.
[0082] In some non-limiting embodiments of the present technology, the protective cover 110 may be configured to provide the components of the camera device 100, such as the at least one light source 402 and the camera lens of the camera sensor 404, with mechanical protection including dust protection, moisture protection, and the like. To that end, the protective cover 110 may be made, for example, from a polymer material such as acrylic glass (plexiglass), polycarbonate, or regular glass. In some non-limiting embodiments of the present technology, the protective cover 110 can be implemented in a certain color to make components located inside the camera device 100 less visible from outside thereof.
[0083] However, in other non-limiting embodiments of the present technology, the protective cover can have certain optical properties, thereby forming part of an optical system of the camera device 100. For example, in some non-limiting embodiments of the present technology, the protective cover 110 can be implemented as an optical filter. Broadly speaking, an optical filter, as used herein, is a device that is configured for selectively transmitting light of certain wavelengths while filtering out (that is, absorbing) others. Thus, generally, technical characteristics of the optical filter, such as thickness thereof, a color thereof, and a material from which it is produced, and others, are defined largely by desired wavelengths of the light transmitted by the optical filter.
[0084] In some non-limiting embodiments of the present technology, the optical filter may be a bandpass optical filter configured to transmit light of a predetermined wavelength range of the electromagnetic spectrum. For example, the optical filter may be a UV bandpass optical filter and thus be configured to pass light of wavelengths from about 180 nm to about 400 nm. In another example, the optical filter may be configured to transmit light in a predetermined range of wavelengths corresponding to the visible light, such as from about 400 nm to about 575 nm.
[0085] Also, in some non-limiting embodiments of the present technology, the protective cover 110 may be implemented as the optical filter having an operating wavelength range corresponding to that of the at least one light source 402. For example, in those embodiments of the present technology where the at least one light source 402 is implemented as an IR LED with the operating wavelength from about 600 nm to about 900 nm, the optical filter may be an IR bandpass optical filter having an operating wavelength range at least partially covering that of the at least one light source 402, such as from about 700 nm to about 1650 nm, from about 650 nm to about 800 nm, from 780 nm to about 1000 nm, and the like. In other nonlimiting embodiments of the present technology, the optical filter may be configured to pass light of a single predetermined wavelength, for example, without limitation, 800 nm. Thus, such an implementation of the protective cover 110 may allow preventing image noise in the image data representative of the camera surrounding area 520 generated by the camera sensor 404. More specifically, such as an implementation of the protective cover 110 with respect to the at least one light source 402 may allow the camera sensor 404 to receive lesser light noise, for example, from the Sun and other light sources located in the camera surrounding area 520, compared to operating within a wavelength range corresponding to the visible light, as an example.
[0086] However, in certain cases, disposing the at least one light source 402 and the camera lens of the camera sensor 404 within one wall of the camera device 100, that is the top assembly 106, under the protective cover 110 may result in lower quality of the image data generated by the camera sensor 404. More specifically, in accordance with certain non-limiting embodiments of the present technology, the protective cover 110 may have certain reflective properties causing inner reflection of at least a portion of the output light flow generated by the at least one light source 402 within the protective cover 110 without going through it towards the camera surrounding area 520. For example, the protective cover 110 may cause such a portion of the output light flow to reflect therewithin multiple times causing propagation thereof to the camera lens of the camera sensor 404. Such a portion of the output light flow is referred to herein as a stray portion 506, and, as it can further be appreciated from Figure 5, it could be incident on the camera lens of the camera sensor 404 imposing malicious noise on the image data, which is also referred to herein as “milky glare effect”, further resulting in lower quality of the image data, such as lower clarity of images.
[0087] Thus, certain non-limiting embodiments of the present technology are directed to minimizing the milky glare effect imposed by the stray portion 506 of the output light flow, thereby improving quality of the image data generated by the camera sensor 404. More specifically, the developers of the present technology have appreciated that positioning the at least one light source 402 at a certain distance from the protective cover 110, such as a first distance 508, may allow reducing a radiation angle of the at least one light source 402, thereby reducing divergence of the output light, which may further help to reduce the stray portion 506 incident on the camera lens of the camera sensor 404. For example, the first distance 508 may be determined such that the at least one light source 402 is depressed within the light source aperture 406. In other words, an edge of the light source aperture 406 may be used as an optical diaphragm for the output light flow generated by the at least one light source 402 configured to reduce divergence thereof, thereby minimizing the stray portion 506.
[0088] Thus, for example, in some non-limiting embodiments of the present technology, the first distance 508 may be determined (for example, empirically) based on a trade-off between minimizing the stray portion 506 and an overall intensity of the output light flow emitted by the at least one light source 402 necessary for generating, by the camera sensor 404, the image data of a desired quality level.
[0089] In other non-limiting embodiments of the present technology, the first distance 508 can be determined to be maximum possible such that the radiation angle of the at least one light source 402 corresponds to the field of view of the camera lens of the camera sensor 404. In other words, the first distance 508 can be determined to be a maximum possible distance at which the at least one light source 402 and the camera sensor 404 are configured to capture substantially a same portion of the camera surrounding area 520.
[0090] With reference to Figure 6, in accordance with some non-limiting embodiments of the present technology, further to the light source aperture 406, the recess 410 of the top assembly 106, for receiving the at least one light source 402, may define a light source groove 602 extending therefrom inwardly in the camera device housing 108. In some non-limiting embodiments of the present technology, a depth of the light source groove 602 can be determined such that the at least one light source 402 is positioned from the protective cover 110 at the first distance 508, as described above. As it can be appreciated, in these embodiments, the overall intensity of the output light flow emitted by the at least one light source 402 towards the camera surrounding area 520 may thus be increased while the stray portion 506 can still be minimized as being “cut off’ by the light source aperture 406, thereby improving the resulting quality of the image data generated by the camera sensor 404.
[0091] Further, with back reference to Figure 5 and with reference to Figure 7, in some nonlimiting embodiments of the present technology, for each one of the light source aperture 406 and the camera lens aperture 408, the recess 410 may further define a respective baffle. More specifically, according to certain non-limiting embodiments of the present technology, the recess 410 may define: (i) a light source baffle 702 protruding outwardly from the light source aperture 406; and (ii) a camera lens baffle 704 protruding outwardly from the camera lens aperture 408. Thus, the light source baffle 702 can allow for additional reduction of the radiation angle of the at least one light source 402, thereby additionally reducing the stray portion 506 reflected inside the protective cover 110. Further, the camera lens baffle 704 can be configured to block at least a portion of the stray portion 506 from incidence thereof on the camera sensor 404. Therefore, in some non-limiting embodiments of the present technology, each one of the light source baffle 702 and the camera lens baffle 704 may allow for additional improvement of the quality of the image data generated by the camera sensor 404.
[0092] It should be noted that a configuration, a form factor, and a size of a given one of the light source baffle 702 and the camera lens baffle 704 are not limited, and can also be determined based on the trade-off between the minimizing the stray portion 506 and the effects thereof on the image data, and the overall intensity of output light flow generated by the at least one light source 402 and directed to the camera surrounding area 520 necessary for generating, by the camera sensor 404, the image data of the desired quality level.
[0093] Further, in specific non-limiting embodiments of the present technology, each one of the light source baffle 702 and the camera lens baffle 704 can be defined to extend from the recess 410 to the protective cover 110, that is, without any gap therebetween, as schematically depicted in Figure 5.
[0094] Further, although in the embodiments depicted in Figure 7 each of the light source baffle 702 and the camera lens baffle 704 is defined as entirely surrounding a respective one of the at least one light source 402 and the camera sensor 404, it should be noted that in other nonlimiting embodiments of the present technology, each one of the light source baffle 702 and the camera lens baffle 704 can be defined partially around the respective one the at least one light source 402 and the camera sensor 404 - such as at respective sides of the light source aperture 406 and the camera lens aperture 408 facing each other within the recess 410.
[0095] Further, in some non-limiting embodiments of the present technology, in addition to reducing the stray portion 506, the top assembly 106 can be configured to attenuate an intensity thereof within the protective cover 110 as the stray portion 506 travels towards the camera sensor 404, thereby minimizing the negative effects of the stray portion 506 on the image data generated by the camera sensor 404. Thus, referring back to Figure 5, as noted hereinabove, in some non-limiting embodiments of the present technology, the light source aperture 406 and the camera lens aperture 408 can be defined within the recess 410 at the given distance therebetween, such as a second distance 512. Thus, according to certain non-limiting embodiments of the present technology, the second distance 512 can be determined, within the recess 410, such that to additionally minimize incidence of the stray portion 506 of the output light flow on the camera lens of the camera sensor 404. For example, the second distance 512 can be predetermined to be a maximum possible distance available within dimensions of the recess 410 to allow the stray portion 506 to travel, within the protective cover 110, a maximum possible straight travel distance to the camera sensor 404. By so doing, the top assembly 106 can be configured to cause the stray portion 506 to weaken as it is travelling within the protective cover 110.
[0096] Additionally, for further attenuation of the stray portion inside the protective cover 110, in some non-limiting embodiments of the present technology, an inner surface of the protective cover 110, facing the recess 410, can be treated with a specific light-absorbing coating. With reference to Figure 8, there is depicted a schematic diagram of an inner surface 802 of the protective cover 110 being applied with a light-absorbing coating 804, in accordance with certain non-limiting embodiments of the present technology.
[0097] As it can be appreciated, in some non-limiting embodiments of the present technology, the light-absorbing coating 804 may be applied to the inner surface 802 in its entirety leaving windows for each one of the at least one light source 402 and the camera sensor 404. In other words, the light-absorbing coating 804 may be applied to the inner surface 802 excluding portions thereof intersecting the outbound light path 502 and the inbound light path 504. Thus, the light-absorbing coating 804 so applied on the inner surface 802 of the protective cover 110 may absorb at least a portion of the stray portion 506, thereby causing additional attenuation thereto as the stray portion 506 travels within the protective cover 110 to the camera lens of the camera sensor 404.
[0098] It should be expressly understood that it is not limited how the light-absorbing coating 804 is implemented; and in some non-limiting embodiments of the present technology, the light-absorbing coating 804 can be, without limitation, at least one of a light-absorbing paste, a light-absorbing film, and a light-absorbing foil, as an example.
[0099] In a specific non-limiting example, the light-absorbing coating 804 can be implemented as the light-absorbing film of a type available from ACKTAR LTD. of 19 Topaz St. P.O.B. 8643 Kiryat-Gat, 8213513, Israel. It should be expressly understood that the light-absorbing coating 804 can be implemented in any other suitable material.
[00100] In additional non-limiting embodiments of the present technology, for yet further attenuation of the stray portion 506 reflected inside the protective cover 110, a thickness thereof can be modulated. For example, the thickness of the protective cover 110 can be minimized to impede propagation of the stray portion 506 within the protective cover 110. In this regard, the thickness of the protective cover 110 may, for example, be determined based on a trade-off between a fragility of the protective cover 110 and its capacity to attenuate the stray portion 506 therewithin.
[00101] Thus, to summarize the above, according to some non-limiting embodiments of the present technology, during the operation of the camera device 100, the processor may be configured to: (1) cause the at least one light source 402 to emit the output light flow towards the camera surrounding area 520 for detecting one or more objects therein, such as the object 510; and (2) cause the camera sensor 404 to generate the image data in response to receiving, through the camera lens, the reflected light flow from the camera surrounding area 520. The resulting quality of the image data of the object 510 can be improved, according to certain nonlimiting embodiments of the present technology, at least by installing the at least one light source 402 at the first distance 508 from the protective cover 110, as described above, to minimize the stray portion 506 incident on the camera lens of the camera sensor 404.
[00102] Further, the processor of the camera device 100 can be configured to analyze the received image data to determine therein presence of indications of the safety event associated with at least one of the vehicle and the driver. To that end, according to some non-limiting embodiments of the present technology, the processor may be configured to have access to and execute one or more computer vision algorithms. By way of example, the processor may be configured to execute an image classification computer vision algorithm, an object detection computer vision algorithm, an object tracking computer vision algorithm, a semantic segmentation computer vision algorithm, and the like. Other computer vision algorithms may also be used by the processor for processing image data without departing from the scope of the present technology.
[00103] Thus, as previously mentioned, the camera device 100 may be directed towards the driver of the vehicle (both not depicted) resulting in that the image data may be representative of certain facial features of the driver. Thus, according to certain non-limiting embodiments of the present technology, the processor may be configured to analyze the main image data for detecting one or more indications of a current physical condition of the driver, which may cause the safety event. As an example, the processor may be configured to determine that driver’s eyes have been closed or squinting for a predetermined period, which may be indicative of the driver being one of fatigued or sleepy. In another example, the processor may be configured to determine that pupils of the driver’s eyes have been dilated wider than normal for a predetermined period, which may be indicative of the driver being intoxicated - drunk, for example.
[00104] In other non-limiting embodiments of the present technology, the camera device 100 may be directed towards the outside of the vehicle, and the image data may be representative of the vehicle surrounding area. To that end, the processor may be configured to determine that the driver is about to drive through an intersection on a red light. In another example, the processor may be configured to determine that the driver systemically crosses stop lines at traffic lights or does not keep distance from another vehicle driving ahead.
[00105] In yet other non-limiting embodiments of the present technology, the camera device 100 may comprise a secondary camera device (not depicted) communicatively couplable to the processor of the camera device 100 (for example, via an auxiliary device port 116). The secondary camera device may include a secondary image sensor and a secondary camera lens, both implemented, for example, similarly to the camera sensor 404 and the camera lens thereof, respectively.
[00106] In some non-limiting embodiments of the present technology, the secondary camera device may be a non-smart camera device. In the context of the present technology, the term “non-smart camera device” denotes a camera device that includes an image sensor and a respective optical assembly for generating image data; however, does not include a separate processor for independent control thereof. In other words, the non-smart camera device does not have a separate (dedicated) processor that is configured, for example, to cause the image sensor to generate respective image data and for further processing and analyzing thereof. To that end, to provide control to the secondary camera device, an external processor (for example, the processor of the camera device 100) is required, to which the non-smart camera device may be coupled, for example, via a respective wire connection. In these embodiments, the processor of the camera device 100 may be configured to execute one or more methods for determining the presence of the safety event described in a co-owned Russian Patent Application No.: 2020124423 filed on July 23, 2020 and entitled “CAMERA DEVICE,” content of which is incorporated herein by reference in its entirety.
[00107] Thus, in some non-limiting embodiments of the present technology, the secondary camera device can also be mounted on a support surface, for example, on the one or another of inner surfaces of the vehicle. Thus, in some non-limiting embodiments of the present technology, the secondary camera device (not depicted) can also be for monitoring indications of the safety event associated with the vehicle. For example, in those embodiments where the camera device 100 is for monitoring activity associated with the driver, the secondary camera device can be directed to the outside of the vehicle to monitor the vehicle surrounding area to determine presence of the safety event therein, and vice versa.
[00108] In yet another example, the secondary camera device can be directed towards a passenger of the vehicle. To that end, secondary image data generated by the secondary camera device may be representative of an activity associated with the passenger. Thus, for example, based on current facial features of the passenger, the processor can be configured to determine his or her current physical condition, such as a condition associated with drunkenness or excessive agitation, as an example. In another example, based on the secondary image data representative of the activity associated with the passenger, the processor can be configured to determine that the passenger is being too emotional and/or located too close to the driver posing danger thereto.
[00109] Further, in some non-limiting embodiments of the present technology, having detected, based on the received image data, the safety event, the processor of the camera device 100 can be configured to generate an alert notification, as will be described below with regard to components of the camera device housing 108.
Camera Device Housing
[00110] Broadly speaking, according to certain non-limiting embodiments of the present technology, the camera device housing 108 may be configured to (1) receive the image data representative of the camera surrounding area 520; (2) analyze the image data for detecting therein indications of the safety event; and (3) in response to analyzing rendering a result indicative of the safety event, generate the alert notification.
[00111] With reference to Figures 1 and 3, as noted above, the plurality of sidewalls 109 of the camera device housing 108 may define the auxiliary device port 116 communicatively coupled to the processor, whereby the processor is configured to connect to an external device corresponding to an interface of the auxiliary device port 116.
[00112] The implementation of the auxiliary device port 116 generally depends on a specific implementation of the external device to be connected to the processor therethrough. By way of example, in those embodiments of the present technology where the external device is the secondary camera device, the auxiliary device port 116 may be implemented as a micro coaxial connector (MCX) configured for receiving the secondary image data from the secondary camera device of up to 1080p and 30 frames per second, as an example. [00113] With reference to Figures 10 and 11, in accordance with certain non-limiting embodiments of the present technology, two opposite ones of the plurality of sidewalls 109 may define a respective one of a first microphone aperture 120 and a second microphone aperture 420 for receiving therein microphones. For example, a given one of the first microphone aperture 120 and the second microphone aperture 420 can be of a circular form.
[00114] It should be noted that positioning of the first microphone aperture 120 and the second microphone aperture 420, in respective ones of the plurality of sidewalls 109, is not limited - it can be also placed towards the top assembly 106 of the camera device 100, and centered horizontally along the respective one of the two opposite ones of the plurality of sidewalls 109, as an example and as depicted in a specific non-limiting embodiment thereof.
[00115] Accordingly, in these embodiments, the camera device 100 may further include at least two microphones (not depicted) respectively receivable, within the camera device housing 108, by the first microphone aperture 120 and the second microphone aperture 420 and communicatively coupled to the processor.
[00116] Thus, in some non-limiting embodiments of the present technology, the processor may be configured to (1) receive, from at least one microphone of the camera device 100, audio data representative of the camera surrounding area 520; and (2) analyze the audio data received from the at least one microphone to determine presence therein additional indications of the safety event in the camera surrounding area 520. For example, the audio data may be indicative of spoken utterances of one of the driver and the passenger of the vehicle.
[00117] For example, in some non-limiting embodiments of the present technology, the processor may be configured to analyze the audio data for peaks (or valleys) in power thereof, which may be indicative, for example, of one of the driver and the passenger being emotional. In another example, the processor may be configured to determine that it is unusually quiet in the vehicle, which may be indicative of the driver having fallen asleep or having a lifethreatening condition - such as heart attack, as an example.
[00118] As previously mentioned, having detected the indications of the safety event, the processor may be further configured to generate the alert notification. According to the nonlimiting embodiments of the present technology, the alert notification may be at least one of a visual alert notification and an audial alert notification. [00119] Thus, with reference to Figures 3, 10, and 11, two opposite ones of the plurality of sidewalls 109 may respectively define a first light aperture 118 and a second light aperture 418, in accordance with certain non-limiting embodiments of the present technology.
[00120] In certain non-limiting embodiments of the present technology, a given one of the first light aperture 118 and the second light aperture 418 may be of a rectangular form, vertically elongated along a respective one of the two opposite ones of the plurality of sidewalls 109. Further, the given one of the first light aperture 118 and the second light aperture 418 may be horizontally centered along the respective one of the two opposite ones of the plurality of sidewalls 109, as it is defined in the depicted embodiments of the present technology.
[00121] In those non-limiting embodiments of the present technology where the two opposite ones of the plurality of sidewalls 109 define both the first microphone aperture 120 and the second microphone aperture 420, and the first light aperture 118 and the second light aperture 418, the first light aperture 118 and the second light aperture 418 may be located lower than the first microphone aperture 120 and the second microphone aperture 420, respectively. However, in other non-limiting embodiments of the present technology, the location of the given one of the first light aperture 118 and the second light aperture 418 is not limited within the plurality of sidewalls 109.
[00122] Thus, the camera device 100 may further comprise at least two light sources, such as a first light source 320 and a second light source 322, communicatively coupled to the processor of the camera device 100 and receivable by the first light aperture 118 and the second light aperture 418. Each of the first light source 320 and the second light source 322 may be mounted within the camera device housing 108 using an associated plurality of mounting holes 324.
[00123] According to certain non-limiting embodiments, having detected the indications of the safety event, the processor may be configured to generate the visual alert notification by powering on at least one of the first light source 320 and the second light source 322, thereby drawing driver’s attention. A manner in which the processor may be configured to power on the at least one of the first light source 320 and the second light source 322 is not limited and may comprise, for example, causing the at least one light source to fade-in, fade-out, blink, and the like. Other modes of operating the first light source 320 and the second light source 322 can also be used without departing from the scope of the present technology. [00124] In certain non-limiting embodiments of the present technology, each of the first light source 320 and the second light source 322 may comprise a plurality of LEDs corresponding to various colors of emitted light, such as red, green, and blue, for example.
[00125] In specific non-limiting embodiments of the present technology, each of the first light source 320 and the second light source 322 may be implemented as a LED of a type available from KINGBRIGHT COMPANY, LLC of 225 Brea Canyon Road, City of Industry, CA 91789, USA. It should be expressly understood that the primary image sensor can be implemented in any other suitable equipment.
[00126] Now, with reference to Figures 1 and 8, one or more of the plurality of sidewalls 109 of the camera device housing 108 may further define a speaker grid 114, in accordance with certain non-limiting embodiments of the present technology.
[00127] According to certain non-limiting embodiments of the present technology, the speaker grid 114 may be defined as a plurality of orifices further defining a rectangular form (however, other form factors are also envisioned). Further, the speaker grid 1 14 may be horizontally centered on a respective one of the plurality of sidewalls 109.
[00128] Further, according to some non-limiting embodiments of the present technology, the camera device 100 may further include a speaker (not depicted) communicatively coupled to the processor of the camera device 100 and received within the camera device housing 108. Accordingly, the speaker grid 114 may be configured to output audio signal generated by the speaker.
[00129] Thus, in some non-limiting embodiments of the present technology, having detected the indications of the safety event, the processor may be configured generate the audial alert notification by causing the speaker to reproduce a predetermined audio feed, thereby drawing the driver’s attention.
[00130] Further, according to some non-limiting embodiments of the present technology, having generated the alert notification, the processor may further be configured to record data indicative of the safety event for a predetermined period (such as from several seconds to several minutes, for example). To that end, the processor may be configured to use, for example, the camera sensor 404 as well as at least one microphone. Thus, having detected the indications of the safety event, the processor may be configured to record, for the predetermined period, data indicative of at least one of the driver, the passenger, and the vehicle surrounding area. By doing so, the processor may be configured to generate a data packet including data indicative of the safety event. Further, in some non-limiting embodiments of the present technology, the processor can be configured to execute at least one of (1) storing the data packet in its local and/or external memory; (2) transmitting the data packet to one or more external electronic devices, such as a smartphone, a tablet, a laptop, and the like; and (3) streaming the data packet to a remote server, in accordance with various embodiments of the present technology.
[00131] With reference to Figures 2, 3, and 9, one or more of the plurality of sidewalls 109 may further define a card slot aperture 204, in accordance with certain non-limiting embodiments of the present technology. In the depicted embodiments, the card slot aperture 204 is of substantially rectangular form, horizontally elongated, and centered along a respective one of the plurality of sidewalls 109. However, it should be expressly understood that shapes of the card slot aperture 204 may vary depending on specific card slots received therein, and as such, other form factors of the card slot aperture 204 may be envisioned without departing from the scope of the present technology.
[00132] According to certain non-limiting embodiments of the present technology, the card slot aperture 204 may be configured to receive a removable non-volatile card slot 326, which may further be communicatively coupled to the processor of the camera device 100. To that end, the removable non-volatile card slot 326 may be configured to receive a removable nonvolatile card insertable therein, using which the processor of the camera device 100 may be configured to store the data packet including the data indicative of the safety event. A nonlimiting example of the removable non-volatile card may be implemented as a Secure Digital™ (SD™) card; however, other formats of removable non-volatile cards may be used by the processor to store the data packet without departing from the scope of the present technology.
[00133] Further, according to certain non-limiting embodiments of the present technology, the camera device 100 may further include a SIM card slot (not depicted) communicatively coupled to the processor, which the card slot aperture 204 may be configured to receive. According to some non-limiting embodiments of the present technology, the card slot aperture 204 may be configured to receive both the removable non-volatile card slot 326 and the SIM card slot. [00134] Further, the SIM card slot may thus be configured to receive a SIM card insertable therein, which may further be configured to provide a network connection (enabling an LTE connection, for example) to the camera device 100. Finally, in some non-limiting embodiments of the present technology, the processor may be configured to use the so provided network connection to stream the data indicative of the safety event to the remote server, as mentioned above. In other non-limiting embodiments of the present technology, by using the so provided network connection, the processor may be configured to transmit the data packet to a given external electronic device. In some non-limiting embodiments of the present technology, the given external electronic device can be associated with the operator of the camera device 100. However, in other non-limiting embodiments of the present technology, the given external electronic device may be associated with an entity, to which the operator of the camera device 100 reports to, as an example.
[00135] With continued reference to Figures 2, 3, and 9, the camera device 100 may further comprise a functional button 202, in accordance with certain non-limiting embodiments of the present technology. To that end, the plurality of sidewalls 109 may define a functional button aperture 206 configured for receiving the functional button 202.
[00136] According to some non-limiting embodiments of the present technology, the functional button aperture 206 may be substantially of a rectangular shape horizontally elongated along in a respective one of the plurality of sidewalls 109. Further, the functional button aperture 206 may be defined to be horizontally centered along the respective one of the plurality of sidewalls 109. In those non-limiting embodiments of the present technology where the card slot aperture 204 and the functional button aperture 206 are defined in a same one of the plurality of sidewalls 109, the functional button aperture 206 may be located above the card slot aperture 204, where both may be horizontally aligned relative to each other.
[00137] The functional button 202 may be mounted within the camera device housing 108 in the functional button aperture 206 by use of an associated mounting assembly 328. Further, the functional button 202 may be communicatively coupled to the processor of the camera device 100, whereby the functional button 202 can be implemented as a programmable (or otherwise software-defined) button. In this regard, the functional button 202 may be configured to trigger several actions in response to specifically predetermined patterns of pressing thereof, such as long strokes, short strokes, and certain combinations thereof. [00138] Thus, in certain non-limiting embodiments of the present technology, via providing to the processor of the camera device 100 respective instructions, the functional button 202 may be configured to cause execution, without limitation, of at least one of: (1) turning on and turning off the camera device 100; (2) resetting configuration of the processor of the camera device 100; (3) actions with respect to the removable non-volatile card (such as formatting thereof, for example); and (4) initiating a wireless connection (such as Wi-Fi or Bluetooth connection, for example) with the given external electronic device. Other actions that can be assigned for execution by using the functional button 202 are also envisioned without departing from the scope of the present technology.
[00139] Thus, using the functional button 202, the processor of the camera device 100 may be caused to establish the wireless connection with the given external electronic device to transmit thereto the data packet including the data indicative of the safety event.
[00140] Further, with reference to Figure 12, according to certain non-limiting embodiments of the present technology, the protective cover 110 of the top assembly 106 may define a wireless interface port 1302 communicatively coupled to the processor of the camera device 100. In these embodiments, the wireless interface port 1302 may be associated with a local wireless interface and may hence be configured to provide a local wireless connection between the processor and the given external electronic device.
[00141] In some non-limiting embodiments of the present technology, the local wireless interface provided by the wireless interface port 1302 may be in a form of a machine-readable optical label, such as one of a bar code and a Quick Response (QR) code (both not depicted) associated with the camera device 100. Thus, in these embodiments the local wireless connection may be initiated by the given external electronic device scanning, using suitable software, a respective one of the bar code and the QR code.
[00142] In other non-limiting embodiments of the present technology, the wireless interface port 1302 may be implemented as a Near Field Communication (NFC) tag associated with the camera device 100. To that end, the local wireless connection between the processor and the given electronic device may be established by placing the given external electronic device within a predetermined distance from the NFC tag (and thus, from the camera device 100).
[00143] It should be noted that positioning the wireless interface port 1302 within the camera device 100 is not limited, and in other non-limiting embodiments of the present technology, the wireless interface port 1302 may also be defined in one of the plurality of sidewalls 109, as an example.
[00144] Thus, via the so established local wireless connection, the processor of the camera device 100 may be configured to transmit the data packet to the given external electronic device, according to certain non-limiting embodiments of the present technology.
Mount Assembly
[00145] According to the non-limiting embodiments of the present technology, the mount assembly 104 may be configured for (1) mounting the camera device 100 on the support surface and (2) adjusting an angular position of the top assembly 106 relative to the support surface.
[00146] With reference to Figures 2, 3, and 8, the mount assembly 104 may include a first linking element 122, according to certain non-limiting embodiments of the present technology. The first linking element 122 may be configured to be received into and secured to the cone- shaped protrusion 208 of the bottom portion 209 of the camera device housing 108. By so doing, the first linking element 122 may be configured to interconnect the body portion 102 and the mount assembly 104.
[00147] According to certain non-limiting embodiments of the present technology, the first linking element 122 may be coupled to the bottom portion 209 of the camera device housing 108 using a plurality of cylindrical protrusions 330. In these embodiments, each or at least some of the plurality of cylindrical protrusions 330 may further define a respective screw hole.
[00148] Further, with continued reference to Figures 2, 3, and 8, according to certain nonlimiting embodiments of the present technology, the mount assembly 104 may further include a second linking element 124. The second linking element 124 may further include a mount base plate 332 and a base protrusion 334 extending upwardly therefrom. In certain non-limiting embodiments of the present technology, the second linking element 124 may define a hollow inside thereof (not separately numbered) configured to receive therein additional structural elements of the mount assembly 104, as will be described below.
[00149] Further, the second linking element 124 may include an adhesive disk 212 attached to the mount base plate 332 for coupling the mount assembly 104 to the support surface. It should be noted that in other non-limiting embodiments of the present technology, this coupling can be executed by means of a suction cup, for example. In alternative non-limiting embodiments of the present technology, the mount base plate 332 of the second linking element 124 may be configured to provide other ways of mounting the camera device 100 onto the support surface, such as a screw mounting, and the like.
[00150] According to certain non-limiting embodiments of the present technology, the first linking element 122 and the second linking element 124 may be interconnected therebetween by a pivotal connection (not separately numbered). With reference to Figures 3 and 10, the base protrusion 334 of the second linking element 124 may define a pivot hole 336 for receiving a pivot screw 338 providing the pivotal connection between the first linking element 122 and the second linking element 124. Thus, the first linking element 122 may change an angular position thereof relative to the second linking element 124 by rotating around the pivot screw 338.
[00151] With reference to Figures 1 and 3, according to the non-limiting embodiments of the present technology, the mount assembly 104 may further include a fixation mechanism 340 for selectively changing the angular position of the first linking element 122 relative to the second linking element 124. As it can be appreciated, the fixation mechanism 340 may be received in the hollow inside of the second linking element 124, and may further include an internal base plate 342 and a locking protrusion 346 extending upwardly therefrom.
[00152] The internal base plate 342 may include a plurality of base screw holes 344 for attaching the fixation mechanism 340 to the hollow inside of the second linking element 124. Further, according to certain non-limiting embodiments of the present technology, the internal base plate 342 may define at least one slide guide 354 protruding upwardly therefrom and allowing the locking protrusion 346 slide on the internal base plate 342.
[00153] In some non-limiting embodiments of the present technology, the locking protrusion 346 may include a pinion mechanism 348 receivable by the hollow inside of the second linking element 124 (for example, in a similar pinion mechanism defined therein), thereby defining a plurality of angular positions of the first linking element 122 relative to the second linking element 124. For example, in some non-limiting embodiments of the present technology, the selective changing among the plurality of angular positions of the first linking element 122 relative to the second linking element 124 may be executed by causing the locking protrusion 346 to slide on the internal base plate 342, thereby allowing free rotation of the first linking element 122 relative to the second linking element 124. Further, securing the first linking element 122 in a selected one of the plurality of angular position thereof relative to the n second linking element 124 may be executed by causing the locking protrusion 346 to displace back to its initial state where the pinion mechanism 348 thereof is coupled with the similar pinion mechanism of the hollow inside of the second linking element 124.
[00154] To that end, in some non-limiting embodiments of the present technology, the mount assembly 104 ma further include a push button 126, a push spring 352 received in a push button aperture 350, thereby allowing causing the locking protrusion 346 to slide on the internal base plate 342 and return to its initial state. To summarize, according to certain non-limiting embodiments of the present technology, pushing the push button 126 causes compression of the push spring 352, which, in turn, may cause the locking mechanism 349 to slide, in the at least one slide guide 354, along the internal base plate 342, thereby unlocking the pinion mechanism 348 and allowing the first linking element 122 to freely rotate relative to the second linking element 124 for selecting the given one of the plurality of angular positions. Further, by releasing the push button 126, the pinion mechanism 348 locks securing the first linking element 122 in the selected one of the plurality of angular positions relative to the second linking element 124.
[00155] By doing so, the operator of the camera device 100 may change the angular position of the top assembly 106 (and thus that of the camera lens o the camera sensor 404) relative to the support surface, onto which the camera device 100 has been mounted, thereby defining the camera surrounding area 520 associated therewith. For example, the operator of the camera device 100 may adjust the angular position of the top assembly 106 for better capturing certain features of the driver.
[00156] Modifications and improvements to the above-described implementations of the present technology may become apparent to those skilled in the art. The foregoing description is intended to be exemplary rather than limiting. The scope of the present technology is therefore intended to be limited solely by the scope of the appended claims.

Claims

CLAIMS What is claimed is:
1. A camera device comprising: a camera device housing having a plurality of walls, the camera device housing including: at least one light source configured to emit output light outwardly from the camera device housing along an outbound light path, the at least one light source being received in a light source aperture of the camera device housing; a camera sensor configured to sense light reflected off a surrounding area of the camera device along an inbound light path, the camera sensor including a lens received in a lens aperture of the camera device housing and facing outwardly therefrom, the light source aperture and the lens aperture being defined in a given one of the plurality of walls of the camera device housing; and a protective cover disposed in the outbound light path and the inbound light path, the protective cover causing inner reflection of a stray portion of the output light within the protective cover such that the stray portion does not pass through the protective cover and is incident onto the lens of the camera sensor; and the at least one light source being depressed within the light source aperture at a first distance from the protective cover such that to minimize the stray portion of the output light, thereby preventing incidence thereof on the lens of the camera sensor. . The camera device of claim 1 , wherein the given one of the plurality of walls of the camera device housing further defines a respective baffle protruding from each one of the light source aperture and the lens aperture for further minimizing the stray portion of the output light. . The camera device of claim 1, wherein the respective baffle extends from the given one of the plurality of walls to the protective cover of the camera device.
- 34 - The camera device of claim 1 , wherein: the at least one light source comprises a plurality of light sources; and the light source aperture is configured for receiving each one of the plurality of light sources. The camera device of claim 4, wherein the plurality of light sources is arranged in a line thereof, and the light source aperture is elongated, within the top assembly, for receiving the line of the light sources. The camera device of claim 1 , wherein the light source aperture is spaced, within the given one of the plurality of walls of the camera device housing, at a second distance from the lens aperture. The camera device of claim 6, wherein the second distance has been determined as being a maximum possible distance within dimensions of the given one of the plurality of walls of the camera device housing for attenuating the stray portion of the output light reflected within the protective cover without passing therethrough. The camera device of claim 1 , wherein a portion of an inner surface of the protective cover, has been treated with a light-absorbing coating for further attenuating the stray portion reflected within the protective cover, the portion excluding a surface intersecting the inbound light path and the outbound light path. The camera device of claim 1, wherein the first distance has been determined to minimize a radiation angle of the at least one light source. The camera device of claim 1 , wherein the first distance has been determined as a maximum possible distance such that a radiation angle of the at least one light source corresponds to a field of view of the camera sensor. The camera device of claim 1 , wherein, for receiving the at least one light source, the given one of the plurality of walls further defines a groove protruding inwardly in the camera device housing from the light source aperture, the groove having a depth having been determined based at least on the first distance. The camera device of claim 1, wherein the at least one light source is an infrared light emitting diode.
- 35 - The camera device of claim 1, wherein the protective cover comprises a light filter configured for passing the output light emitted by the at least one light source. The camera device of claim 13, wherein the light filter is for obfuscating the output light emitted by the at least one light source. The camera device of claim 1, further comprising a mount assembly connected to an other one of the plurality of walls of the camera device housing for mounting the camera device onto a surface. The camera device of claim 15, wherein the surface is a part of a vehicle, and wherein the camera sensor is for monitoring an activity associated with a driver of the vehicle.
PCT/RU2021/000397 2021-09-16 2021-09-16 Camera device WO2023043327A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/RU2021/000397 WO2023043327A1 (en) 2021-09-16 2021-09-16 Camera device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/RU2021/000397 WO2023043327A1 (en) 2021-09-16 2021-09-16 Camera device

Publications (1)

Publication Number Publication Date
WO2023043327A1 true WO2023043327A1 (en) 2023-03-23

Family

ID=85603325

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RU2021/000397 WO2023043327A1 (en) 2021-09-16 2021-09-16 Camera device

Country Status (1)

Country Link
WO (1) WO2023043327A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017085326A (en) * 2015-10-27 2017-05-18 パナソニックIpマネジメント株式会社 Camera device
US20190011106A1 (en) * 2017-07-10 2019-01-10 Lg Electronics Inc. Lamp for vehicle and vehicle
US20190149703A1 (en) * 2017-11-16 2019-05-16 Aptiv Technologies Limited Eye tracking device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017085326A (en) * 2015-10-27 2017-05-18 パナソニックIpマネジメント株式会社 Camera device
US20190011106A1 (en) * 2017-07-10 2019-01-10 Lg Electronics Inc. Lamp for vehicle and vehicle
US20190149703A1 (en) * 2017-11-16 2019-05-16 Aptiv Technologies Limited Eye tracking device

Similar Documents

Publication Publication Date Title
EP3018560B1 (en) Integrated overhead console assembly for vehicle
JP4566929B2 (en) Imaging device
US10082664B2 (en) Tracking optics for a mobile device
EP1701290B1 (en) Image capturing apparatus for vehicle driver
US20030156741A1 (en) Iris recognition system
WO2008142697A2 (en) Security system and method
KR20190037701A (en) Sleepiness prevention apparatus for vehicle
TWM553534U (en) Iris identification device
JPH11195082A (en) Optical information reading device
CN208789584U (en) Drive assistance device
KR20160139158A (en) Filter moving apparatus and camera module including the same
WO2023043327A1 (en) Camera device
WO2021200827A1 (en) Biological information acquisition device and biometric authentication system
CN112329493B (en) Aiming indicating device for bar code reading and bar code reading equipment
JP2006318677A (en) Irradiation equipment and night vision equipment
JP2014106635A (en) Lighting fixture system for vehicle
WO2022019802A1 (en) Camera device
KR100546821B1 (en) Lighting device of iris recognition device
US20040028262A1 (en) Optical system of fingerprint image capture apparatus
KR100876821B1 (en) Apparatus for photographing face image in picture area exactly
CN211401219U (en) Apply to mobile robot of indoor navigation
KR20050022461A (en) Indicated device of iris location for iris recognition system
US10003727B1 (en) Camera module capable of emitting a uniform light
CN203241675U (en) Infrared night-vision image pickup device
US11816528B2 (en) Slot scanner assembly with wakeup system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21957647

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE