CN216437338U

CN216437338U - Camera assembly and display device

Info

Publication number: CN216437338U
Application number: CN202122995074.1U
Authority: CN
Inventors: 韩忠峰; 徐淑敏; 刘玉洁
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-11-30
Filing date: 2021-11-30
Publication date: 2022-05-03
Anticipated expiration: 2031-11-30

Abstract

The embodiment of the application provides a camera assembly and a display device, wherein the camera assembly comprises a support, a camera and a pitch angle detection sensor; wherein, the bracket is arranged on the display device; the camera is arranged on the bracket; the pitch angle detection sensor is fixed on the bracket or positioned in the camera, and the relative position of the pitch angle detection sensor and the camera is fixed; the camera comprises a processor and an image sensor; and the pitch angle detection sensor and the image sensor are both connected with the processor. The pitch angle detection sensor can be used for detecting the change value of the pitch angle of the camera and sending the change value to the processor; the processor can determine an effective imaging area of the image sensor according to the change value of the pitching angle of the camera, and sends image data acquired in the effective imaging area to the display equipment for displaying, so that a frame containing the display equipment in an image shot by the camera can be avoided, the shooting effect of the camera is effectively guaranteed, and the universality of the camera among different display equipment is improved.

Description

Camera assembly and display device

Technical Field

The embodiment of the application relates to the technical field of cameras, in particular to a camera assembly and a display device.

Background

With the rapid development of the intellectualization of the television, the television has been developed into an intelligent display device integrating images, sounds and various sensors. For example, functions such as motion recognition and video call can be realized through a television camera.

At present, when a user purchases a television, the user can select and purchase a camera matched with the television and also can select other types of cameras to install. Because there is the difference between the different TV products to and between the different camera products, consequently, after different cameras were installed on same section TV, the distance difference between camera and the TV frame can be bigger, and some cameras can normally shoot, and some cameras then can shoot the frame of TV, influence the camera and shoot the effect, have greatly restricted the commonality of camera between different TV products.

SUMMERY OF THE UTILITY MODEL

The embodiment of the application provides a camera assembly and display equipment, and can solve the technical problem that the universality of the existing camera between different display equipment is poor.

In some embodiments, the present application provides a camera assembly comprising a bracket, a camera, and a pitch angle detection sensor;

the bracket is arranged on the display equipment; the camera is arranged on the bracket; the pitch angle detection sensor is fixed on the bracket or positioned in the camera, and the relative position of the pitch angle detection sensor and the camera is fixed;

the camera comprises a processor and an image sensor; the pitch angle detection sensor and the image sensor are both connected with the processor; the processor is provided with a first data interface, and the first data interface is connected with the display equipment;

the pitch angle detection sensor is used for detecting a pitch angle change value of the camera and sending the pitch angle change value of the camera to the processor;

the processor is used for determining an effective imaging area of the image sensor according to the pitching angle change value of the camera, and sending image data collected in the effective imaging area to the display equipment through the first data interface for displaying.

In one possible embodiment, the pitch angle detection sensor is an acceleration sensor.

In one possible embodiment, the camera includes a first circuit board, and when the acceleration sensor is located in the camera, the acceleration sensor and the image sensor are both disposed on the first circuit board.

In a possible implementation, the camera includes a second circuit board therein, and the processor is disposed on the second circuit board; the first Circuit board and the second Circuit board are connected through a Flexible Printed Circuit (FPC) for short.

In a possible implementation, the Processor is an Image Signal Processor (ISP), the ISP and the acceleration sensor each include an I2C bus interface, and the I2C bus interface of the ISP is connected to the I2C bus interface of the acceleration sensor;

the acceleration sensor is used for sending the change value of the pitch angle of the camera to the ISP through the I2C bus interface.

In a possible embodiment, said ISP and said acceleration sensor each comprise an interrupt signal INT interface, said INT interface of said ISP being connected to said INT interface of said acceleration sensor;

the acceleration sensor is used for sending an interrupt signal to the ISP through the INT interface when detecting that the pitching angle value of the camera changes.

In one possible embodiment, the first data interface is a Universal Serial Bus (USB) interface; the ISP and the image sensor are both provided with Mobile Industry Processor Interfaces (MIPI), and the ISP is connected with the image sensor by using the MIPI.

In a possible implementation manner, the processor is further configured to send the change value of the pitch angle of the camera to the display device through the first data interface.

In a possible implementation manner, the system further includes a power conversion module, and the power conversion module is respectively connected to the processor, the image sensor, and the pitch angle detection sensor.

In some embodiments, the present application provides a display device comprising a display screen, a controller, and a camera assembly; the camera component is the camera component provided in the embodiment;

the display screen and the camera assembly are both connected with the controller;

the controller is used for sending a control instruction to the camera assembly, receiving image data sent by the camera assembly and sending the image data to the display screen for displaying; the control instruction is used for adjusting the pitching angle of the camera in the camera assembly.

The camera assembly provided by the embodiment of the application comprises a support, a camera and a pitch angle detection sensor; the pitch angle detection sensor can be used for detecting the change value of the pitch angle of the camera and sending the change value to the processor; the effective imaging area of image sensor can be determined according to the every single move angle change value of camera to the treater to image data with gathering in this effective imaging area sends display device to show, contains display device's frame in the image that from this can avoid the camera to shoot, effectively ensures the shooting effect of camera, promotes the commonality of camera between different display device.

Drawings

FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus in an embodiment of the present application;

fig. 2 is a side view of a usage scenario of a camera provided in an embodiment of the present application;

FIG. 3 is a schematic diagram of an image acquired by a camera under a shielding condition in the embodiment of the application;

fig. 4 is a schematic view of an angle of view when the camera is horizontally placed in the embodiment of the present application;

fig. 5 is a schematic structural diagram of a camera assembly provided in an embodiment of the present application;

fig. 6 is a schematic view of a field angle of the camera after the pitch angle is adjusted in the embodiment of the present application;

FIG. 7 is a schematic diagram of an object-image relationship of a camera in an embodiment of the present application;

fig. 8 is a schematic circuit structure diagram of a camera provided in an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus in an embodiment of the present application. As shown in fig. 1, a user may operate the display apparatus 200 through a mobile terminal 1002 or a control device 1001.

In some embodiments, the control device 1001 may be a remote controller, and the user may input a user instruction through a key on the remote controller, a voice input, a control panel input, or the like to control the display apparatus 200.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200.

The display device 200 may be a liquid crystal display, an OLED display, a laser projection host in a laser television, or the like. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

As shown in fig. 1, a camera 201 may be connected or disposed on the display device 200, and is used to present a picture taken by the camera on a display interface of the display device or other display devices, so as to implement an interactive chat between users. Specifically, the picture captured by the camera 201 may be displayed on the display device 200 in a full screen, a half screen, or any selectable area.

As an alternative connection mode, the camera 201 is connected with the rear case of the display device through a connection plate, and is fixedly installed in the middle of the upper side of the rear case of the display device 200, and as an installable mode, the camera may be fixedly installed at any position of the rear case of the display device 200. Wherein, the image acquisition area of the camera 201 is the same as the display orientation of the display device 200.

As another alternative, the camera 201 is connected to the rear case of the display device through a connection board or other conceivable connectors, which are capable of being lifted up and down, and the connector is provided with a lifting motor, and when the user wants to use the camera or has an application program to use the camera, the camera is lifted up and down above the display device 200, and when the user does not need to use the camera, the camera can be embedded in the rear case, so as to protect the camera from being damaged and protect the privacy of the user.

After the camera 201 is installed on the display device 200, the contents displayed in different application scenes of the display device 200 can be fused in various different ways, so that the functions that cannot be realized by the conventional display device are achieved.

Illustratively, a user may conduct a video chat with at least one other user while watching a video program. The presentation of the video program may be as a background frame over which a window for video chat is displayed. The function is called 'chat while watching'.

In another example, in a motion sensing game (such as a ball, a boxing game, a running game, a dancing game and the like), the posture and the motion of a human body, the detection and the tracking of limbs and the detection of key point data of human skeleton are obtained through a camera, and then the detection and the fusion with an animation in the game are carried out, so that the game of scenes such as sports, dancing and the like is realized.

In other examples, more or less functionality may be added. The function of the display device is not particularly limited in the present application.

Because there is the difference between the display device of different grade type to and between the different camera products, consequently, different cameras are installed on same section of display device back, and the distance difference between camera and the display device frame can be bigger, and some cameras can normally shoot, and some cameras then can shoot display device's frame, and the shooting effect is not good, has greatly restricted the commonality of camera between different television products.

Referring to fig. 2, fig. 2 is a side view of a usage scenario of a camera provided in an embodiment of the present application.

In fig. 2, the angle of view of the camera 201 in the vertical direction is VFOV.

In an actual application process, when the camera 201 is too close to the frame of the display device 200, or the frame of the display device 200 is thick, the upper frame of the display device 200 may block a part of the viewing angle of the camera 201, so that the bottom of the image collected by the camera 201 includes the frame of the display device 200.

Referring to fig. 3, fig. 3 is a schematic view of an image acquired by a camera under a shielding condition in the embodiment of the present application. In the case that the upper frame of the display device 200 blocks part of the viewing angle of the camera 201, after the camera 201 sends the acquired image to the display 202, an image 203 of the upper frame of the display device 200 may exist in the image displayed by the display 202, which affects the beauty of the whole image.

It can be understood that after the type selection of the camera 201 is completed, the field angle FOV of the camera 201 is fixed, and all objects within the FOV are captured by the camera.

For easy understanding, referring to fig. 4, fig. 4 is a schematic view of an angle of view when the camera is horizontally placed in the embodiment of the present application. In the embodiment of the present application, the following assumptions are made:

1) the camera 201 is placed horizontally; 2) the lens position of the camera 201 is an original point O, the vertical mapping point of the camera on the display device 200 is A, the OA height is d, the edge of the display device 200 is B, the AB length is L, and the intersection point of the vertical field angle VFOV of the camera 201 and the extension line of the AB is a point C; 3) the complementary angle of the VFOV/2 is alpha.

As can be seen from fig. 4:

the positions of points C are as follows:

if AB is less than or equal to AC, namely L is less than or equal to AC, the point B can not appear in the visual angle which can be shot by the camera, and the image shot by the camera can be normally displayed.

If AB > AC, namely L > AC, then point B will enter the field angle of the camera, and the camera will take the point B and other frames of the display device entering the field angle, resulting in the occlusion of the image taken by the camera.

In addition, due to the characteristic that the position of the camera of the display device is fixed, the pitching adjusting function of the camera can be increased generally, so that the possibility that the field angle of the camera is shielded by the frame of the display device is increased to a greater extent, and the universality of the camera among different television products is limited.

In the face of above-mentioned technical problem, in the embodiment of the application, through set up the pitch angle detection sensor on the camera, detect the pitch angle change value of camera, and according to the pitch angle change value of camera, determine the effective imaging area of camera, and send the image data who gathers in this effective imaging area to display device and show, the frame that contains display device in the image that can avoid the camera to shoot from this, effectively ensure the shooting effect of camera, the commonality of camera between different display device has been promoted.

Referring to fig. 5, fig. 5 is a schematic structural diagram of a camera assembly provided in an embodiment of the present application, and in a possible implementation manner of the present application, the camera assembly 500 includes a bracket 501, a camera 201, and a pitch angle detection sensor 502.

Wherein, the bracket 501 is mounted on the display device; the camera 201 is mounted on the bracket 501; the pitch angle detection sensor 502 is fixed to the bracket 501 or located in the camera 201, and the relative position with the camera is fixed.

In some embodiments, the camera 201 includes a processor 2011 and an image sensor; the pitch angle detection sensor 502 and the image sensor are both connected with the processor 2011; the processor 2011 is provided with a first data interface, which is connected to the display device.

In some embodiments, the pitch angle detection sensor 502 is configured to detect a pitch angle change value of the camera 201, and send the pitch angle change value of the camera 201 to the processor 2011; the processor 2011 is configured to determine an effective imaging area of the image sensor according to the change value of the pitch angle of the camera 201, and send image data acquired in the effective imaging area to the display device through the first data interface for displaying.

In some embodiments, referring to fig. 6, fig. 6 is a schematic view of a field angle of a camera head after a pitch angle is adjusted in an embodiment of the present application.

In fig. 6, within the VFOV viewing angle, an image acquisition region of the camera is defined, and the angle COB is defined as a viewing angle shielding region.

As can be seen from fig. 5:

therefore, the temperature of the molten metal is controlled,

since when the camera is placed horizontally:

therefore, when the camera rotates downwards to angle beta, the angle alpha is reduced to become angle alpha 1

Wherein, subtracting the angle AOB and the angle alpha 1 to obtain a shielding angle COB:

because the camera position is different, shelter from the angle and can have three kinds of situations: critical, shielded, no shielded; three different numerical relationships correspond:

when the angle COB is equal to 0 degrees, the edge of the camera view field is in a shielding critical position.

When the < COB is less than 0 degrees, the visual field of the camera is not shielded;

and when the & lt COB & gt is larger than 0 DEG, the camera view field is shielded.

In some embodiments, after it is determined that the camera view field is blocked, an effective imaging area of the camera image sensor can be determined based on a pitch angle change value of the camera and a blocking angle COB of the camera.

Referring to fig. 7, fig. 7 is a schematic diagram of an object-image relationship of a camera in the embodiment of the present application.

In fig. 7, XY is an object plane, the distance from the object plane to the focal center of the camera is H, O1 is the center of the main optical axis, XY is the imaging plane of the camera image sensor, the center of the main incident light is O1, and the position of the X1 point in the object plane mapped on the imaging plane is X1.

For the sake of understanding, it is assumed that X1 is the occlusion critical point, and the position thereof can be obtained by the occlusion angle ═ COB and the half-angle non-occlusion angle γ. Wherein the half-angle unshielded angle gamma is:

due to the fact that

So solving for O1X1 length is:

O1X1＝H*tanγ

the same principle is that:

therefore: X1Y ═ O1X1+ O1Y, XY ═ 2 ═ O1Y

Because the object plane and the imaging plane are in a one-to-one mapping relationship, namely: O1X1 ═ k × O1X1, where k is the mapping coefficient. Therefore, the effective imaging area on the camera image sensor is as follows:

wherein: xy is camera image sensor's imaging surface width, for fixed value w, further can obtain:

since the pixels of the camera image sensor are uniformly distributed on the surface of the camera image sensor, the corresponding pixels of x1 point are:

where Pw is the total number of pixels in the width of the camera image sensor.

In some embodiments, pixels between point x and point x1 in the camera image sensor imaging plane can be used as the effective imaging area of the camera image sensor.

According to the camera assembly provided by the embodiment of the application, the pitching angle change value of the camera can be detected by using the pitching angle detection sensor and is sent to the processor; the processor can determine an effective imaging area of the image sensor according to the change value of the pitching angle of the camera, and sends image data acquired in the effective imaging area to the display equipment for displaying, so that a frame containing the display equipment in an image shot by the camera can be avoided, the shooting effect of the camera is effectively guaranteed, and the universality of the camera among different display equipment is improved.

In some embodiments, the pitch angle detection sensor may be an acceleration sensor.

In one possible embodiment, the initial value of the acceleration sensor can be recorded as [ Ax ] when the camera is horizontally placed₀,Ay₀,Az₀]Current initial angle beta₀Comprises the following steps:

β₀x＝[arctan(Ax₀/squr(Ay₀ ²+Az₀ ²)]*180/π

β₀y＝[arctan(Ay₀/squr(Ax₀ ²+Az₀ ²)]*180/π

β₀z＝[arctan(Az₀/squr(Ax₀ ²+Ay₀ ²)]*180/π

suppose that after the camera is rotated, the acceleration sensor reads [ Ax, Ay, Az]Calculating the angle beta after rotation_x。

According to the relative relationship of the two groups of data, the rotation angle beta of the camera can be calculated_xComprises the following steps:

β_xx＝[arctan(Ax/squr(Ay²+Az²)]*180/π

β_xy＝[arctan(Ay/squr(Ax²+Az²)]*180/π

β_xz＝[arctan(Az/squr(Ax²+Ay²)]*180/π

therefore, according to the above two formulas, the rotation angle β can be calculated;

β＝(β_xx-β₀x，β_xy-β₀y，β_xz-β₀z)

referring to fig. 8, fig. 8 is a schematic circuit structure diagram of a camera provided in an embodiment of the present application.

In some embodiments, the camera 201 includes an ISP chip, an image sensor, an acceleration sensor, and a power conversion module.

Wherein, image sensor and acceleration sensor can set up on the camera board jointly.

In some embodiments, the image sensor and the acceleration sensor may be connected to the ISP chip circuit board through the FPC.

In some embodiments, the ISP chip and the acceleration sensor each include an I2C bus interface and an INT interface, and the ISP chip and the acceleration sensor are connected to the INT interface through an I2C bus interface.

In some embodiments, the ISP chip includes a USB interface for connecting to a display device and a MIPI interface for connecting to an image sensor.

In some embodiments, the power conversion module is respectively connected to the ISP chip, the image sensor, and the acceleration sensor.

In some embodiments, the ISP chip may implement at least the following functions:

(1) and initializing the camera.

(2) And receiving the image data returned by the image sensor.

(3) And receiving an interrupt signal sent by the acceleration sensor, and receiving camera real-time pitching angle data sent by the acceleration sensor.

(4) And calculating the effective imaging area of the image sensor according to the pitching angle change value of the camera.

(5) The effective photosensitive area of the image sensor is set in real time through the I2C bus in accordance with the effective imaging area described above.

(6) And carrying out real-time image correction on the received image data, such as 3D noise reduction, Lens Shading correction, color correction and the like.

In some embodiments, the image sensor may implement at least the following functions:

(1) ISP configuration data is received via the I2C bus and associated control commands, including frame corrections, etc., are executed in real time.

(2) The optical signals received by the image sensor surface are converted into electrical signal image data.

(3) And transmitting the electrical signal image data back to the ISP chip through the MIPI.

In some embodiments, the acceleration sensor may perform at least the following functions:

(1) and monitoring the position state of the camera in real time.

(2) If the position of the camera changes, the acceleration sensor informs the ISP chip through an interruption INT signal, and the camera real-time angle information obtained by the acceleration sensor is transmitted back to the ISP chip through an I2C bus.

In some embodiments, the power conversion module can convert the power supplied by the display device into a power suitable for each module, so that each module can work normally.

According to the camera assembly provided by the embodiment of the application, the pitching angle change value of the camera can be detected by using the acceleration sensor and is sent to the ISP chip; the ISP chip can determine an effective imaging area of the image sensor according to the change value of the pitching angle of the camera, and sends image data collected in the effective imaging area to the display equipment for display, so that a frame containing the display equipment in an image shot by the camera can be avoided, the shooting effect of the camera is effectively guaranteed, and the universality of the camera among different display equipment is improved.

Based on the camera assembly described in the above embodiments, there is also provided in an embodiment of the present application a display apparatus,

in one possible embodiment, the display device includes a display screen, a controller, and a camera assembly.

Wherein, display screen and camera subassembly all are connected with the controller.

In some embodiments, the controller may employ a System on Chip (SoC).

In some embodiments, the display device may be connected to the camera assembly via a USB interface.

In some embodiments, the display device may implement at least the following functions:

(1) and sending the real-time control command triggered by the user to the camera assembly through the USB interface.

(2) And receiving image data transmitted back by the ISP chip in the camera assembly in real time through the USB interface.

(3) And outputting the image data transmitted back by the ISP chip to a display screen for displaying so as to present to a user.

(4) And original power is provided for each functional module of the camera assembly.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A camera component is characterized by comprising a support, a camera and a pitch angle detection sensor;

2. The camera assembly of claim 1, wherein the pitch angle detection sensor is an acceleration sensor.

3. The camera assembly of claim 2, wherein the camera includes a first circuit board, the acceleration sensor and the image sensor both being disposed on the first circuit board when the acceleration sensor is in the camera.

4. A camera assembly according to claim 3, wherein a second circuit board is included in the camera, the processor being disposed on the second circuit board; the first circuit board is connected with the second circuit board through a Flexible Printed Circuit (FPC).

5. Camera assembly according to any one of claims 2 to 4, wherein the processor is an image signal processor ISP, the ISP and the acceleration sensor each comprising an I2C bus interface, the I2C bus interface of the ISP being connected to the I2C bus interface of the acceleration sensor;

6. The camera assembly according to claim 5, wherein the ISP and the acceleration sensor each comprise an interrupt signal INT interface, the INT interface of the ISP being connected to the INT interface of the acceleration sensor;

7. The camera assembly of claim 5, wherein the first data interface is a Universal Serial Bus (USB) interface; the ISP and the image sensor are both provided with Mobile Industry Processor Interfaces (MIPIs), and the ISP is connected with the image sensor by using the MIPIs.

8. The camera assembly of claim 1, wherein the processor is further configured to send the change in the tilt angle of the camera to the display device via the first data interface.

9. The camera assembly of claim 1, further comprising a power conversion module, the power conversion module being connected to the processor, the image sensor, and the pitch angle detection sensor, respectively.

10. A display device is characterized by comprising a display screen, a controller and a camera assembly; the camera assembly is according to any one of claims 1 to 9;