WO2022111000A1 - Display device and display method - Google Patents

Abstract

A display device and a display method. The display device comprises a display; and a controller which is respectively connected to the display and a camera accessing the display device and is configured to: receive a starting instruction of the camera, according to the mounting position of the camera and a display mode of the display, determine a display scale of an image collected by the camera on the display, the display scale being used for representing the length-to-width ratio of the image displaying on the display, and display the image collected by the camera on the display at the display scale.

Description

Display device and display method

This application claims the priority of the Chinese patent application with the application number 202011363628.X and titled "Display Device and Display Method" filed with the China Patent Office on November 27, 2020, and the Chinese patent application filed on August 6, 2021 Office, application number 202110901318.7, and the priority of a Chinese patent application entitled "A method for determining the preview direction of a camera and a display device", and submitted to the Chinese Patent Office on August 6, 2021, application number 202110902251.9, titled The priority of the Chinese patent application for "A method for capturing images with a camera and a display device", the entire contents of which are incorporated herein by reference.

technical field

The embodiments of the present application relate to display technologies. More specifically, it relates to a display device and a display method.

Background technique

With the development of smart TVs, smart rotating TVs gradually appear in the user's field of vision. The smart rotating TV includes a horizontal screen display and a vertical screen mode, and the horizontal screen mode and the vertical screen mode can facilitate users to watch TV programs from different angles.

In the related art, the camera of the smart rotating TV can be fixed on the smart rotating TV, or can be installed in other positions such as a TV cabinet. Because the smart rotating TV is in landscape mode and portrait mode, the images captured by the camera may not be displayed at the correct angle in a certain mode, or the display range may deviate from the center of the display screen of the smart rotating TV.

SUMMARY OF THE INVENTION

In a first aspect, an embodiment of the present application provides a display device, including:

monitor;

a controller, the controller is respectively connected with the display and the camera connected to the display device, and the controller is configured as:

receiving an opening instruction of the camera;

According to the installation position of the camera and the display mode of the display, the display ratio of the image collected by the camera on the display is determined, and the display ratio is used to represent the display ratio of the image when displayed on the display. aspect ratio;

The image collected by the camera is displayed on the display at the display ratio.

In a second aspect, an embodiment of the present application provides a display method, the method comprising:

Receive the opening instruction of the camera;

According to the installation position of the camera and the display mode of the display, the display ratio of the image collected by the camera on the display is determined, and the display ratio is used to represent the display ratio of the image when displayed on the display. aspect ratio;

The image collected by the camera is displayed on the display at the display ratio.

In a third aspect, the application also provides an electronic device, comprising:

memory and processor;

the memory for storing executable instructions of the processor;

The processor is configured to perform the method of the second aspect by executing the executable instructions.

In a fourth aspect, the present invention also provides a non-transitory computer-readable storage medium storing computer instructions, and a computer program is stored thereon, and when the computer program is executed by a processor, any one of the possible methods in the second aspect is implemented .

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the implementations in the related technologies, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or related technologies. Obviously, the drawings in the following description are the For some embodiments of the application, for those of ordinary skill in the art, other drawings can also be obtained according to these drawings.

FIG. 1A is an application scenario diagram of a display device provided by some embodiments of the present application;

FIG. 1B is a rear view of a display device provided by some embodiments of the present application;

FIG. 2 is a block diagram of the hardware configuration of the control apparatus 100 in FIG. 1 provided by some embodiments of the present application;

FIG. 3 is a block diagram of the hardware configuration of the display device 200 in FIG. 1 according to some embodiments of the present application;

FIG. 4 is a block diagram of the architecture configuration of the operating system in the memory of the display device 200 provided by some embodiments of the present application;

FIG. 5 provides a user interface according to some embodiments of the present application;

Figures 6a-6d exemplarily show schematic diagrams of installation positions of exemplary cameras according to some embodiments;

FIG. 7 exemplarily shows a schematic flowchart of a display method according to some embodiments;

FIG. 8 exemplarily shows a schematic flowchart of another display method according to some embodiments;

FIG. 9 exemplarily shows a schematic flowchart of still another display method according to some embodiments;

FIG. 10 exemplarily shows a schematic diagram of a camera type interface according to some embodiments;

FIG. 11 exemplarily shows a schematic flowchart of still another display method according to some embodiments;

FIG. 12 exemplarily shows a schematic diagram of a camera of different camera types according to some embodiments;

Figures 13-20 exemplarily show a schematic diagram of an image captured by a camera in the related art;

FIG. 21 exemplarily shows a flowchart of a method for determining a camera preview direction;

Figure 22 exemplarily shows a schematic diagram of a user interface;

Figure 23 exemplarily shows another schematic diagram of the user interface;

Figure 24 exemplarily shows a flow chart of a method for a camera to capture an image;

A schematic diagram of a user interface is exemplarily shown in FIG. 25 .

Detailed ways

In order to make the objectives, implementations and advantages of the present application clearer, the exemplary embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the exemplary embodiments described It is only a part of the embodiments of the present application, but not all of the embodiments.

A rotating TV is a new type of smart TV, which mainly includes a display and rotating components. Among them, the display is fixed on the wall or bracket through the rotating component, and the placement angle of the display can be adjusted through the rotating component to achieve the purpose of rotation, so as to adapt to the display images of different aspect ratios. For example, in most cases the monitor is placed in landscape orientation to display video images with aspect ratios such as 16:9 and 18:9. When the aspect ratio of the video image is 9:16, 9:18, etc., the monitor that is placed horizontally needs to scale the image, and black areas are displayed on both sides of the monitor. Therefore, the display can be placed vertically by rotating the assembly to accommodate 9:16, 9:18, etc. video images.

In order to facilitate the user to display the detail page of the target media asset in different horizontal and vertical screen states of the display, and to improve the user's viewing experience of the display device in different viewing states, the embodiments of the present application provide a display device, a method for displaying a detail page, and a computer storage medium , a display device such as a rotating TV. It should be noted that the method provided in this embodiment is not only applicable to rotating a TV, but also applicable to other display devices, such as a computer, a tablet computer, and the like.

The terms "first", "second", "third", etc. in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit specific Order or precedence unless otherwise indicated. It should be understood that the terms so used are interchangeable under appropriate circumstances, eg, can be implemented in an order other than those given in the illustration or description of the embodiments of the present application.

Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover but not exclusively include, for example, a product or device incorporating a series of components is not necessarily limited to those explicitly listed, but may include No other components are expressly listed or inherent to these products or devices.

The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or/and software code capable of performing the function associated with that element.

As used in this application, the term "remote control" refers to a component of an electronic device, such as the display device disclosed in this application, that can wirelessly control the electronic device, usually over a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included. For example, a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

The term "gesture" used in this application refers to a user's behavior that is used by a user to express an expected thought, action, purpose/or result through an action such as a change of hand shape or hand movement.

FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., and controls the display device 200 by wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.

In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

In some embodiments, as shown in FIG. 1B , the display device 200 includes a rotating assembly 276, a controller 250, a display 275, and a rotating assembly 276 connected to the backplane. The rotating assembly 276 can rotate the display screen from the front of the display device. From the viewing angle, the rotating component 276 can rotate the display screen to the vertical screen state, that is, the vertical side length of the screen is larger than the horizontal side length, or the screen can be rotated to the horizontal screen state, that is, the horizontal side length of the screen is larger than the vertical screen state. The state of the side length in the direction.

A block diagram of the configuration of the control device 100 is exemplarily shown in FIG. 2 . As shown in FIG. 2 , the control device 100 includes a controller 110 , a memory 120 , a communicator 130 , a user input interface 140 , a user output interface 150 , and a power supply 160 .

A block diagram of a hardware configuration of the display device 200 is exemplarily shown in FIG. 3 . As shown in FIG. 3 , the display device 200 may include, but is not limited to, a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, At least one of the display 275 , the rotating component 276 , the monitoring component 277 , the audio processor 280 , the audio output interface 285 , and the power supply 290 .

The rotating assembly 276 may include components such as a drive motor, a rotating shaft, and the like. The drive motor can be connected to the controller 250, and is controlled by the controller 250 to output a rotation angle; one end of the rotating shaft is connected to the power output shaft of the drive motor, and the other end is connected to the display 275, so that the display 275 can be fixedly installed on the rotating assembly 276. on a wall or stand.

The rotating assembly 276 may also include other components, such as transmission components, detection components, and the like. The transmission component can adjust the rotational speed and torque output by the rotating component 276 through a specific transmission ratio, which can be a gear transmission mode; the detection component can be composed of sensors arranged on the rotating shaft, such as an angle sensor, an attitude sensor, and the like. These sensors can detect parameters such as the rotation angle of the rotating component 276, and send the detected parameters to the controller 250, so that the controller 250 can judge or adjust the state of the display device 200 according to the detected parameters. In practical applications, the rotating assembly 276 may include, but is not limited to, one or more of the above components.

The monitoring component 277 is used to monitor the component rotation information of the rotating component 276 and output the component rotation information to the controller. Wherein, the monitoring component 277 can be set independently, or can be set in the controller.

The detector 230 is a component of the display device 200 for collecting external environment or external interaction signals. The detector 230 can include a sound collector 231, such as a microphone, which can be used to receive the user's voice, such as the voice signal of the user's control instruction to control the display device 200; Device 200 can adapt to ambient noise.

In some other exemplary embodiments, the detector 230 may further include an image collector 232, such as a camera, a camera, etc., which may be used to collect external environmental scenes to adaptively change the display parameters of the display device 200; Attributes of the user or gestures to interact with the user to realize the function of interaction between the display device and the user.

The external device interface 240 is a component that provides the controller 250 to control data transmission between the display device 200 and the external device. The external device interface 240 can be connected with external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), additional information (such as EPG) ) and other data.

The external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, a component (Component) Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure).

The controller 250 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored in the memory 260 .

As shown in FIG. 3, the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, a communication bus 256, a rotation processor 257 and Animation processor 258. Among them, the RAM 251 , the ROM 252 , the graphics processor 253 , the communication interface 255 of the CPU processor 254 , the rotation processor 257 and the animation processor 258 are connected through a communication bus 256 . The functions of the rotation processor 257 and the animation processor 258 will be described in detail in subsequent embodiments.

FIG. 4 exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200 . The operating system architecture is, from top to bottom, the application layer, the middleware layer and the kernel layer.

The application layer, built-in applications in the system and non-system-level applications belong to the application layer. Responsible for direct interaction with users. The application layer may include multiple applications, such as a settings application, an electronic post application, a media center application, and the like. These applications are mainly developed based on the Android system, and the development language can be Java/C++. These applications can also be implemented as web applications, which are executed based on the WebKit engine, and in particular can be developed and executed based on HTML5, Cascading Style Sheets (CSS) and JavaScript.

The middleware layer can provide some standardized interfaces to support the operation of various environments and systems. For example, the middleware layer may be implemented as Multimedia and Hypermedia Information Coding Experts Group (MHEG) for data broadcasting related middleware, DLNA middleware for external device communication related middleware, and also for providing Displays the middleware of the browser environment in which each application program in the device runs.

The kernel layer provides core system services, such as file management, memory management, process management, network management, and system security authority management. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on a Linux operating system.

The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: display driver for display 275, camera driver for camera, button driver for remote control, and WI The FI module provides a WiFi driver, an audio driver for the audio output interface, a power management driver for the power management (PM) module, and so on.

In FIG. 3, user interface 265, receives various user interactions. Specifically, it is used to send the user's input signal to the controller 250, or to transmit the output signal from the controller 250 to the user. Exemplarily, the remote control 100A may send input signals input by the user, such as power switch signals, channel selection signals, volume adjustment signals, etc., to the user interface 265, and then the user interface 265 forwards them to the controller 250; or, the remote control 100A may The controller 250 processes an output signal such as audio, video or data output from the user interface 265, and displays the received output signal or outputs the received output signal in the form of audio or vibration.

"User interface" is a medium interface for interaction and information exchange between application programs or operating systems and users, which realizes the conversion between the internal form of information and the form acceptable to users. A commonly used form of user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, wherein the control can include icons, controls, menus, tabs, text boxes, dialog boxes, status bars, channel bars, Widgets, etc. visual interface elements.

Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through a sensor to receive the user input command.

FIG. 5 exemplarily shows a content that can be presented on a user interface, which may include, but is not limited to, at least one of live TV, VOD, media center, application center, game application, and the like. In the application center, applications that need to use the camera can be included.

At present, with the development of smart TVs, smart rotating TVs gradually appear in the user's field of vision. The smart rotating TV includes a horizontal screen display and a vertical screen mode, and the horizontal screen mode and the vertical screen mode can facilitate users to watch TV programs from different angles.

In the related art, the camera of the smart rotating TV can be fixed on the smart rotating TV, or can be placed in other positions such as a TV cabinet independently of the TV. Since the smart rotating TV can be in landscape mode and portrait mode, the image captured by the camera may not be displayed at the correct angle in a certain mode, or the display range may deviate from the center of the display screen of the smart rotating TV.

Embodiments of the present application provide a display device and a display method, wherein an appropriate display ratio is determined by the installation position of the camera and the display mode of the display to display the image collected by the camera, so as to avoid the image collected by the camera from being unable to be accurately displayed on the rotating TV.

It should be noted that the camera involved in the embodiments of the present application may be installed on the display device as a part of the display device, or may be externally connected to the display device, which is not limited in the embodiments of the present application.

It can be understood that the above display method can be implemented by the display device provided in the embodiment of the present application. The technical solutions of the embodiments of the present application will be described in detail below by taking a display device integrated or installed with relevant execution codes as an example with specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

An embodiment of the present application provides a display method, which involves a specific process of how to display an image captured by a camera in a smart rotating TV. The display method may be implemented by a display device, or implemented by a controller in the display device.

In this embodiment of the present application, when the user needs to play the image captured by the camera on the display device, the user may input an instruction to turn on the camera to the display device. Alternatively, when the user turns on the turn-on button of the camera, the camera sends a turn-on instruction to the display device.

The embodiments of the present application do not limit how to input a camera turn-on instruction to the display device. In some embodiments, a user may input a camera turn-on instruction to the display device by clicking a button on the remote control.

Subsequently, in the embodiment of the present application, after receiving the opening instruction, the display device may determine the installation position of the camera according to the type of the camera and the serial bus port to which the camera is connected.

The types of cameras may include a first type and a second type. The first type may be, for example, a sit-stand type, and the second type may be, for example, a plug-in type. It should be understood that the camera with the base and the external lead is the first type, and the first type of camera is usually arranged on the TV cabinet. It should be understood that the camera that is integrally embedded in the whole machine and can rotate along with the whole machine is of the second type. The second type of ray head is usually arranged at the top of the horizontal screen of the display or the top of the vertical screen of the display.

In some embodiments, the type of camera may be entered by the user. Exemplarily, if it is detected that the camera is connected to the display device, the display device controls the display to display the camera type interface. Then, the type of the camera is input by the user in the camera type interface. After receiving the camera type input by the user, the display device may save the camera type locally.

It should be understood that the serial bus port of the camera in the embodiment of the present application may be located at the top of the horizontal screen of the display device or the top of the vertical screen of the display, which is not limited in the embodiment of the present application.

In some embodiments, the display device can determine the serial bus port connected to the camera through the file name under the USB path. The file name is related to the type of the access device. Exemplarily, after the camera is inserted into the display device, a device node may be added to the camera directory of the display device. Then, if it is queried whether the file name under the USB path satisfies videoX, it is determined that the camera is connected to the USB port. Among them, X represents the format of 0, 1 and so on.

Below are some ways to determine the camera installation location based on the type of camera and the serial bus port to which the camera is connected.

In the first case, if the camera type is the first type, it is determined that the camera is not installed on the display device.

In the first case, if the camera type is the second type and the serial bus port connected to the camera is located at the top of the horizontal screen of the display, it is determined that the camera is installed at the top of the horizontal screen of the display.

In the first case, if the camera type is the second type and the serial bus port to which the camera is connected is located at the top of the vertical screen of the display, it is determined that the camera is installed at the top of the vertical screen of the display.

In the related art, the display of the rotating TV is applied in various usage scenarios because it can be rotated. For the convenience of users, the current rotating TV has a port for connecting an external camera. The port includes a first port and a second port. The first port is located at the upper end of the display when the display is in landscape orientation, and the second port is located at the display when the display is in portrait orientation. , which is the side of the monitor when the monitor is in landscape orientation.

Illustratively, FIGS. 6a-6d exemplarily show schematic diagrams of installation positions of cameras according to some embodiments. The cameras shown in Figures 6a-6d are all second type cameras. In Fig. 6a, the display mode of the display of the display device is landscape display, and the camera is installed at the top of the landscape display. In Fig. 6b, the display mode of the display of the display device is landscape display, and the camera is installed at the top of the vertical screen of the display. In Fig. 6c, the display mode of the display of the display device is vertical screen display, and the camera is installed at the top of the horizontal screen of the display. In Fig. 6d, the display mode of the display of the display device is vertical screen display, and the camera is installed at the top of the vertical screen of the display.

In the embodiment of the present application, after the installation position of the camera is determined, the display ratio of the image collected by the camera on the display can be determined according to the installation position of the camera and the display mode of the display.

Among them, the display ratio is used to represent the aspect ratio of the image when displayed on the display, which can be determined by the resolution. The display ratio may include a first display ratio and a second display ratio, the first display ratio is used for displaying a landscape screen image, and the second display ratio is used for displaying a portrait screen image. Exemplarily, the first display ratio may be 16:9, and the first display ratio may be 9:16.

The following describes how to determine the display ratio.

In some embodiments, if the camera is not installed on the display device and the display mode of the display is landscape display, or, alternatively, the camera is installed at the top of the portrait screen of the display, the display mode of the display is landscape display and the camera does not support the first 2. Display ratio. Alternatively, if the camera is installed at the top of the horizontal screen of the display and the display mode of the display is horizontal display, then it is determined that the image captured by the camera is displayed on the display at the first display ratio, and the first display ratio is used to display Landscape image.

If the camera is installed at the top of the horizontal screen of the display and the display mode of the display is vertical screen display, the image captured by the camera is rotated by 90 degrees and displayed at the first display ratio.

In some embodiments, if the camera is not installed on the display device and the display mode of the display is vertical screen display, or if the camera is installed at the top of the vertical screen of the display and the display mode of the display is vertical screen display, then The image is cropped, and the cropped image is displayed in a second display ratio, and the second display ratio is used to display a portrait image;

In some embodiments, if the camera is installed at the top of the vertical screen of the display, the display mode of the display is vertical screen display, and the camera supports the second display scale, the image captured by the camera is displayed at the second display scale.

In some embodiments, if the camera is installed at the top of the vertical screen of the display, the display mode of the display is landscape display, and the camera supports the second display ratio, the image captured by the camera is rotated by 90 degrees and displayed in the first The second display ratio displays the image captured by the camera.

The following describes the situation that the display device rotates during the display process.

If it is not installed on the display device, when the display is rotated from the landscape mode to the portrait mode, the image captured by the camera is cropped to meet the second display ratio, so that the first display ratio is converted to the second display ratio. Displays the image captured by the camera. When the display is rotated from the portrait screen mode to the landscape screen mode, the image captured by the camera is displayed from the second display ratio to the first display ratio.

If the camera is installed at the top of the horizontal screen of the display, when the display is rotated from the horizontal screen mode to the vertical screen mode, the image captured by the camera is rotated by 90 degrees and displayed at the first display ratio. When the display is rotated from the portrait mode to the landscape mode, the image captured by the camera is displayed at the first display ratio.

If the camera is installed at the top of the vertical screen of the display, when the display is rotated from the vertical screen mode to the horizontal screen mode, the image captured by the camera is rotated by 90 degrees and displayed at the second display ratio. When the display is rotated from landscape mode to portrait mode, the image captured by the camera is displayed at the second display ratio

It should be noted that, if the camera is installed at the top of the vertical screen of the display, but the camera does not support the second display ratio, the display ratio can be determined in a way that the camera is not installed on the display device.

In this embodiment of the present application, when the display ratio of the image collected by the camera on the display is determined, the display device may display the image collected by the camera on the display at the display ratio.

In the display method provided by the embodiment of the present application, the display device first receives an instruction to turn on the camera input by the user. Secondly, the display device determines the display ratio of the image collected by the camera on the display according to the installation position of the camera and the display mode of the display. Finally, the display device displays the image captured by the camera on the display at the display ratio. Compared with the prior art, the embodiment of the present application determines an appropriate display ratio to display the image captured by the camera through the installation position of the camera and the display mode of the display, so as to avoid the image captured by the camera from being unable to be accurately displayed on the rotating TV.

FIG. 7 exemplarily shows a schematic flowchart of a display method according to some embodiments. As shown in FIG. 7 , the method includes:

S301. Receive an instruction for turning on the camera.

S302 , according to the installation position of the camera and the display mode of the display, determine the display ratio of the image collected by the camera on the display.

S303. Display the image collected by the camera on the display at a display ratio.

On the basis of the foregoing embodiment, the following describes in detail how to determine the display ratio of the image captured by the camera on the display. FIG. 8 exemplarily shows a schematic flowchart of another display method according to some embodiments. As shown in FIG. 8 , the method includes:

S401 . Receive a camera startup instruction input by a user.

S402. Obtain the type of the camera, the serial bus port connected to the camera, and the display ratio supported by the camera.

S403. Determine whether the camera type is the first type.

If yes, go to step S404, if not, go to step S407.

S404. Determine whether the display mode of the display is landscape display.

If yes, go to step S405, otherwise go to step S406.

S405. Display the image collected by the camera at a first display scale.

S406 , crop the image collected by the camera, and display the cropped image in a second display ratio.

S407. Determine whether the USB port connected to the camera is a horizontal screen port.

If yes, go to step S408, otherwise go to step S411.

S408, determine whether the display mode of the display is landscape display.

If yes, go to step S409, otherwise go to step S410.

S409. Display the image collected by the camera at a first display scale.

S410. After rotating the image collected by the camera by 90 degrees, display the image collected by the camera at a first display scale.

S411. Determine whether the camera supports the second display scale.

If yes, go to step S412, otherwise go to step S404.

S412. Determine whether the display mode of the display is vertical screen display.

If yes, go to step S413, otherwise go to step S414.

S413. Display the image collected by the camera at a second display scale.

S414. After rotating the image collected by the camera by 90 degrees, display the image collected by the camera at a second display scale.

On the basis of the above-mentioned embodiment, the following describes how the display device acquires the type of the connected camera. FIG. 9 exemplarily shows a schematic flowchart of still another display method according to some embodiments. As shown in FIG. 9 , the method includes:

S501. If it is detected that the camera is connected to the display device, control the display to display the camera type interface.

S502. Receive the type of the camera input by the user.

S503. Store the type of the camera in the memory of the display device.

The embodiments of the present application do not limit how to detect a camera connected to a display device. In some embodiments, after detecting a USB insertion event, the display device may acquire the number of cameras mounted in the system of the display device. If the number of mounted cameras is greater than 0, it is determined that a camera is connected to the display device.

It should be understood that, in some embodiments, when it is determined that a camera is connected to the display device, the display device may directly control the display to display a camera type interface. In other embodiments, when it is determined that a camera is connected to the display device, it is also necessary to determine whether the display device has recorded the type of the camera. If the camera type has not been recorded, the display is controlled to display the camera type interface.

Exemplarily, the display device may determine by acquiring the attribute corresponding to the insertion record of the camera. If the attribute corresponding to the insertion record of the camera is 0, it is determined that the display device has not recorded the type of the camera, and at this time, the display can be controlled to display the camera type interface. If the attribute corresponding to the insertion record of the camera is not 0, it is determined that the display device has recorded the type of the camera, and in this case, there is no need to control the display to display the camera type interface.

It should be understood that the camera type interface in this embodiment of the present application is used for a user to select a camera type. Exemplarily, FIG. 10 schematically shows a schematic diagram of a camera type interface according to some embodiments. As shown in FIG. 10 , a schematic diagram of two cameras of the second type and the first type is displayed in the camera type interface. The schematic diagrams of the two cameras of the first type are identically provided with corresponding controls, and the user can input the type of camera to the display device by triggering the controls.

On the basis of the above embodiment, the following describes the case where the camera type interface is displayed under boot navigation, boot animation, or sound mode. FIG. 11 schematically shows a flowchart of another display method according to some embodiments, as shown in FIG. 11 , the method includes:

S601. Determine whether a camera is connected to a display device.

If not, go to step S602, if yes, go to step S603.

S602, waiting for a response from the camera being inserted.

S603. Determine whether the device is in the boot navigation mode.

If not, step S604 is executed; if yes, step S603 is polled every 3s.

S604. Determine whether the boot animation is being played.

If no, step S605 is executed; if yes, step S604 is polled every 3s.

S605. Determine whether it is in the audio mode.

If yes, go to step S606, if not, go to step S607.

S606. Exit the audio mode.

S607. Display a camera type interface.

In the display method provided by the embodiment of the present application, the display device first receives an instruction to turn on the camera input by the user. Secondly, the display device determines the installation position of the camera according to the type of the camera and the serial bus port connected to the camera. Thirdly, the display device determines the display ratio of the image collected by the camera on the display according to the installation position of the camera and the display mode of the display. Finally, the display device displays the image captured by the camera on the display at the display ratio. Compared with the prior art, the embodiment of the present application determines an appropriate display ratio to display the image captured by the camera through the installation position of the camera and the display mode of the display, so as to avoid the image captured by the camera from being unable to be accurately displayed on the rotating TV.

Hereinafter, the present application will be exemplarily described in a more concrete and figurative manner.

The display device supports inserting cameras of different camera types through the port. The camera types include in-line type or sit-stand type. As shown in Figure 12, the in-line type camera 51 means that the camera rotates with the display, and the sit-stand type The type of camera 52 refers to the connection between the camera and the port through the transmission line 53, and the camera of the sit-stand type does not rotate when the display is rotated.

Figures 13-19 show images captured by the camera in different situations, wherein the images in Figure 13-19 are captured under the condition that the position of the photographed object remains unchanged. FIG. 13 shows the image captured by the camera when the screen state is in the landscape state, the camera is inserted into the first port, and the camera type is an in-line type, and it can be seen that the image is displayed normally. FIG. 14 shows the image captured by the camera when the screen is in a landscape state, the camera is inserted into the first port, and the camera type is a sitting type. It can be seen that the image is displayed normally and does not rotate. In the embodiment of the present application, the placement position of the sit-to-stand type camera can be arbitrarily set. Exemplarily, when the image in FIG. 14 is captured, the positions of the sit-to-stand type camera and the in-line camera in FIG. 13 are In the same way, FIG. 14 only shows that there is a sit-stand type camera, but does not show the position of the sit-stand camera when the image in FIG. 14 is captured.

Figure 15 shows the image captured by the camera when the screen is in the landscape state, the camera is inserted into the second port, and the camera type is an in-line type. It can be seen that the image cannot be displayed normally and rotates.

In the embodiment of the present application, since the cameras are located at the first port and the second port, and the positions of the cameras are different with respect to the person, the shooting ranges of the cameras located on the first port and the cameras located on the second port are also different. Exemplary, Fig. In Figure 14, the characters do not exceed the display interface boundary of the display. In Figure 15, the characters exceed the display interface boundary. At this time, the user can adjust the position of the characters to realize that all characters are located in the display interface.

Figure 16 shows the image captured by the camera when the screen is in the landscape state, the camera is inserted into the second port, and the camera type is the sitting type. It can be seen that the image is displayed normally and does not rotate. FIG. 17 shows that the screen state is in the vertical screen state, the camera is inserted into the first port, and the camera type is an in-line type. The image captured by the camera cannot be displayed normally and rotates. FIG. 18 shows that the screen state is in the vertical screen state, the camera is inserted into the first port, and the camera type is a sitting type. The image captured by the camera can be displayed normally without rotation. FIG. 19 shows that the screen state is in the vertical screen state, the camera is inserted into the second port, and the camera type is an in-line type. The image captured by the camera can be displayed normally without rotation. Figure 20 shows that the screen state is in the vertical screen state, the camera is inserted into the second port, and the camera type is a sit-stand type, and the image captured by the camera can be seen to be displayed normally without rotation.

To sum up, it can be seen that when the screen state is in the horizontal screen state, the camera is inserted into the second port, and the camera type is an in-line type, and when the screen state is in the vertical screen state, the camera is inserted into the first port, and the camera is inserted into the first port. The type is an in-line type, and the image cannot be displayed normally in two cases. It should be noted that the image flip direction of the abnormal situation in FIG. 15 and FIG. 17 is only an example. In some embodiments, the abnormal situation may also include other flip directions. Exemplarily, as shown in FIG. When the direction of the display device is forward, the direction of the head of the portrait in FIG. 15 is located in the opposite direction of the camera relative to the display device. In some embodiments, the direction of the head of the portrait is located in the same direction as the direction of the camera relative to the display device. .

It should be noted that the solution involved in this application is deployed when the number of cameras inserted into the display device is one, and not for the situation where two cameras are inserted. When there are two cameras, the user is prompted to pull out one of the cameras, or the preset The method selects one of the cameras to use to capture the image.

In order to solve the above technical problems, the embodiment of the present application provides a method for determining the preview direction of a camera, which can be used when the screen state is in a landscape state, the camera is inserted into the second port, and the camera type is an in-line type, and, When the screen state is in the vertical screen state, the camera is inserted into the first port, and the camera type is an in-line type, the image captured by the camera can be normally displayed on the display.

In some embodiments, the method, as shown in Figure 21, includes:

S701. Receive an instruction to start a preset application, and determine whether there is a camera inserted into the display device.

In some embodiments, the instruction to start the preset application, the preset application may be a camera application, move the focus on the display device through the control device, move the focus to the control of the preset application, and press the control device. The confirmation button on the screen generates an instruction to start the preset application. After starting the preset application, the user interface is displayed as shown in Figure 22, and the image captured by the camera is displayed in the preview box of the user interface. In some embodiments, the user can move the focus to the photographing control through the control device to achieve the purpose of photographing.

If there is a camera inserted into the display device, determine the port information of the camera inserted into the display device, wherein the port information includes the first port or the second port. When there is a camera inserted into the display device, it is determined that the camera is specifically inserted into the port in the display device.

If there is no camera inserted into the display device, the display is controlled to display the prompt information for inserting the camera. The form of the prompt information is not limited, and it can be a picture, text or sound. For example, as shown in FIG. 23, the prompt information is not Camera detected, please check if the current camera is connected.

In some embodiments, it is detected that the camera is inserted into the display device, and the first preset file is generated. The step of judging whether there is a camera inserted into the display device includes: judging whether there is a first preset file; if there is a first preset file, determining that there is a camera inserted into the display device; if the first preset file does not exist, then Make sure there is no camera plugged into the display device. In the embodiment of the present application, when the camera is inserted into the display device, the first preset file is automatically generated. When the step of determining whether there is a camera inserted into the display device is performed, it is directly determined whether there is a first preset file. If it exists, it is determined that there is a camera inserted into the display device, and if it does not exist, there is no camera inserted into the display device. The present application may also use other methods to determine whether there is a camera inserted into the display device, which is not specifically limited in the present application.

In some embodiments, port information, screen status and rotation status are obtained, wherein the port information is used to indicate the port into which the camera is inserted, the screen status is used to indicate that the screen is placed in landscape or portrait orientation, and the rotation status is used to indicate whether the image is Rotation occurs.

In some embodiments, it is detected that the camera is inserted into the display device, and a second preset file is generated; the step of determining the port information of the camera inserted into the display device includes: judging whether there is a second preset file; if there is a second preset file; file, the port information is determined according to the file name of the second preset file. In the embodiment of the present application, when the camera is inserted into the display device, the second preset file is automatically generated according to the inserted port. The file name of the second preset file is generated according to the port, and when inserted into different ports, the file name of the second preset file is different. When the port information is the first port, the file name of the second preset file is the first file name; when the port information is the second port, the file name of the second preset file is the second file name; 2. The file name of the preset file, and the step of determining the port information includes: judging whether there is a second preset file with the first file name, if it exists, then determining that the port information is the first port, and if it does not exist, then determining that the port information is second port.

In some embodiments, the step of determining the rotation state includes: acquiring an image captured by a camera; and determining a rotation state of the image according to the image, where the rotation state includes rotation or no rotation. In some embodiments, according to the image, the step of determining the rotation state of the image includes: extracting features of the image, inputting the features into a preset classifier, and determining the rotation state of the image.

In this embodiment of the present application, the preset classifier is trained through sample data. In some embodiments, the feature of the image is a texture feature, and the texture feature refers to the outline of an object. The sample data includes the texture feature and the rotation state of the object when the rotation occurs, and the preset classifier is trained by the sample data. It should be noted that, in the embodiment of the present application, the occurrence of rotation only refers to the occurrence of 90° rotation.

In some embodiments, the texture feature of the image is extracted, and the texture feature is input into a preset classifier to obtain the rotation state of the image.

In some embodiments, the number of the preset classifiers may be multiple, exemplarily, including a first preset classifier and a second preset classifier, first extract the features of the image, and input the first preset classifier. , obtain the rotation state of the image, in order to avoid using the first preset classifier to determine that the rotation state of the image is inaccurate, the rotation state of the image determined by the first preset classifier is the image corresponding to the rotation, and continue to extract the rotation state of the image. The feature corresponding to the second preset classifier is input into the second preset classifier to obtain the rotation state of the image. If the second preset classifier is used, it is still determined that the rotation state of the image is rotated, then the rotation of the image is finally determined. The state is rotated, so that the rotation state of the image can be accurately determined.

In this embodiment of the present application, the display device further includes a gyroscope, and the gyroscope is used to determine a screen state, where the screen state is used to indicate that the screen is placed in a landscape orientation or a portrait orientation.

In the embodiment of the present application, before the image is displayed on the user interface, the image captured by the camera is adjusted so that the image can be displayed on the user interface normally, so as to avoid image rotation and affect the use of the user.

In some embodiments, in S702, the camera type is determined according to the port information, the screen state and the rotation state.

In some embodiments, according to the port information, the screen state and the rotation state, the step of determining the camera type includes:

The screen state includes a landscape screen state or a portrait screen state; the rotation state includes rotation or no rotation; and the camera type includes an in-line type or a sit-stand type. In some embodiments, the in-line type camera may be an external camera, and in other embodiments, the in-line type camera may be a camera built in a display device.

If the port information is the first port, the screen state is a portrait screen state, and the image is rotated, it is determined that the camera type is an in-line type.

If the port information is the second port, the screen state is a landscape state, and the image is rotated, it is determined that the camera type is an in-line type.

If the port information is the first port, the screen state is a landscape state, and the image is not rotated, it is determined that the camera type is a preset type, and the preset type includes an in-line type or a sitting type. Vertical type.

If the port information is the second port, the screen state is a landscape state, and the image is not rotated, it is determined that the camera type is a sit-stand type.

If the port information is the first port, the screen state is a portrait screen state, and the image is not rotated, it is determined that the camera type is a sit-stand type.

If the port information is the second port, the screen state is a portrait screen state, and the image is not rotated, it is determined that the camera type is a preset type.

In some embodiments, S703: Control the camera to capture an image according to the camera type, port information and screen status, so that the captured image is displayed on the display normally, and the normal display on the display means that the image is not displayed. Rotation occurs.

In some embodiments, according to the camera type, port information and screen status, the step of controlling the camera to capture images includes:

If the camera type is a sit-stand type and the screen state is a landscape screen state, control the camera to capture images according to the preset preview image ratio m:n; receive a display rotation instruction, change the screen state and rotate the display to vertical Screen. When the display rotation instruction is received, the screen state is changed to the vertical screen state. In some embodiments, a rotation control is provided on the user interface. The user can move the focus to the rotation control through the control device and press the confirmation key on the control device. , to generate the display rotation instruction; when the screen state of the display is in the vertical screen state, determine whether the camera supports the preview image ratio n:m, if so, control the camera to shoot images according to the preview image ratio n:m; if not, it will The image captured by the camera according to the preset preview image ratio is captured according to the preview image ratio n:m, the captured image content is preserved to the maximum extent, and the captured image is displayed on the display. Exemplarily, the ratio of the display is m:n, the size of the display is 1920:1080, the ratio of the preset preview image is m:n, m is 16, and n is 9. When the screen state of the display is in the vertical screen state and the preview image ratio 9:16 is not supported, the image with the preset preview image ratio of 16:9 will be captured, and the preview image ratio of the captured image will be 9:16, and the The captured image is displayed on the display. It should be noted that, in some embodiments, when the captured image is displayed, the image method can be used to display the image in full screen.

In the embodiment of the present application, the preview image ratio supported by the camera is pre-stored. Exemplarily, when the camera supports the preview image ratio n:m, the image ratio captured by the camera is n:m. However, due to the different performances of different cameras, some cameras Preview image ratio n:m cannot be supported. Therefore, when the screen state is in the horizontal screen state, the display rotation command is received and the display is rotated to the vertical screen. Since the camera does not support the preview image ratio n:m, the image captured by the camera needs to be processed, and the processed image is displayed in the In the display, in the embodiment of the present application, the image captured by the camera is intercepted according to the preview image ratio n:m, and the intercepted image is displayed on the display, which can meet the requirement that the display needs to display the n:m ratio.

If the camera type is a sitting-stand type and the screen state is a vertical screen state, determine whether the camera supports the preview image ratio n:m, if so, control the camera to capture images according to the preview image ratio n:m; if not If yes, the image captured by the camera according to the preset preview image ratio is captured according to the preview image ratio n:m, and the captured image is displayed on the display; the display rotation instruction is received, the screen state is controlled to be changed, and the display is rotated to Horizontal screen, control the camera to capture images according to the preset preview ratio m:n, and display the captured images on the monitor.

If the type of the camera is an in-line type, the port information is the first port, and the screen state is the vertical screen state, the image captured by the camera according to the preset preview image ratio m:n is rotated by the preset angle. , which is displayed on the display. Exemplarily, the preset angle is 90°. After the preset angle is rotated, the image is normally displayed on the display without rotation. Receive a display rotation instruction, change the screen state and rotate the display to landscape, control the camera to capture images according to the preset preview image ratio m:n, and display the captured images on the display.

If the camera type is an in-line type, the port information is the first port, and the screen state is a horizontal screen state, control the camera to capture images according to the preset preview image ratio m:n; receive a display rotation instruction, The screen state is changed and the display is rotated to a vertical screen, and the image captured by the camera according to the preset preview image ratio m:n is rotated by the preset angle and displayed on the display.

If the camera type is an in-line type and the port information is the second port, determine whether the camera supports the preview image ratio n:m; If the state is the vertical screen state, then control the camera to capture images according to the preview image ratio n:m; receive the display rotation instruction, change the screen state and rotate the display to the horizontal screen, and take the image captured by the camera according to the preview image ratio n:m, After rotating the preset angle, it is displayed on the display; if the screen state is landscape, the image captured by the camera according to the preview image ratio n:m is rotated by the preset angle, displayed on the display, and the display rotation instruction is received. , change the screen state and rotate the display to a vertical screen, control the camera to capture images according to the preview image ratio n:m, and display the images on the display.

If it is not supported, determine whether the screen state is in the vertical screen state, and if the screen state is in the vertical screen state, the image captured by the camera according to the preset preview image ratio is captured according to the preview image ratio n:m, and the captured image The displayed image is displayed on the display; receiving the rotation instruction of the display, changing the screen state and rotating the display to the horizontal screen, controlling the camera to capture the image according to the preset preview image ratio m:n, and rotating the preset angle, and displaying the rotated image On the display; if the screen state is the horizontal screen state, then the image of the image m:n captured by the camera according to the preset preview image ratio is intercepted, the image of the ratio n:m is captured, and the captured image is rotated and previewed. Set the angle and display it on the display; receive the rotation instruction of the display, change the screen state and the display to the vertical screen, rotate the image in the reverse direction by a preset angle, and display it on the display. In some embodiments, the cropped and rotated image is displayed full screen on the display.

In the above-mentioned embodiment, a method for determining the preview direction of a camera and a display device, the embodiment of the present application adjusts the image captured by the camera according to the type of the camera, port information and screen status, so that the image is normally displayed on the display, improving the user's use experience. The method includes: receiving an instruction to start a preset application, and obtaining port information, a screen state and a rotation state, wherein the port information is used to indicate a port into which a camera is inserted, the screen state is used to indicate that the screen is placed in a landscape orientation or a portrait orientation, and the The rotation status is used to indicate whether the image is rotated; the camera type is determined according to the port information, the screen status and the rotation status; the camera is controlled to capture images according to the camera type, the port information and the screen status.

Another way of realizing the image error-free in the present application is to remind the user in advance which socket to insert into, so that the image is error-free. For example, according to the current horizontal screen state of the display, the user is reminded to insert into the interface in the long-side direction (the top of the screen at this time); according to the current vertical screen state of the display, the user is reminded to insert into the short-side direction (the top of the screen at this time) in the interface.

That is to say, how to select the camera and how to ensure that the image captured by the camera is displayed on the display without being rotated have become problems to be solved by those skilled in the art.

An embodiment of the present application provides a method for capturing an image with a camera, which can normally display images captured by the cameras on a display when multiple cameras are inserted into a display device, and the images are not rotated when displayed on the display.

The method, as shown in Figure 24, includes:

S801. Receive an instruction to start a preset application, and acquire the sequence in which the ports on the display device are inserted by the camera and the screen status, where the screen status is used to indicate that the screen is placed horizontally or vertically.

In some embodiments, the preset application may be a camera application, and the focus on the display device is moved by the control device, the focus is moved to the control of the preset application, and the confirmation key on the control device is pressed to generate a startup preset. After starting the preset application, the user interface is displayed as shown in FIG. 22, and the image captured by the camera is displayed in the preview box of the user interface. In some embodiments, the user can move the focus to the photographing control through the control device to achieve the purpose of photographing.

In some embodiments, the step of determining the order in which the ports on the display device are inserted by the camera includes:

Start the preset service, use the preset service to determine whether there is a camera inserted into the display device, and monitor port insertion information, where the port insertion information includes the port inserted by the camera and the camera unplugged from the port. In this embodiment of the present application, the preset service may be a background service (GlobalUI).

In some embodiments, it is detected that the camera is inserted into the display device, and the first preset file is generated. The step of judging whether there is a camera inserted into the display device includes: judging whether there is a first preset file; if there is a first preset file, determining that there is a camera inserted into the display device; if the first preset file does not exist, then Make sure there is no camera plugged into the display device. In the embodiment of the present application, when the camera is inserted into the display device, the first preset file is automatically generated. When the step of determining whether there is a camera inserted into the display device is performed, it is directly determined whether there is a first preset file. If it exists, it is determined that there is a camera inserted into the display device, and if it does not exist, there is no camera inserted into the display device. The present application may also use other methods to determine whether there is a camera inserted into the display device, which is not specifically limited in the present application.

If there is no camera inserted into the display device, the display is controlled to display the prompt information for inserting the camera. The form of the prompt information is not limited, and it can be a picture, text or sound. For example, as shown in FIG. 23, the prompt information is not Camera detected, please check if the current camera is connected.

In some embodiments, if there is a camera inserted into the display device, and both the first port and the second port are inserted, the display is controlled to display a prompt message for unplugging the camera, and the form of the prompt message for unplugging the camera is also not limited. Exemplarily, as shown in Figure 25, the prompt message is to ensure that you are in the best use state, please make sure that the camera is always only inserted directly above the screen.

In some embodiments, if there is a camera inserted into the display device, the order in which the ports on the display device are inserted by the camera is determined. When listening to the port being inserted by the camera, or listening to the camera being unplugged from the port, update the order in which the ports on the display device are inserted by the camera. When it is monitored that the camera is pulled out of the port or that the port is inserted by the camera, according to the screen state, the camera corresponding to the port in the preset sequence in the updated sequence is used to capture an image.

When there is a camera inserted into the display device, first determine the port information of the camera inserted into the display device, the port information includes the first port and/or the second port, and determine the insertion sequence corresponding to each port. When it is recognized that the camera is inserted into the first port, the insertion sequence in which the port is inserted is determined. After it is recognized that the camera is inserted into the second port, the insertion sequence in which the port is inserted is determined.

In some embodiments, it is detected that the camera is inserted into the display device, and the second preset file is generated. The step of determining the port information of the camera inserted into the display device includes: judging whether there is a second preset file; if there is a second preset file, determining the port information according to the file name of the second preset file. In the embodiment of the present application, when the camera is inserted into the display device, the second preset file is automatically generated according to the inserted port. The file name of the second preset file is generated according to the port, and when inserted into different ports, the file name of the second preset file is different. When the port information is the first port, the file name of the second preset file is the first file name; when the port information is the second port, the file name of the second preset file is the second file name; 2. The file name of the preset file, and the step of determining the port information includes: judging whether there is a second preset file with the first file name, if it exists, then determining that the port information is the first port, and if it does not exist, then determining that the port information is second port.

In some embodiments, the second preset file includes the first identifier. When the camera is inserted into the display device, the cameras are configured with the first identifier in the order of insertion. Exemplarily, the first camera is inserted into the display device. At this time, the camera is configured with the first identifier (videox) as 0, and the second camera is configured with the first identifier (videox) as 0. The camera is inserted into the display device, and the camera is configured with a first identifier of 1 at this time. When the first camera is unplugged from the display device and the third camera is inserted into the display device, at this time, the camera is configured with a first identifier of 2.

The port on the display device is configured with a second identification, the second identification (logicalID) is determined according to the first identification (videox) of the camera inserted into the port, and the second identification includes the third identification LandscapeID and the fourth identification PortraitID means that the third identifier is the identifier of the first port, and the fourth identifier is the identifier of the second port. Exemplarily, the port into which the camera with the first identification 0 is inserted is the first port, the third identification LandscapeID is 0 at this time, the port into which the camera with the first identification 1 is inserted is the second port, and the fourth identification PortraitID is 1. At the same time, when the camera is inserted into the port of the display device, the order in which the port is inserted by the camera is determined, and is represented by a fifth identifier, which includes a sixth identifier LandscapeInsertID and a seventh identifier PortraitInsterID, and the fifth identifier It is the identification of the first port insertion order, and the sixth identification is the identification of the second port insertion order. Exemplarily, the port that is first inserted into the camera is the first port, and the corresponding sixth identification is 0 at this time. The port into which the camera is inserted is the second port, and the corresponding seventh identifier is 1 at this time. When the camera in the port whose sixth identifier is 0 is pulled out, the seventh identifier corresponding to the port whose seventh identifier is 1 is changed from 1 to 0, and the sixth identifier is changed from 0 to the default value -1. It should be noted that the fifth identifier is a non-negative number, and the smaller the value is, the earlier the corresponding port is inserted.

In the following scenarios, the sixth identifier and the seventh identifier are determined, and finally the order in which the ports are inserted by the camera is determined. In some embodiments, the ports in the preset order are the first ports in the order.

Scenario 1: Insert a camera when the display device is turned on and the camera is not inserted. If the camera is inserted into the first port, the first identifier is X, the corresponding third identifier is X, and the sixth identifier representing the insertion order is 0. The second port is not inserted. At this time, the first flag is set to a default value of -1, the fourth flag is -1, and the seventh flag representing the insertion order is -1. Since the sixth identifier is a non-negative number, the first port is inserted as the first port in the insertion order.

Scenario 2: When the display device is turned on and a camera has been inserted, insert a camera again. If the camera has been plugged into the first port in the power-on state, the second port of the re-plugged camera is used. At this time, the first identifier of the first port is X, the corresponding third identifier is X, the sixth identifier representing the insertion sequence is 0, the first identifier of the second port is X+1, and the corresponding fourth identifier is X+ 1, the seventh flag representing the insertion order is 1. Since both the sixth identifier and the seventh identifier are non-negative numbers, and the sixth identifier is smaller than the seventh identifier, the first port is determined as the port at the first position in the insertion sequence.

Scenario 3: When the display device is turned on and a camera has been inserted, remove the camera. At this time, the third identifier, the fourth identifier, the sixth identifier and the seventh identifier are all default values -1, and there is no port at the first position in the insertion sequence at this time.

Scenario 4: The display device is powered on, and two cameras have been inserted. After the display device is powered on, one camera is removed. If the camera from the first port is removed, the third flag is the preset value -1, the sixth flag is the preset value -1, the fourth flag is X, the seventh flag is 0, and the second port is finally determined. Port as first in insertion order.

In this embodiment of the present application, the order in which the ports are inserted by the camera is monitored in real time, and the camera corresponding to the first port is used to capture an image.

S802. According to the screen state, use the camera corresponding to the port located in the preset sequence in the sequence to capture an image. The camera in this embodiment of the present application supports the first preview image ratio m:n and the second preview image ratio n:m.

In some embodiments, according to the screen state, using the camera corresponding to the port in the preset sequence in the insertion sequence, the step of capturing an image includes:

If the port in the preset order in the insertion sequence is the first port, and the screen state is the horizontal screen state, control the camera to capture images according to the first preview image ratio m:n; receive the display rotation instruction to change the screen state, and the display is rotated to a vertical screen, and the image captured by the camera according to the first preview image ratio m:n is rotated by a preset angle and displayed on the display. Exemplarily, the first preview image ratio is m:n, where m is 16 and n is 9.

If the port in the preset order in the insertion sequence is the first port, and the screen state is the vertical screen state, the image captured by the camera according to the first preview image ratio m:n is rotated by the preset angle and displayed on the display. Receive the display rotation instruction, change the screen state, and rotate the display to the horizontal screen, and display the image captured by the camera according to the first preview image ratio m:n on the display.

If the port in the preset order in the insertion sequence is the second port, and the screen state is the landscape state, the image captured by the camera according to the second preview image ratio n:m is rotated by the preset angle and displayed on the on the display; receiving the display rotation instruction, changing the screen state, and rotating the display to the vertical screen, and displaying the image captured by the camera according to the second preview image ratio n:m on the display. Exemplarily, the second preview image ratio is n:m, where n is 9 and m is 16.

If the port in the preset order in the insertion sequence is the second port, and the screen state is the vertical screen state, control the camera to capture images according to the second preview image ratio n:m; receive the display rotation instruction to change the screen state , and rotate the display to a landscape orientation, and rotate the image captured by the camera according to the second preview image ratio n:m to a preset angle and display it on the display.

In the above-mentioned embodiment, a method for capturing an image by a camera and a display device, the embodiment of the present application is beneficial to the camera corresponding to the port located in the preset order, and the image captured by the camera is adjusted in combination with the screen state, so that the image is normally displayed on the display, Improve user experience. The method includes: receiving an instruction to start a preset application, and acquiring the sequence in which the ports on the display device are inserted by the camera and the screen state, where the screen state is used to indicate that the screen is placed horizontally or vertically; and according to the screen state, using the sequence The camera corresponding to the port in the preset order takes an image.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by program instructions related to hardware, the aforementioned program can be stored in a computer-readable storage medium, and when the program is executed, execute It includes the steps of the above method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

The embodiment of the present application further provides a program, which is used to execute the display method provided by the above method embodiment when the program is executed by the processor.

Embodiments of the present application further provide a program product, such as a computer-readable storage medium, where instructions are stored in the program product, and when the program product runs on a computer, the computer executes the display method provided by the above method embodiments.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present invention result in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center over a wire (e.g. coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) to another website site, computer, server, or data center. A computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media. Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present invention. scope.

Claims (10)

1. A display device comprising:

   monitor;

   a controller, the controller is respectively connected with the display and the camera connected to the display device, and the controller is configured as:

   receiving an instruction to turn on the camera;

   According to the installation position of the camera and the display mode of the display, the display ratio of the image collected by the camera on the display is determined, and the display ratio is used to represent the display ratio of the image when displayed on the display. aspect ratio;

   The image collected by the camera is displayed on the display at the display ratio.
2. The display device of claim 1, the controller further configured to:

   The installation position of the camera is determined according to the type of the camera and the serial bus port connected to the camera.
3. The display device of claim 2, the controller further configured to:

   If it is detected that the camera is connected to the display device, the serial bus port to which the camera is connected is determined according to the file name under the storage path of each serial bus port, and the file name and the type of the connected device are determined. related.
4. The display device according to claim 1, the controller is specifically configured to:

   If the camera type is the first type, determining that the camera is not installed on the display device;

   If the camera type is the second type and the serial bus port connected to the camera is located at the top of the horizontal screen of the display, determine that the camera is installed at the top of the horizontal screen of the display;

   If the camera type is the second type and the serial bus port connected to the camera is located at the top of the vertical screen of the display, it is determined that the camera is installed at the top of the vertical screen of the display.
5. The display device according to claim 4, the controller is specifically configured to:

   If the camera is not installed on the display device and the display mode of the display is landscape display, or, if the camera is installed at the top of the landscape screen of the display and the display mode of the display is landscape display , or, if the camera is installed at the top of the vertical screen of the display, the display mode of the display is landscape display, and the camera does not support the second display ratio, then it is determined that the image captured by the camera is displayed on the display The above is displayed in a first display ratio, the first display ratio is used for displaying a landscape screen image, and the second display ratio is used for displaying a portrait screen image.
6. The display device according to claim 4, the controller is specifically configured to:

   If the camera is installed at the top of the horizontal screen of the display and the display mode of the display is vertical screen display, the image captured by the camera is rotated by 90 degrees and displayed at the first display ratio.
7. The display device according to claim 4, the controller is specifically configured to:

   If the camera is not installed on the display device and the display mode of the display is vertical screen display, or, the camera is installed at the top of the vertical screen of the display, the display mode of the display is vertical screen display and If the camera does not support the second display ratio, the image collected by the camera is cropped, and the cropped image is displayed in the second display ratio.
8. The display device according to claim 4, the controller is specifically configured to:

   If the camera is installed at the top of the vertical screen of the display, the display mode of the display is vertical screen display, and the camera supports a second display ratio, the image captured by the camera is displayed at the second display ratio .
9. The display device according to claim 4, the controller is specifically configured to:

   If the camera is installed at the top of the vertical screen of the display, the display mode of the display is landscape display, and the camera supports the second display ratio, the image captured by the camera is rotated 90 degrees so that the The second display scale displays the image collected by the camera.
10. A display method, the method comprising:

    Receive the opening instruction of the camera;

    According to the installation position of the camera and the display mode of the display, the display ratio of the image collected by the camera on the display is determined, and the display ratio is used to represent the display ratio of the image when displayed on the display. aspect ratio;

    The image collected by the camera is displayed on the display at the display ratio.

Images