WO2020248640A1 - Display device - Google Patents

Abstract

A display device (200) for implementing the following steps: opening a first interface on a television according to a user instruction (S101); displaying, on the first interface, preview pictures of a scene captured by a television camera (S102); and upon receiving a photographing instruction, converting a picture currently being displayed on the first interface into an image, and displaying the image on a second interface (S103).

Description

A display device

This disclosure requires the priority of a Chinese patent application filed with the Chinese Patent Office on June 10, 2019, the filing date is 201910497563.9, and the application title is "An image shooting method and device, and display device", and September 17, 2019 The priority of the Chinese patent application filed with the Chinese Patent Office with the filing date of 201910877523.7 and the application name of "a display device", and the filing date of 201910878161.3 with the application name of "a kind of display device" in the Chinese Patent Office on September 17, 2019 The priority of the Chinese patent application for “display device” and the priority of the Chinese patent application filed with the Chinese Patent Office on September 17, 2019 with the filing date of 201910877525.6 and the application name “a display device”, the entire content of which is incorporated by reference Incorporated in this disclosure.

Technical field

This application relates to the technical field of smart TVs, and in particular to a display device.

Background technique

Currently, since the display device can provide users with playback screens such as audio, video, and pictures, it has received widespread attention from users. With the development of big data and artificial intelligence, users' demand for the functions of display devices is increasing day by day. Current display devices, especially household devices, such as smart TVs. The actual shooting area of the camera is not consistent with the display area of the smart TV. The current technology cannot capture and display images on the TV according to the aspect ratio required by the user.

Summary of the invention

An exemplary embodiment of the present application provides a display device for capturing and displaying an image according to an aspect ratio set by a user on the TV side.

According to a first aspect of an exemplary embodiment, a display device is provided, including:

Camera, used to collect image data with the first aspect ratio;

A display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;

A controller in communication with the display, the controller being configured to:

Receiving a control signal input from a user input interface instructing to start the camera;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

Receive a user input instructing to obtain a picture selected by the selector in the first user interface, in response to the user input, obtain a frame of the second aspect ratio image in the preview screen, and display it on the display The second aspect ratio of the image.

In a second aspect, an exemplary embodiment of the present application provides an image capturing method, including:

Receiving a control signal input from a user input interface instructing to start the camera;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

Receive a user input instructing to obtain a picture selected by a selector in the first user interface, in response to the user input, obtain a frame of an image with a second aspect ratio in the preview screen, and display the image on the display The second aspect ratio image.

In a third aspect, an exemplary embodiment of the present application provides a display device, which is characterized in that it includes:

Camera, used to collect image data with the first aspect ratio;

A display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;

A controller in communication with the display, the controller being configured to:

Receiving a control signal input from a user input interface that instructs to start the camera on or off;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

Receive a user input instructing to obtain a picture selected by the selector in the first user interface, in response to the user input, obtain a frame of the second aspect ratio image in the preview screen, and display it on the display The second aspect ratio of the image.

In a fourth aspect, an exemplary embodiment of the present application provides a display device, which is characterized in that it includes:

Camera, used to collect image data with the first aspect ratio;

A display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;

A controller in communication with the display, the controller being configured to:

Receiving a control signal input from a user input interface that instructs to start the camera on or off;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. Intercepting the first aspect ratio image collected by the camera, and displaying according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

Receiving a user input in the first user interface to select an instruction to acquire a picture through the selector, in response to the user input, acquiring the first image of the first aspect ratio currently collected by the camera, and maintaining the first image A preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.

In a fifth aspect, an exemplary embodiment of the present application provides a display device, which is characterized in that it includes:

A camera for collecting image data at the first resolution;

A display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;

A controller in communication with the display, the controller is configured to: receive a control signal input from a user input interface instructing to start the camera on or off;

In response to the user input for starting the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller collecting the camera from the camera. The first resolution image is intercepted and displayed according to the second resolution and according to the first frame rate, where the second resolution is different from the first resolution;

Receive a user input indicating that a picture is acquired by a user through the selector in the first user interface, and in response to the user input, acquire the camera to collect the first resolution image, keep the preview picture still displayed, and display The image of the first resolution is displayed at the second frame rate.

In a sixth aspect, an exemplary embodiment of the present application provides an image capturing method, which is characterized in that the method includes:

Receiving a control signal input from a user input interface instructing to start the camera;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

Receive a user input instructing to obtain a picture selected by a selector in the first user interface, in response to the user input, obtain a frame of an image with a second aspect ratio in the preview screen, and display the image on the display The second aspect ratio image.

In a seventh aspect, an exemplary embodiment of the present application provides an image capturing method, which is characterized in that the method includes:

Receiving a control signal input from a user input interface that instructs to start the camera on or off;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. The camera captures the first aspect ratio image for interception, and displays it according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

Receiving a user input indicating to obtain a picture selected by the user through the selector in the first user interface, in response to the user input, obtaining the first image of the first aspect ratio currently collected by the camera, and preserving the first image A preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.

The above is a brief summary of the present disclosure to explain certain aspects of the application. This summary is not a comprehensive or exhaustive overview of the application and its various aspects, examples and/or configurations. Its purpose is neither to determine the main or key elements of the application, It does not describe the scope of the application, but briefly introduces certain concepts of the application. As an introduction to the detailed description below, it should be understood that other aspects, examples and/or configurations of this disclosure can be used alone or in combination with the above statements or A feature or pairs of fine lines detailed.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative work, other drawings can be obtained from these drawings.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device according to the embodiment;

FIG. 2 exemplarily shows a configuration block diagram of the software system in the display device 200 according to the embodiment;

FIG. 3 exemplarily shows a schematic diagram of application programs included in the application layer of the display device according to the embodiment;

FIG. 4 exemplarily shows a schematic diagram of a user interface in the display device 200 according to the embodiment;

5 to 7 exemplarily show schematic diagrams of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment;

FIG. 8 exemplarily shows a schematic diagram of an image shooting method according to an exemplary embodiment;

FIG. 9 exemplarily shows a schematic diagram of a comparison of the display ratio of the camera shooting area and the TV display area according to an exemplary embodiment;

FIG. 10 exemplarily shows a schematic diagram of a process of capturing an image of a television display area according to an exemplary embodiment;

11 to 13 exemplarily show schematic diagrams of interaction between a user interface and a user in the display device 200 according to another exemplary embodiment;

FIG. 14 exemplarily shows a schematic diagram of another image shooting method according to an exemplary embodiment;

FIG. 15 exemplarily shows a flowchart of capturing an image of a display area of a camera according to an exemplary embodiment;

FIG. 16 exemplarily shows a schematic diagram of a display device of an image capturing device according to an exemplary embodiment;

Fig. 17 exemplarily shows a schematic diagram of another image capturing device according to an exemplary embodiment.

FIG. 18 exemplarily shows a schematic diagram of another image capturing device according to an exemplary embodiment;

Fig. 19 exemplarily shows a schematic diagram of another image capturing device according to an exemplary embodiment.

FIG. 20 exemplarily shows a schematic diagram of another image capturing apparatus according to an exemplary embodiment.

FIG. 21 exemplarily shows a schematic diagram of another image capturing apparatus according to an exemplary embodiment.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

Hereinafter, each embodiment of the present application will be described in detail with reference to the drawings of the specification. It should be noted that the display order of the embodiments of the present application only represents the sequence of the embodiments, and does not represent the pros and cons of the technical solutions provided by the embodiments.

The term "module" used in the various embodiments of this application can refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware or/and software code that can execute related to the component Function.

The term "remote control" used in the various embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. This component can generally use infrared and/or radio frequency (RF) signals and/or Bluetooth to connect with electronic devices, and can also include functional modules such as wireless network WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.

The term "gesture" used in the embodiments of the present application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

FIG. 1 exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device according to the embodiment. As shown in FIG. 1, the user can operate the display device 200 by controlling the device 100.

Wherein, the control device 100 may be a remote controller 100A, which can communicate with the display device 200 through infrared protocol communication, Bluetooth protocol communication, ZigBee protocol communication or other short-distance communication methods for wireless or other communication The display device 200 is controlled in a wired manner. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and switch buttons on the remote control. Function.

The control device 100 can also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc., which can be connected through a local area network (LAN, Wide Area Network), a wide area network (WAN, Wide Area Network), and a wireless local area network ((WLAN) , Wireless Local Area Network) or other networks communicate with the display device 200, and realize the control of the display device 200 through an application program corresponding to the display device 200. For example, use an application program running on a smart device to control the display device 200 The application can provide users with various controls through an intuitive user interface (UI, User Interface) on the screen associated with the smart device.

For example, both the mobile terminal 100B and the display device 200 can install software applications, so that the connection and communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be realized. For example, the mobile terminal 100B can establish a control command protocol with the display device 200, synchronize the remote control keyboard to the mobile terminal 100B, and control the display device 200 by controlling the user interface of the mobile terminal 100B; or the mobile terminal 100B The audio and video content displayed on the screen is transmitted to the display device 200 to realize the synchronous display function.

As shown in FIG. 1, the display device 200 can also communicate with the server 300 through multiple communication methods. In various embodiments of the present application, the display device 200 may be allowed to communicate with the server 300 via a local area network, a wireless local area network, or other networks. The server 300 may provide various contents and interactions to the display device 200.

Illustratively, the display device 200 transmits and receives information, interacts with an Electronic Program Guide (EPG, Electronic Program Guide), receives software program updates, or accesses a remotely stored digital media library. The server 300 may be a group or multiple groups, and may be one or more types of servers. The server 300 provides other network service content such as video on demand and advertising services.

The display device 200 may be a liquid crystal display, an organic light emitting diode (Organic Light Emitting Diode, OLED) display, a projection display device, or a smart TV. The specific display device type, size, aspect ratio, etc. are not limited, and those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.

In addition to providing the broadcast receiving TV function, the display device 200 may additionally provide a smart network TV function that provides a computer support function. Examples include Internet TV, Smart TV, Internet Protocol TV (IPTV, Interactive Personality TV), etc.

As shown in Figure 1, the display device may be connected or provided with a camera, which is used to present the picture captured by the camera on the display interface of the display device or other display devices to realize interactive chats between users. Specifically, the picture captured by the camera can be displayed on the display device in full screen, half screen, or in any optional area.

As an optional connection method, the camera is connected to the monitor rear shell through a connecting plate, and is fixedly installed on the upper middle of the monitor rear shell. As an installable method, it can be fixedly installed at any position of the monitor rear shell to ensure its It is sufficient that the image capture area is not blocked by the rear shell, for example, the image capture area and the display device have the same orientation.

As another optional connection method, the camera can be connected to the display rear shell through a connecting plate or other conceivable connectors. The connector is equipped with a lifting motor. When the user wants to use the camera or has an application to use the camera When the camera is not needed, it can be raised above the display. When the camera is not needed, it can be embedded behind the back shell to protect the camera from damage.

As an embodiment, the camera used in this application may have 16 million pixels to achieve the purpose of ultra-high-definition display. In actual use, a camera with higher or lower than 16 million pixels can also be used.

When a camera is installed on the display device, the content displayed in different application scenarios of the display device can be merged in many different ways, so as to achieve functions that cannot be achieved by traditional display devices.

Exemplarily, the user can video chat with at least one other user while watching a video program. The presentation of the video program can be used as the background picture, and the video chat window is displayed on the background picture. Visually, you can call this function "watch and chat".

Optionally, in the "watching and chatting" scenario, while watching live video or online video, at least one video chat is performed across terminals.

In another example, the user can video chat with at least one other user while entering the education application for learning. For example, students can realize remote interaction with teachers while learning content in educational applications. Visually, you can call this function "learning and chatting".

In another example, when a user is playing a card game, a video chat is conducted with players entering the game. For example, when a player enters a game application to participate in a game, it can realize remote interaction with other players. Visually, you can call this function "watch and play".

Optionally, the game scene is integrated with the video picture, and the portrait in the video picture is cut out and displayed on the game picture to improve user experience.

Optionally, in somatosensory games (such as ball games, boxing games, running games, dancing games, etc.), human body postures and movements are acquired through the camera, body detection and tracking, and the detection of human bone key points data, and then the game Animations are integrated to realize games such as sports and dance scenes.

In another example, the user can interact with at least one other user in video and voice in the K song application. Visually, you can call this function "watch and sing". Preferably, when at least one user enters the application in the chat scene, multiple users can jointly complete the recording of a song.

In another example, the user can turn on the camera locally to obtain pictures and videos, which is vivid, and this function can be called "look in the mirror". The mirror application is a newly added application in the social TV project. The application supports camera image preview, face recognition, adding beauty filters, taking pictures, photo sharing and other functions; the method of taking pictures mentioned in this embodiment is mirroring Realized in application.

In other examples, more functions can be added or the aforementioned functions can be reduced. This application does not specifically limit the function of the display device.

FIG. 2 exemplarily shows a configuration block diagram of a software system in the display device 200 according to an exemplary embodiment.

As shown in FIG. 2, the operating system 2911 includes operating software for processing various basic system services and performing hardware-related tasks, and serves as a medium for completing data processing between application programs and hardware components.

In some embodiments, part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.

In some other embodiments, part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. The drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

Among them, the accessibility module 2911-1 is used to modify or access the application program, so as to realize the accessibility of the application program and the operability of its display content.

The communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.

The user interface module 2911-3 is used to provide objects that display the user interface for access by various applications, and can realize user operability.

The control application 2911-4 is used to control process management, including runtime applications.

The event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand, and implemented in the application program 2912 at the same time, for monitoring various user input events, and responding to the recognition results of various events or sub-events according to various events. And implement one or more sets of pre-defined operation procedures.

Among them, the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.

The event recognition module 2914-1 is used to input the definitions of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute the corresponding one or more groups of processing programs .

Among them, the event or sub-event refers to the input detected by one or more sensors in the display device 200 and the input of an external control device (such as the control device 100). Such as: various sub-events of voice input, gesture input sub-events of gesture recognition, and sub-events of remote control button command input of control devices. For example, one or more sub-events in the remote control include multiple forms, including but not limited to one or a combination of pressing up/down/left/right/, confirming keys, and pressing keys. And the operations of non-physical buttons, such as moving, pressing, and releasing.

The interface layout management module 2913, which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container The size, position, level, etc. of the interface are related to various execution operations.

FIG. 3 exemplarily shows a schematic diagram of the application programs included in the application program layer of the display device according to the exemplary embodiment, and the application program layer of the display device includes various application programs that can be executed on the display device 200.

The application layer 2912 may include, but is not limited to, one or more applications, such as: video-on-demand application, application center, game application, etc., live TV application, media center application, etc.

Live TV applications can provide live TV through different sources. For example, a live TV application may use input from cable TV, wireless broadcasting, satellite services, or other types of live TV services to provide TV signals. And, the live TV application can display the video of the live TV signal on the display device 200.

Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, the video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains the stored video programs.

Media center applications can provide various multimedia content playback applications. For example, the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.

Application center, can provide storage of various applications. The application program may be a game, an application program, or some other application program that is related to a computer system or other device but can be run on a display device. The application center can obtain these applications from different sources, store them in the local storage, and then run on the display device 200.

FIG. 4 exemplarily shows a schematic diagram of a user interface in the display device 200 according to an exemplary embodiment. As shown in FIG. 4, the user interface includes a view display area 201. For example, the view display area 201 includes layout of one or more different items. And the user interface also includes a selector indicating that the item is selected, and the position of the selector can be moved through user input to change the selection of different items.

In some embodiments, the view display area 201 is a zoomable view display. "Scalable" can mean that the size or proportion of the view display area 201 on the screen is scalable, or that the size or proportion of the items in the view display 201 on the screen is scalable.

"Items" refer to visual objects displayed in the view display area of the user interface of the display device 200 to represent corresponding content such as icons, thumbnails, and video clips. For example: the item can represent the image content or video clip of a movie, TV series, audio content of music, application program, or other user access content history information.

In addition, the item may indicate an interface or a set display of interfaces through which the display device 200 is connected to an external device, or may indicate the name of an external device connected to the display device, or the like. Such as: signal source input interface collection, or high-definition multimedia interface (High Definition Multimedia Interface, HDMI), USB interface, PC terminal interface, etc.

It should be noted that: the view display area can present the content of the video chat project or the content of the application layer project (for example, web video, video on demand (VOD) display, application program screen, etc.).

"Selector" is used to indicate that any item has been selected, such as cursor or focus object. Positioning the selection information input according to the icon or menu position touched by the user in the display 200 can enable the display device 200 to display the movement of the focus object to select the control item, and select or control one or more items.

The focus object refers to the object that moves between items based on user input. For example, draw a thick line on the edge of the item to realize or identify the position of the focus object. In other embodiments, the focus form is not limited to examples. It can be a tangible or intangible form that can be recognized by the user, such as a cursor, such as a 3D deformation of the item, and the border line and size of the text or image of the focused item can also be changed. , Color, transparency, outline, and/or font.

The event transmission system 2914 can monitor the user input of each predefined event or sub-event, and directly or indirectly provide the interface layout management module 2913 with the control of the recognized event or sub-event.

The interface layout management module 2913 is used to monitor the state of the user interface (including the position and/or size, change process, etc. of the view partition, item, focus or cursor object, etc.), and according to the event or sub-event, the view display area can be modified The size, location, level and other layout of the display area, and/or, adjust or modify the size or/and location, quantity, type, content and other layouts of various items in the view display area. In some embodiments, modifying and adjusting the layout includes displaying or not displaying each view partition or the content of items in the view partition on the screen.

The user input interface is used to send the user's input signal to the controller, or to transmit the signal output from the controller to the user. Exemplarily, the control device (such as a mobile terminal or a remote control) may send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then the user input interface forwards the input signal to the controller; Alternatively, the control device may receive output signals such as audio, video, or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

FIGS. 5-7 exemplarily show schematic diagrams of interaction between the user interface and the user in the display device 200 according to an exemplary embodiment; for example, as shown in FIGS. 5-7, a plurality of different items are arranged in the view display area 201, such as A preview screen is displayed on the first user interface 201-1 of the view display area 201. The preview screen is an image and video stream obtained from a camera that is intercepted according to the aspect ratio of the display. Figure 5 shows one of the preview screens of the shooting scene. (The displayed preview screen has multiple frames, here is an example of a frame selected), and as can be seen from Figure 5, the image mode selected by the user is "storage ratio-full screen" (the pixel ratio of image width and height is 16 :9). When the user clicks "photograph", in response to the photographing instruction, the user interface changes as shown in FIG. 6.

In some exemplary implementations, as an optional way, the user can click on "beauty filter" to add or change special effects on the preview screen, where the selectable special effects include beauty, filters, Stickers, etc.; users can also click "view pictures" to enter the album center;

As shown in Figure 6, the first user interface 201-1 displays a frame in the image data stream obtained when the user sends the "photograph" instruction. At this time, the user can scan the code to share the picture, or click "Save" or restart. Shoot; when the user clicks "save", in response to the "save" instruction, the user interface changes to as shown in FIG. 7, the second user interface 201-2 in the view display area 201 displays the picture just saved. At this time, the user can obtain a picture with a 16:9 display ratio of the TV display area.

In some exemplary embodiments, the preview image is formed by the controller capturing the image obtained by the camera according to the second aspect ratio, and then continuously displaying it on the first user interface according to the preset frame rate, The second aspect ratio is the display aspect ratio. For example, the display aspect ratio is 16:9.

In some exemplary embodiments, the picture has a resolution, which determines the aspect ratio of the image. In other words, the ratio of the number of horizontal pixels to the number of vertical pixels can be referred to as the pixel ratio, and can also be referred to as the aspect ratio of the image.

In some exemplary embodiments, the first resolution is the resolution of the image acquired by the camera, the first aspect ratio is the aspect ratio of the image acquired by the camera, and the first aspect ratio is associated with the first resolution.

In some exemplary embodiments, the second resolution is the resolution of the display preview image, the second aspect ratio is the aspect ratio of the display preview image, and the second aspect ratio is associated with the second resolution.

In some exemplary embodiments, the preview screen has special effects, which can be implemented by using the acquired data stream or image through an interface that calls a special effect algorithm.

In some exemplary embodiments, the image storage ratio is a full-screen mode (the aspect ratio of the image storage is 16:9).

Fig. 8 exemplarily shows an image shooting method according to an exemplary embodiment, including:

S101. Start the first user interface on the TV according to the user instruction.

S102: Display a preview image of the shooting scene of the camera on the TV side on the first user interface.

In some exemplary embodiments, the preview image is that the controller captures the first aspect ratio image collected by the camera according to the second aspect ratio, and according to the second aspect ratio and according to the preset frame The second aspect ratio is different from the first aspect ratio.

In some exemplary embodiments, the preview image is that the controller captures the first resolution image collected by the camera at the second resolution, and displays the image at the second resolution and the preset frame rate. , The second resolution is different from the first resolution.

In some exemplary embodiments, the first aspect ratio corresponding to the first resolution is 4:3; the aspect ratio corresponding to the second resolution is 16:9.

S103: When a photographing instruction is received, obtain a frame of an image with a second aspect ratio in the preview picture, and display the image with the second aspect ratio on a display.

In some exemplary embodiments, when a photographing instruction is received, a frame of the second resolution image in the preview screen is acquired, and the second resolution image is displayed on the display at the second frame rate .

For example, the first user interface is a preview interface, and the second user interface is a photo display interface.

In some exemplary implementations, the preview screen is a screen captured according to a preset ratio.

For example, the preset ratio is that the pixel ratio of the image width and height is 16:9; after the preview interface of the mirror application is opened on the TV side according to the user instruction, the camera uses the image width and height pixel ratio of 4:3 The original image is captured in proportion (the camera captures a video stream, and the video stream is composed of multiple frames of image data). In order to adapt to the TV aspect ratio of 16:9, the system hardware abstraction layer (HAL) captures the camera The original image is intercepted according to the pixel ratio of 16:9, and the intercepted image is compressed and encoded, and transmitted to the upper application (example, social TV mirror application), and the upper application parses the image to a certain degree The frame rate (the value of the frame rate is not limited here) is continuously displayed on the preview interface to form a camera preview screen.

The mirror application is a newly added application in the social TV project. The application supports camera screen preview, face recognition, adding special effects such as beauty filters, taking pictures, and photo sharing.

In some exemplary embodiments, the preview screen has special effects.

For example, special effects include beauty, filters, stickers, etc. The preview screen can have special effects or no special effects; if you need to add special effects to the preview screen, the camera object is provided by the special effect algorithm; the method of adding special effects to the video screen specifically includes: output the video screen to the texture control ; For example, the special effect algorithm recognizes the face on the texture control TextureView, adds special effects such as filter stickers, superimposes the added special effects on the texture of the video picture without any special effects, and synthesizes the new texture; The texture is output to the display control, and the user can see the video preview screen with special effects on the preview interface.

In some exemplary implementations, if there is no need to add special effects to the preview image, the mirror application does not process the integrated special effects algorithm, and directly creates a camera object to control and manage the camera. The Camera object is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc. Camera has many interfaces to manage the camera, configure parameters, start/stop preview, etc. The takePicture interface is used to start taking pictures.

In some exemplary implementations, special effects are not preset in the mirror application, and no post-processing is required on the images taken by the camera.

For example, when the preview interface displays the preview screen of the shooting scene of the camera on the TV side, the user can select the image storage ratio to full-screen mode, and can also increase or change the special effects of the preview screen; when the user clicks "photograph", it will receive A frame of image is acquired when the user's photographing instruction is received, the user interface is switched from the preview interface to the photo display interface, and the image is displayed on the photo display interface.

In some exemplary embodiments, the first aspect ratio is 4:3.

In some exemplary embodiments, the second aspect ratio is an aspect ratio at 16:9.

For example, when the image storage ratio is full-screen mode, the aspect ratio of image width and height is 16:9, for example, the resolution of the image displayed on the second user interface may be 1920*1080.

FIG. 9 exemplarily shows a comparison diagram of the display ratio between the camera shooting area and the TV display area according to an exemplary embodiment. It can be seen from the figure that the actual shooting area of the camera angle of view is larger than the TV preview screen display area.

Fig. 10 exemplarily shows a flow chart of capturing images of the TV display area according to an exemplary embodiment. On the TV side, the TV terminal receives an instruction from the user to open the TV side mirror application, and after entering the preview interface, the special effect algorithm interface is called to initialize Display the required controls and turn on the camera in the special effect algorithm. The camera collects the original image according to the ratio of width and height of pixels to 4:3. In order to adapt to the size of the TV with a width and height of 16:9, the system's HAL compares the original The image is intercepted according to the pixel ratio of width and height of 16:9, and the intercepted image is compressed and encoded, and then uploaded to the upper application (example, mirror application), the upper application parses the image, (due to the camera capture The video stream is a video stream, and the video stream consists of multiple frames of images) and the parsed image is formed into a video screen without any special effects at a certain frame rate (the value of the frame rate is not limited here), and the video screen is output to On the texture control; for example, the special effect algorithm recognizes the face on the TextureView of the texture control, adds special effects such as filter stickers, superimposes the added special effects on the texture of the video screen without any special effects, and synthesizes a new texture; The synthesized texture is output to the display control, and the user can see the video preview screen with special effects on the preview interface. If the storage ratio selected by the user is full-screen mode (the image aspect ratio is 16:9), and the user "takes a picture" instruction is received, a frame of the current video preview screen is obtained through the special effect algorithm interface (this frame of image has special effects) Effect), and notify the preview screen, the user can see the Bitmap format image (or other format images) on the preview interface; when the user clicks on the "save" instruction, in response to the "save" instruction, the user interface The preview interface is switched to the photo display interface, and the photo is displayed on the photo display interface; at this time, the user obtains a 16:9 aspect ratio photo with special effects in the TV display area, for example, a resolution of 1920*1080). If you do not add special effects to the video preview screen, the steps to capture the image of the TV display area include: on the TV side, receiving instructions from the user to enter the camera-related application (such as opening the mirror application), entering the preview interface, and obtaining the camera object (This object is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc.); the camera collects the original image according to the ratio of width to height pixel ratio of 4:3, and the system's HAL treats the original image according to the width And the high pixel ratio is 16:9 to intercept, and the intercepted image is compressed and encoded, and then uploaded to the upper application (example, mirror application), the upper application parses the image, (because the camera captures video The video stream is composed of multiple frames of images) and the parsed image is continuously displayed on the preview interface at a certain frame rate (the value of the frame rate is not limited here) to form a video preview screen. At this time, the user will see the formed video preview screen on the preview interface.

If the storage ratio selected by the user is full-screen mode (the image aspect ratio is 16:9), and the user "takes a picture" instruction is received, obtain a frame of the current video preview screen (this frame of image does not have special effects), The user can see the Bitmap format image (or pictures in other formats) in the preview interface; when the user clicks the "save" instruction, the user interface switches from the preview interface to the photo display interface in response to the "save" instruction. The photos are displayed on the photo display interface; at this time, the user obtains a 16:9 aspect ratio photo of the TV display area without special effects, for example, a resolution of 1920*1080.

In some embodiments, when the user clicks to take a photo, a frame of image in the preview screen is acquired, the first user interface including the preview screen is exited, and the display displays the image with the second aspect ratio .

The following steps exemplarily show an image with or without special effects of the visible area of the camera:

An exemplary embodiment of the present application provides another display device, including:

A display configured to display a user interface, wherein the user interface includes a view display area, wherein the view display area includes one or more different layout items, and the user interface further includes an instruction The selector whose item is selected can move the position of the selector in the user interface through user input, so that a different item can be selected;

A controller in communication with the display, the controller configured to perform presentation of the user interface;

The controller displays the first user interface of the view display area on the display according to the user's instruction for turning on the camera;

Acquiring an image according to a first aspect ratio through a camera, and forming a preview screen of the image according to a second aspect ratio on the first user interface;

If the image aspect ratio selected by the user is the first aspect ratio, and when the controller receives an instruction for acquiring an image, it stops the preview screen, and at the same time calls the camera to acquire the image according to the first aspect ratio, and The second user interface in the view display area is displayed.

In some exemplary embodiments, the method further includes:

Displaying the first user interface of the view display area on the display according to the user's instruction for turning on the camera;

Acquiring an image according to a first aspect ratio by a camera in a special effect algorithm, adding special effects to the image of the first aspect ratio, and forming a preview image on the first user interface according to the second aspect ratio;

If the image aspect ratio selected by the user is the first aspect ratio, and when an instruction for acquiring an image is received, the preview screen will be stopped, and the camera will be called to acquire the image according to the first aspect ratio, and after adding special effects The second user interface in the view display area is displayed.

11-13 exemplarily show a schematic diagram of interaction between the user interface and the user in the display device 200 according to another exemplary embodiment; for example, as shown in FIGS. 11-13, a plurality of different items are laid out in the view display area 201 For example, the first user interface 201-3 of the view display area 201 displays the preview screen of the shooting scene of the camera on the TV side. FIG. 11 shows one of the preview screens of the shooting scene (the preview screen displayed has multiple frames, here Select a frame of picture for illustration), and it can be seen from Figure 11 that the image mode selected by the user is "storage ratio-standard" (the pixel ratio of image width and height is 4:3), the user can click "beauty filter "Mirror", add or change special effects on the preview screen. The selectable special effects include beauty, filters, stickers, etc.; the user can also click "view picture"; when the user clicks "take a picture", in response to the photo command, The user interface changes as shown in Figure 12.

As shown in Figure 12, the first user interface 201-3 displays the last frame before the user sends out the "photograph" command. At this time, the user can scan the QR code to share the picture, or click "Save" or retake the picture; when the user When "save" is clicked, in response to the "save" instruction, the user interface changes as shown in FIG. 13, and the second user interface 201-4 of the view display area 201 displays the picture just saved. At this time, the image obtained by the user is a picture with a display ratio of 4:3 in the display area of the camera.

In some exemplary embodiments, receiving a control signal that is input from a user input interface and instructs to start turning on or off the camera;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. Intercepting the first aspect ratio image collected by the camera, and displaying according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

Receiving a user input in the first user interface to select an instruction to acquire a picture through the selector, in response to the user input, acquiring the first image of the first aspect ratio currently collected by the camera, and maintaining the first image A preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.

In some exemplary embodiments, receiving a control signal that is input from a user input interface and instructs to start turning on or off the camera;

In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. The first aspect ratio image collected by the camera is intercepted, and displayed according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio.

In some exemplary embodiments, an image is acquired by a camera according to a first aspect ratio, and the image is formed into a preview screen in the first user interface according to the second aspect ratio, that is, according to the second aspect ratio. After comparing and capturing the image obtained by the camera, it is continuously displayed on the first user interface according to a preset frame rate to form a preview image.

For example, the preset ratio is an aspect ratio of 16:9.

In some exemplary embodiments, the preview screen has special effects.

In some exemplary embodiments, when the controller receives a photographing instruction, the data acquired by the camera is used as the current image and displayed on the second user interface. specific:

When the controller receives the user's camera instruction, it stops playing the preview screen, that is, it stops converting the aspect ratio of the camera shooting data. Call the camera directly to obtain the image data of the first aspect ratio, and display it on the second user interface after the photo is taken.

For example, the image of the visible area of the camera is displayed on the second user interface 201-4 (photo display interface), and the pixel ratio of the width to the height of the image is 4:3. Exemplarily, the image resolution is, for example, 4656*3496 (it can also be set to other values).

In some exemplary embodiments, the preset aspect ratio is a corresponding aspect ratio when the image storage ratio selected by the user is the standard mode.

In some exemplary embodiments, after the controller finishes taking a picture of the picture currently displayed on the first user interface, it adds special effects to the obtained image, and displays the image to which the special effects have been added on the second user interface.

For example, the image after the photographing is completed is returned to the special effect algorithm to add the special effect effect, and the image with the special effect added is displayed on the second user interface 201-4.

Fig. 14 exemplarily shows another image capturing method according to an exemplary embodiment, including:

S201: Open the first user interface on the TV according to the user instruction;

S202: Display a preview screen of the shooting scene of the TV camera on the first user interface;

S203: When receiving a photographing instruction, convert the picture currently displayed on the first user interface into an image, and display it on the second user interface.

For example, the first user interface is a preview interface, and the second user interface is a photo display interface.

In some exemplary implementations, the preview screen is a screen captured according to a preset ratio.

In some exemplary embodiments, the preview screen has special effects.

For example, special effects include beauty, filters, stickers, etc.

For example, the preset aspect ratio is 4:3 ratio of pixel width and height (the specific image resolution aspect ratio is 4656*3496); the image displayed on the second user interface is the image of the camera display area. The image can be an image with or without special effects.

In some exemplary embodiments, the preset aspect ratio is a corresponding aspect ratio when the image storage ratio selected by the user is the standard mode.

Figure 15 exemplarily shows a flow chart of capturing images of the display area of a camera according to an exemplary embodiment. On the TV side, the user receives an instruction to open the mirror application on the TV side, starts the camera, initializes the controls required for display, and acquires the camera The image data of is intercepted to fit the size displayed on the monitor, and enter the preview interface. If it is necessary to display a special effect screen, the intercepted data stream is called the special effect algorithm interface to present a preview screen with special effects.

Specifically, the camera collects the original image according to the ratio of the width and height of the pixel to 4:3. In order to adapt to the TV width and height of 16:9, the HAL of the system is based on the original image according to the width and height of the pixel ratio of 16. ：9 ratio is intercepted, and the intercepted image is compressed and encoded, and then uploaded to the upper application (example, mirror application), the upper application parses the image, (because the camera captures the video stream, and the video stream is composed of multiple Frame image composition) and the parsed image is formed at a certain frame rate (the value of the frame rate is not limited here) to form a video picture without any special effects, and output the video picture to the texture control; for example, the special effect algorithm is The texture control TextureView recognizes human faces, adds special effects such as filter stickers, superimposes the added special effects on the texture of the video screen without any special effects, and synthesizes a new texture; outputs the synthesized texture to the display control, The user can see the video preview screen with special effects on the preview interface.

If the storage ratio selected by the user is the standard mode (the image aspect ratio is 4:3), the preview image is still displayed at the 1920*1080 preview resolution; and the user "takes a picture" instruction is received, the camera stops capturing and capturing image data. Special effects processing, and return to the camera object (the camera is not in the preview algorithm application; call the camera's takePicture interface to take a picture, the preview picture will automatically stop, at this time the user sees one frame of the multi-frame picture when the camera command is executed ; Among them, the camera object is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc.); then call the takePicture interface, start taking pictures, generate the original photos obtained by the camera, and call the special effect algorithm to add special effects to the photo , Generate photos with special effects, and notify the preview interface, the user can see Bitmap format images (or pictures in other formats) on the preview interface; when the user clicks on the "save" instruction, in response to the "save" instruction, The user interface is switched from the preview interface to the photo display interface, and the photo is displayed on the photo display interface; at this time, the user obtains a photo with special effects in the visible area of the camera with an aspect ratio of 4:3, for example, a resolution of 4656*3496.

If no special effects are added to the video preview screen, and the final image obtained by the user does not have special effects, the steps to capture the image of the camera display area include: on the TV side, receiving the user's instruction to open the TV side mirror application, starting the camera, and initializing the display The required controls are to intercept the image data obtained by the camera into a size suitable for the display of the monitor and enter the preview interface. After entering the preview interface, the camera object is obtained (the object 1 is used to control the camera switch, configure the camera parameters, manage the camera start/stop preview, take pictures, etc.).

The user selects the "storage ratio-standard" mode (the pixel ratio of image width and height is 4:3), and the preview image is still displayed at the preview resolution of 1920*1080; when the user clicks "photograph", in response to the "photograph" command, First stop the video preview screen, and return to the camera object (when the takePicture interface of the camera is called to take a picture, the preview screen will automatically stop, at this time the user sees a frame of the picture when taking pictures; among them, the camera object is used to control the camera switch, configuration Camera parameters, manage camera start/stop preview, take pictures, etc.); then call the takePicture interface to start taking pictures. After the picture is taken, the user can see the Bitmap format image (or pictures in other formats) on the preview interface. The image is The screen of the actual visible area of the camera; when the user clicks the "save" instruction, the user interface switches from the preview interface to the photo display interface in response to the "save" instruction, and the photo is displayed on the photo display interface; at this time, the user gets the camera visible An area photo with an aspect ratio of 4:3 without special effects can be, for example, a resolution of 4656*3496.

Through the above method, the TV-side camera displays the preview image with a resolution of 1920*1080. When the user takes a photo, the image with the corresponding aspect ratio is obtained according to the image storage ratio selected by the user (full screen or standard); specifically, when the user selects The image storage ratio is full-screen mode, and the ratio of pixel width to height of the TV display area is 16:9, and the resolution is for example 1920*1080 image. When the image storage ratio selected by the user is the standard mode, the visible area of the camera is obtained The pixel width and height of is 4:3, and the resolution is, for example, an image of 4656*3496. In other words, users can simply switch to obtain photos with different aspect ratios and different shooting angles.

Correspondingly, on the device side, FIG. 16 exemplarily shows an image capturing device according to an exemplary embodiment, including:

The first unit 11 is configured to start the first user interface on the TV according to a user instruction;

The second unit 12 is configured to display a preview image of the shooting scene of the TV camera on the first user interface;

The third unit 13 is configured to convert the picture currently displayed on the first user interface into an image and display it on the second user interface when receiving a photographing instruction.

FIG. 17 exemplarily shows another image capturing device according to an exemplary embodiment, including:

The opening unit 21 is configured to open the first user interface on the TV according to a user instruction;

The preview unit 22 is configured to display a preview picture of the shooting scene of the TV camera on the first user interface;

The display unit 23 is configured to convert the picture currently displayed on the first user interface into an image when receiving a photographing instruction, and display it on the second user interface.

FIG. 18 exemplarily shows another display device according to an exemplary embodiment, including:

The fourth unit 31 collects surrounding environment data with the first aspect ratio;

The fifth unit 32 is configured to open a first user interface on the TV side according to a user instruction, and display a preview picture of the shooting scene of the TV side camera on the first user interface, the preview picture being the controller according to the second width The aspect ratio intercepts the first aspect ratio image collected by the camera, and displays it according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio ratio;

The sixth unit 33 is configured to convert the picture of the second aspect ratio currently displayed on the preview picture into an image when receiving a photographing instruction, or obtain the picture of the first aspect ratio collected by the camera, and The second user interface is displayed.

FIG. 19 exemplarily shows another display device according to an exemplary embodiment, including:

The collecting unit 41 collects surrounding environment data with the first aspect ratio;

The preview unit 42 is configured to open a first user interface on the TV side according to a user instruction, and display a preview screen of the shooting scene of the TV camera on the first user interface, the preview screen being the controller according to the second width and height The first aspect ratio image collected by the camera is compared and intercepted, and displayed according to a second aspect ratio and according to a preset frame rate, where the second aspect ratio is different from the first aspect ratio ；

The display unit 43 is configured to convert the picture of the second aspect ratio currently displayed on the preview picture into an image when receiving a photographing instruction, or to obtain an image of the first aspect ratio collected by the camera, 2. The user interface is displayed.

Fig. 20 also exemplarily shows an image capturing device according to an exemplary embodiment, including:

The processor 600 is configured to read a program in the memory 610 and execute the following process:

Open the first user interface on the TV according to the user instruction;

Displaying a preview image of the shooting scene of the camera on the TV side on the first user interface;

When a photographing instruction is received, the picture currently displayed on the first user interface is converted into an image and displayed on the second user interface.

Through this device, the first user interface is opened on the TV according to the user instruction; the preview screen of the shooting scene of the TV camera is displayed on the first user interface; when the camera instruction is received, the first user interface is currently displayed The picture is converted into an image and displayed on the second user interface, so that the image is captured and displayed on the TV according to the aspect ratio set by the user.

In some exemplary implementations, the preview screen is a screen captured according to a preset ratio.

In some exemplary embodiments, the preview screen has special effects.

In some exemplary implementations, when a photographing instruction is received, converting the picture currently displayed on the first user interface into an image, and displaying it on the second user interface, specifically includes:

When receiving a user's photographing instruction, according to the image storage ratio selected by the user, the picture currently displayed on the first user interface is converted into an image and displayed on the second user interface.

In some exemplary embodiments, the image storage ratio is a full-screen mode.

FIG. 21 also exemplarily shows another image capturing device according to an exemplary embodiment, including:

The processor 800 is configured to read a program in the memory 810 and execute the following process:

Open the first user interface on the TV according to the user instruction;

Displaying a preview image of the shooting scene of the camera on the TV side on the first user interface;

When a photographing instruction is received, the picture currently displayed on the first user interface is converted into an image and displayed on the second user interface.

Through this device, the first user interface is opened on the TV according to the user instruction; the preview screen of the shooting scene of the TV camera is displayed on the first user interface; when the camera instruction is received, the first user interface is currently displayed The picture is converted into an image and displayed on the second user interface, so that the image is captured and displayed on the TV according to the aspect ratio set by the user.

In some exemplary implementations, the preview screen is a screen captured according to a preset ratio.

In some exemplary embodiments, the preview screen has special effects.

In some exemplary implementations, when a photographing instruction is received, converting the picture currently displayed on the first user interface into an image, and displaying it on the second user interface, specifically includes:

When receiving a user's photographing instruction, the camera is called, the camera is set according to the preset aspect ratio, and the picture currently displayed on the first user interface is photographed. After the photograph is completed, it is displayed on the second user interface.

In some exemplary embodiments, the preset aspect ratio is a corresponding aspect ratio when the image storage ratio selected by the user is the standard mode.

In some exemplary implementations, after the picture currently displayed on the first user interface is taken, a special effect is added to the obtained image, and the image to which the special effect has been added is displayed on the second user interface.

Among them, in FIGS. 20 and 21, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by the processors 600 and 800 and various circuit links between the memories represented by the memories 610 and 810 Together. The bus architecture can also link various other circuits such as peripherals, voltage regulators, and power management circuits. These are all well-known in the art, and therefore, no further description will be given here. The bus interface provides the interface.

An exemplary embodiment of the present application provides a display terminal, and the display terminal may specifically be a desktop computer, a portable computer, a smart phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), etc. The display terminal may include a central processing unit (CPU), a memory, an input/output device, etc. The input device may include a keyboard, a mouse, a touch screen, etc., and an output device may include a display device, such as a liquid crystal display (Liquid Crystal Display, LCD), Cathode Ray Tube (CRT), etc.

For different display terminals, in some exemplary embodiments, the user interfaces 620 and 820 may be interfaces that can externally and internally connect the required equipment. The connected equipment includes but not limited to a keypad, a display, a speaker, a microphone, a joystick, etc. .

The processor is responsible for managing the bus architecture and general processing, and the memory can store data used by the processor 600 when performing operations.

In some exemplary embodiments, the processor may be a CPU (Central Embedded Device), ASIC (Application Specific Integrated Circuit, application-specific integrated circuit), FPGA (Field-Programmable Gate Array, field programmable gate array) or CPLD ( Complex Programmable Logic Device, complex programmable logic device).

The memory may include read-only memory (ROM) and random access memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiment of the present application, the memory may be used to store the program of any of the methods provided in the exemplary implementation of the present application.

The processor calls the program instructions stored in the memory, and the processor is configured to execute any of the methods provided in the exemplary implementation manners of the present application according to the obtained program instructions.

The exemplary embodiment of the present application provides a computer storage medium for storing computer program instructions used by the device provided in the foregoing embodiment of the present application, which includes a computer program instruction for executing any method provided in the foregoing embodiment of the present application. program.

The computer storage medium may be any available medium or data storage device that can be accessed by the computer, including but not limited to magnetic storage (such as floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor memory (such as ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid state drive (SSD)), etc.

In summary, the exemplary embodiments of the present application provide an image capturing method and device, and a display device, so that images are captured and displayed on the TV according to the aspect ratio set by the user. Specifically, when the image mode selected by the user is the full-screen mode (16:9), the image of the visible area of the TV is captured on the TV and displayed; when the image mode selected by the user is the standard mode (4:3), The terminal captures the image of the visible area of the camera and displays it; thus, the user can simply switch to obtain photos with different aspect ratios and different shooting angles.

Those skilled in the art should understand that the exemplary embodiments of this application may be provided as a method, a system, or a computer program product. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.

This application is described with reference to flowcharts and/or block diagrams of methods, equipment (systems), and computer program products according to the embodiments of this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Based on the exemplary embodiments shown in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application. In addition, although the disclosure in this application is introduced in accordance with one or several exemplary examples, it should be understood that various aspects of these disclosures can also be individually constituted as a complete technical solution.

It should be understood that the terms “first”, “second”, “third”, etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or Priority. It should be understood that the data used in this way can be interchanged under appropriate circumstances, for example, it can be implemented in an order other than those given in the illustration or description of the embodiments of the present application.

In addition, the terms "including" and "having" and any variations of them are intended to cover but not exclusively include. For example, a product or device including a series of components need not be limited to those clearly listed, but may include Other components that are not clearly listed or are inherent to these products or equipment.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the application, not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: It is still possible to modify the technical solutions described in the foregoing embodiments, or equivalently replace some or all of the technical features; these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the application range.

Claims (28)

1. A display device, characterized by comprising:

   Camera, used to collect image data with the first aspect ratio;

   A display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;

   A controller in communication with the display, the controller being configured to:

   Receiving a control signal input from a user input interface that instructs to start the camera on or off;

   In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

   Receive a user input instructing to obtain a picture selected by the selector in the first user interface, in response to the user input, obtain a frame of the second aspect ratio image in the preview screen, and display it on the display The second aspect ratio of the image.
2. The display device according to claim 1, wherein a user input indicating to obtain a picture selected in the first user interface through the selector is received, and in response to the user input, one of the preview images is obtained Frame image, exit displaying the first user interface including the preview screen, and display the image with the second aspect ratio on the display.
3. The display device according to claim 1, wherein the controller is further configured to execute:

   Call the special effect algorithm interface to perform special effect processing on the preview screen.
4. The display device according to claim 1, wherein a user input indicating to obtain a picture selected in the first user interface through the selector is received, and in response to the user input, one of the preview images is obtained Frame an image with the second aspect ratio and display the image with the second aspect ratio on a display specifically includes:

   When the controller receives the user's camera instruction, it acquires a frame of the second aspect ratio image in the preview screen according to the user input of the image storage ratio selected by the user, and displays the second aspect ratio on the display Image.
5. The display device of claim 4, wherein the image storage ratio comprises a first width-to-height storage ratio and a second width-to-height storage ratio, wherein the first width-to-height storage ratio and the image data acquired by the camera The first aspect ratio is associated, and the second aspect storage ratio is associated with the second aspect ratio of the preview screen displayed on the display.
6. An image shooting method, characterized in that the method includes:

   Receiving a control signal input from a user input interface instructing to start the camera;

   In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller compares the controller with the second aspect ratio. Intercepting an image with a first aspect ratio collected by a camera, and displaying it according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

   Receive a user input instructing to obtain a picture selected by a selector in the first user interface, in response to the user input, obtain a frame of an image with a second aspect ratio in the preview screen, and display the image on the display The second aspect ratio image.
7. The display device according to claim 1, wherein after the receiving a user input indicating that a picture is acquired in the first user interface selected by the selector and responding to the user input, the method further comprises:

   Acquire a frame of image in the preview screen, exit displaying the first user interface including the preview screen, and display the image with the second aspect ratio on the display.
8. The method according to claim 6, wherein the method further comprises:

   Display the first user interface on the display according to the user's instruction to turn on the camera;

   Acquiring an image according to a first aspect ratio by a camera in a special effect algorithm, adding special effects to the image and forming a preview image on the first user interface according to the second aspect ratio;

   An instruction for acquiring an image is received, a frame of an image with a second aspect ratio with special effects in the preview screen is acquired, and the image with the second aspect ratio is displayed on a display.
9. The method according to claim 6, characterized in that a user input indicating to obtain a picture selected by the selector in the first user interface is received, and in response to the user input, a first frame of the preview screen is obtained. The image with the second aspect ratio and displaying the image with the second aspect ratio on the display specifically include:

   When the controller receives the user's camera instruction, it acquires a frame of the second aspect ratio image in the preview screen according to the user input of the image storage ratio selected by the user, and displays the second aspect ratio on the display Image.
10. The method according to claim 9, wherein the image storage ratio includes a first width-to-height storage ratio and a second width-to-height storage ratio, wherein the first width-to-height storage ratio is related to the first width-to-height storage ratio of the image data acquired by the camera. An aspect ratio is associated, and the second aspect storage ratio is associated with the second aspect ratio of the preview image displayed on the display.
11. A display device, characterized by comprising:

    Camera, used to collect image data with the first aspect ratio;

    A display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;

    A controller in communication with the display, the controller being configured to:

    Receiving a control signal input from a user input interface that instructs to start the camera on or off;

    In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. Intercepting the first aspect ratio image collected by the camera, and displaying according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

    Receiving a user input in the first user interface to select an instruction to acquire a picture through the selector, in response to the user input, acquiring the first image of the first aspect ratio currently collected by the camera, and maintaining the first image A preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.
12. 11. The display device according to claim 11, wherein after receiving a user input indicating to obtain a picture selected by the selector in the first user interface, it is further configured to execute:

    In response to the user input, the camera acquires the first image with the first aspect ratio currently collected by the camera, and keeps the preview screen in the first user interface still displayed, and then exits the display of the first image that includes the preview screen. The user interface and the display display the first image with the first aspect ratio.
13. 11. The display device according to claim 11, wherein the presenting a first user interface on the display in response to a user input of starting the camera comprises:

    Obtain the image data of the first aspect ratio collected by the camera;

    Intercepting the data of the first aspect ratio according to the second aspect ratio to obtain image data of the second aspect ratio;

    Calling the special effect algorithm interface to perform special effect processing on the intercepted image data of the second aspect ratio;

    The image data of the second aspect ratio that has undergone special effects processing is presented on the display.
14. 11. The display device according to claim 11, wherein the controller receives a user input indicating to obtain a picture selected by a user through the selector in the first user interface, and in response to the user input, obtains the The camera currently collects the first image with the first aspect ratio, and keeps the preview image in the first user interface still displayed, and then is also used to execute:

    Special effect processing is performed on the acquired first image, and the display displays the first image subjected to the special effect processing.
15. An image shooting method, characterized in that the method includes:

    Receiving a control signal input from a user input interface that instructs to start the camera on or off;

    In response to the user input to start the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller according to the second aspect ratio. The camera captures the first aspect ratio image for interception, and displays it according to a second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;

    Receiving a user input indicating to obtain a picture selected by the user through the selector in the first user interface, in response to the user input, obtaining the first image of the first aspect ratio currently collected by the camera, and preserving the first image A preview image in a user interface is displayed statically, and the display displays a first image of the first aspect ratio.
16. The method according to claim 15, characterized in that, after performing said receiving a user input indicating to obtain a picture selected by the selector in the first user interface, the method further comprises:

    In response to the user input, the camera acquires the first image with the first aspect ratio currently collected by the camera, and keeps the preview screen in the first user interface still displayed, and then exits the display of the first image that includes the preview screen. The user interface and the display display the first image in the first aspect ratio.
17. The method according to claim 15, wherein the presenting a first user interface on the display in response to a user input of starting the camera comprises:

    Display the first user interface on the display according to the user's instruction to turn on the camera;

    Acquiring an image according to a first aspect ratio by a camera in a special effect algorithm, adding special effects to the image and forming a preview image on the first user interface according to the second aspect ratio;
18. The method according to claim 15, characterized in that: after receiving a user input indicating that a picture is acquired by a user selected in the first user interface through the selector, in response to the user input, acquiring the current acquisition by the camera A first image with an aspect ratio, and the preview image in the first user interface is kept still displayed, and then further includes:

    Special effect processing is performed on the acquired first image, and the display displays the first image subjected to the special effect processing.
19. A display device, characterized by comprising:

    A camera for collecting image data at the first resolution;

    A display configured to display an image screen and a user interface, and a selector used in the user interface to indicate that an item is selected in the user interface;

    A controller in communication with the display, the controller is configured to: receive a control signal input from a user input interface instructing to start the camera on or off;

    In response to the user input for starting the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller collecting the camera from the camera. The first resolution image is intercepted and displayed according to the second resolution and according to the first frame rate, where the second resolution is different from the first resolution;

    Receive a user input indicating that a picture is acquired by a user through the selector in the first user interface, and in response to the user input, acquire the camera to collect the first resolution image, keep the preview picture still displayed, and display The image of the first resolution is displayed at the second frame rate.
20. The display device of claim 19, wherein the controller is further configured to execute:

    Call the special effect algorithm interface to perform special effect processing on the preview screen.
21. 22. The display device according to claim 20, wherein the controller receives a user input indicating to obtain a picture selected by a user through the selector in the first user interface, and in response to the user input, obtains the After the camera collects the first resolution image, it is also used to perform:

    Perform special effect processing on the acquired image data of the first resolution, and present it on the display according to the second frame rate.
22. 18. The display device of claim 19, wherein receiving user input for obtaining a first resolution image, stopping the formation of the preview screen, and obtaining one frame of the first resolution image data collected by the camera, Specifically:

    Receive user input from the user to select the image storage ratio, set the method of acquiring the image, when receiving the user input for acquiring the first resolution image, acquire the first resolution image collected by the camera, keep the preview image still displayed, and The second frame rate displays the image of the first resolution.
23. 20. The display device according to claim 19, wherein the controller is further configured to perform: after performing the receiving user input indicating that a picture is acquired in the first user interface selected by the selector:

    In response to the user input, acquire the first image of the first resolution currently collected by the camera, and keep the preview screen in the first user interface still displayed, and then exit the display of the first user that includes the preview screen The interface and the display display the first image of the first resolution.
24. An image shooting method, characterized in that the method includes:

    Receive a control signal input from the user input interface that instructs to start the camera on or off;

    In response to the user input for starting the camera, a first user interface is presented on the display, wherein the first user interface includes a preview screen, and the preview screen is the controller collecting the camera from the camera. The first resolution image is intercepted and displayed according to the second resolution and according to the first frame rate, where the second resolution is different from the first resolution;

    Receive a user input indicating that a picture is acquired by a user through the selector in the first user interface, and in response to the user input, acquire the camera to collect the first resolution image, keep the preview picture still displayed, and display The image of the first resolution is displayed at the second frame rate.
25. The method according to claim 24, wherein after the receiving a user input indicating that a picture is obtained is selected in the first user interface through the selector, the method further comprises:

    In response to the user input, acquire the first image of the first resolution currently collected by the camera, and keep the preview screen in the first user interface still displayed, and then exit the display of the first user that includes the preview screen The interface and the display display the first image with the first resolution at the second frame rate.
26. The method according to claim 24, wherein a special effect algorithm interface is called to perform special effect processing on the preview screen.
27. A computing device, characterized by comprising:

    Memory, used to store program instructions;

    The processor is configured to call the program instructions stored in the memory, and execute the method according to any one of claims 6 to 10 according to the obtained program.
28. A computer storage medium, characterized in that the computer storage medium stores computer executable instructions, and the computer executable instructions are used to make the computer execute the method according to any one of claims 6 to 10.

Images