CN110636354A - Display device - Google Patents

Display device Download PDF

Info

Publication number
CN110636354A
CN110636354A CN201910878161.3A CN201910878161A CN110636354A CN 110636354 A CN110636354 A CN 110636354A CN 201910878161 A CN201910878161 A CN 201910878161A CN 110636354 A CN110636354 A CN 110636354A
Authority
CN
China
Prior art keywords
aspect ratio
image
display
camera
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910878161.3A
Other languages
Chinese (zh)
Inventor
于文钦
杨鲁明
朱铄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Electronics Co Ltd
Original Assignee
Qingdao Hisense Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Electronics Co Ltd filed Critical Qingdao Hisense Electronics Co Ltd
Publication of CN110636354A publication Critical patent/CN110636354A/en
Priority to PCT/CN2020/079701 priority Critical patent/WO2020248640A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438—Window management, e.g. event handling following interaction with the user interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application discloses a display device which is used for shooting and displaying images at a television end according to an aspect ratio set by a user. The image shooting method provided by the embodiment of the application comprises the following steps: starting a first user interface at the television according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; when a photographing instruction is received, an image of a second aspect ratio of one frame in the preview picture is acquired, and the image of the second aspect ratio is displayed on a display.

Description

Display device
Technical Field
The application relates to the technical field of intelligent televisions, in particular to a display device.
Background
Currently, since a display device can provide a user with a play picture such as audio, video, picture, and the like, it is receiving a wide attention of the user. With the development of big data and artificial intelligence, the functional requirements of users on display devices are increasing day by day. Current display devices, especially household devices, such as smart televisions; the actual shooting area of the camera is not consistent with the display area of the television, and the current technology cannot shoot and display images at the television according to the aspect ratio required by a user.
Disclosure of Invention
The exemplary embodiment of the application provides a display device which is used for shooting and displaying images according to the aspect ratio set by a user at a television end.
According to an aspect of exemplary embodiments, there is provided a display apparatus including:
a camera for acquiring image data using a first aspect ratio;
a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;
a controller in communication with the display, the controller configured to:
receiving a control signal input from a user input interface and indicating to start the camera;
responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
receiving a user input indicating to acquire a picture selected in the first user interface through the selector, acquiring an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.
Opening a first user interface of the view display area at a television end through a controller according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; and when the controller receives a photographing instruction, acquiring a frame of image with a second aspect ratio in the preview picture, and displaying the image with the second aspect ratio on a display, so that a picture is photographed and displayed at the television end according to the instruction of a user.
An exemplary embodiment of the present application provides an image capturing method, including:
receiving a control signal input from a user input interface and indicating to start the camera;
responding to user input for starting the camera, presenting a first user interface in a display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting an image of a first aspect ratio acquired by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
the method includes receiving a user input indicating that a picture is to be taken by a selector in the first user interface, taking an image of a frame of a second aspect ratio in the preview screen in response to the user input, and displaying the image of the second aspect ratio on a display.
According to the method, a first user interface is started at a television end according to a user instruction; displaying a preview picture of a shooting scene of a television camera on the first user interface; and when a photographing instruction is received, acquiring a frame of image with a second aspect ratio in the preview picture, and displaying the image with the second aspect ratio on a display, so that a picture is photographed and displayed at a television end according to the instruction of a user.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
According to the method, the preview picture is a picture intercepted according to a preset proportion, so that the preview picture is displayed on a first user interface of a television according to a television visible area.
In some exemplary embodiments, the preview screen has a special effect.
By the method, the preview picture has a special effect, so that the preview picture with the special effect is displayed on the first user interface of the television.
An embodiment of the present application further provides a computing device, including:
a memory for storing program instructions;
and the processor is used for calling the program instructions stored in the memory and executing any one of the methods provided by the embodiment of the application according to the obtained program.
Another embodiment of the present application provides a computer storage medium having stored thereon computer-executable instructions for causing a computer to perform any one of the methods described above.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device 200 and a control apparatus according to an embodiment;
fig. 2 is a block diagram schematically illustrating a configuration of a software system in the display device 200 according to the embodiment;
fig. 3 is a schematic diagram illustrating an application included in an application layer of a display device according to an embodiment;
fig. 4 schematically illustrates a user interface in the display device 200 according to an embodiment;
FIG. 5 ~ 7 is a schematic diagram illustrating user interface interaction with a user in display device 200 according to an exemplary embodiment;
fig. 8 is a diagram schematically illustrating an image capturing method according to an exemplary embodiment;
fig. 9 is a schematic diagram illustrating a comparison of display scales of a camera shooting area and a television display area according to an exemplary embodiment;
FIG. 10 is a flow diagram illustrating capturing television display area images according to an exemplary embodiment;
FIG. 11 ~ 13 is a schematic diagram illustrating user interface interaction with a user in the display device 200 according to another exemplary embodiment;
fig. 14 is a schematic view schematically illustrating another image capturing method according to an exemplary embodiment;
fig. 15 is a flowchart illustrating capturing a camera display area image according to an exemplary embodiment;
FIG. 16 is a schematic diagram of a display device according to an exemplary embodiment;
FIG. 17 is a schematic diagram of another display device according to an exemplary embodiment;
a schematic diagram of a display device according to an exemplary embodiment is also illustrated in fig. 18.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Various embodiments of the present application will be described in detail below with reference to the accompanying drawings. It should be noted that the display sequence of the embodiment of the present application only represents the sequence of the embodiment, and does not represent the merits of the technical solutions provided by the embodiments.
The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component can be generally connected with an electronic device by using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and can also comprise a wireless network WiFi, a wireless USB, bluetooth, a motion sensor and other functional modules. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.
The term "gesture" as used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose, or result through a change in hand shape or an action such as hand movement.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device 200 and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the control device 100.
The control device 100 may be a remote controller 100A, which can communicate with the display device 200 through an infrared protocol communication, a bluetooth protocol communication, a ZigBee (ZigBee) protocol communication, or other short-range communication, and is used to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
The control apparatus 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a notebook computer, etc., which may communicate with the display device 200 through a Local Area Network (LAN), a Wide Area Network (WAN), a Wireless Local Area Network (WLAN), or other networks, and implement control of the display device 200 through an application program corresponding to the display device 200.
For example, the mobile terminal 100B and the display device 200 may each have a software application installed thereon, so that connection communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be further realized. Such as: a control instruction protocol can be established between the mobile terminal 100B and the display device 200, a remote control keyboard is synchronized to the mobile terminal 100B, and the function of controlling the display device 200 is realized by controlling a user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.
As shown in fig. 1, the display apparatus 200 may also perform data communication with the server 300 through various communication means. In various embodiments of the present application, the display device 200 may be allowed to be communicatively coupled to the server 300 via a local area network, a wireless local area network, or other network. The server 300 may provide various contents and interactions to the display apparatus 200.
Illustratively, the display device 200 receives software Program updates, or accesses a remotely stored digital media library by sending and receiving information, and Electronic Program Guide (EPG) interactions. The servers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.
The display device 200 may be a liquid crystal display, an Organic Light Emitting Diode (OLED) display, a projection display device, or an intelligent television. The particular display device type, size, aspect ratio, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.
The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a network TV, a smart TV, an Internet Protocol TV (IPTV), and the like.
As shown in fig. 1, the display device may be connected or provided with a camera, and is configured to present a picture taken by the camera on a display interface of the display device or other display devices, so as to implement interactive chat between users. Specifically, the picture shot by the camera can be displayed on the display device in a full screen mode, a half screen mode or any optional area.
As an optional connection mode, the camera is connected with the display rear shell through the connecting plate, is fixedly installed in the middle of the upper side of the display rear shell, and can be fixedly installed at any position of the display rear shell as an installable mode, so that an image acquisition area is ensured not to be shielded by the rear shell, for example, the display orientation of the image acquisition area is the same as that of the display equipment.
As another alternative connection mode, the camera is connected to the display rear shell through a connection board or other conceivable connector, the camera is capable of lifting, the connector is provided with a lifting motor, when a user wants to use the camera or an application program wants to use the camera, the camera is lifted out of the display, and when the camera is not needed, the camera can be embedded in the rear shell to protect the camera from being damaged.
As an embodiment, the camera adopted in the present application may have 1600 ten thousand pixels, so as to achieve the purpose of ultra high definition display. In actual use, cameras higher or lower than 1600 ten thousand pixels may also be used.
After the camera is installed on the display device, the contents displayed by different application scenes of the display device can be fused in various different modes, so that the function which cannot be realized by the traditional display device is achieved.
Illustratively, a user may conduct a video chat with at least one other user while watching a video program. The presentation of the video program may be as a background frame over which a window for video chat is displayed. The function is called 'chat while watching'.
Optionally, in a scene of "chat while watching", at least one video chat is performed across terminals while watching a live video or a network video.
In another example, a user can conduct a video chat with at least one other user while entering the educational application for learning. For example, a student may interact remotely with a teacher while learning content in an educational application. Vividly, this function can be called "chatting while learning".
In another example, a user conducts a video chat with a player entering a card game while playing the game. For example, a player may enable remote interaction with other players when entering a gaming application to participate in a game. Figuratively, this function may be referred to as "watch while playing".
Optionally, the game scene is fused with the video picture, the portrait in the video picture is scratched and displayed in the game picture, and the user experience is improved.
Optionally, in the motion sensing game (such as ball hitting, boxing, running and dancing), the human posture and motion, limb detection and tracking and human skeleton key point data detection are obtained through the camera, and then the human posture and motion, the limb detection and tracking and the human skeleton key point data detection are fused with the animation in the game, so that the game of scenes such as sports and dancing is realized.
In another example, a user may interact with at least one other user in a karaoke application in video and voice. Vividly, this function can be called "sing while watching". Preferably, when at least one user enters the application in a chat scenario, a plurality of users can jointly complete recording of a song.
In another example, a user may turn on a camera locally to take pictures and videos, figurative, which may be referred to as "looking into the mirror". The mirror application is an application newly added in the social television project, and the application supports the functions of camera image preview, face recognition, addition of a beauty filter, photographing, picture sharing and the like; the method of capturing images mentioned in this embodiment is implemented in a mirror application.
In other examples, more or less functionality may be added. The function of the display device is not particularly limited in the present application.
Fig. 2 is a block diagram illustrating a configuration of a software system in the display device 200 according to an exemplary embodiment.
As shown in fig. 2, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary between application programs and hardware components for performing data processing.
In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.
In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display, a camera, Flash, WiFi, and audio drivers.
The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.
A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.
The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.
Control applications 2911-4 for controlling process management, including runtime applications and the like.
The event transmission system 2914 may be implemented within the operating system 2911 or within the application 2912. In some embodiments, an aspect is implemented within the operating system 2911, while implemented in the application 2912, for listening for various user input events, and will implement one or more sets of predefined operations in response to various events referring to the recognition of various types of events or sub-events.
The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.
The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.
The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control apparatus 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting a gesture sub-event through gesture recognition, inputting a remote control key command of a control device and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.
The interface layout management module 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, which are related to the layout of the interface.
Fig. 3 is a diagram illustrating an application included in an application layer of a display device including various applications executable in the display device 200 according to an exemplary embodiment.
The application layer 2912 may include, but is not limited to, one or more applications such as: video-on-demand applications, application centers, gaming applications, etc., live television applications, media center applications, etc.
The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.
A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.
The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.
The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on a display device. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.
A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 4. As shown in fig. 4, the user interface includes a view display area 201, wherein, for example, the view display area 201 includes a layout of one or more different items. And a selector in the user interface indicating that the item is selected, the position of the selector being movable by user input to change the selection of a different item.
In some embodiments, the view display area 201 is a scalable view display. "scalable," may mean that the view display area 201 is scalable in size or proportion on the screen, or that the items in the view display 201 are scalable in size or proportion on the screen.
"item" refers to a visual object displayed in a view display area of a user interface in the display device 200 to represent corresponding content, such as icons, thumbnails, video clips, and the like. For example: the items may represent movies, image content or video clips of a television show, audio content of music, applications, or other user access content history information.
Further, the item may represent an interface or a collection of interfaces on which the display device 200 is connected to an external device, or may represent a name of an external device connected to the display device, or the like. Such as: a signal source input Interface set, or a High Definition Multimedia Interface (HDMI), a USB Interface, a PC terminal Interface, and the like.
It should be noted that: the view display area may present Video chat project content or application layer project content (e.g., web page Video, Video On Demand (VOD) presentations, application screens, etc.).
A "selector" is used to indicate where any item has been selected, such as a cursor or a focus object. Positioning the selection information input according to an icon or menu position touched by the user in the display 200 may cause movement of a focus object displayed in the display device 200 to select a control item, one or more of which may be selected or controlled.
The focus object refers to an object that moves between items according to user input. Illustratively, the focus object position is implemented or identified by drawing a thick line through the item edge. In other embodiments, the focus form is not limited to an example, and may be a form such as a cursor that is recognizable by the user, either tangible or intangible, such as in the form of a 3D deformation of the item, or may change the identification of the border lines, size, color, transparency, and outline and/or font of the text or image of the item in focus.
The event transmission system 2914, which may monitor user input for each predefined event or sub-event heard, provides control identifying the event or sub-event directly or indirectly to the interface layout management module 2913.
The interface layout management module 2913 is configured to monitor the state of the user interface (including the position and/or size of the view partition, the item, the focus or the cursor object, the change process, and the like), and according to the event or the sub-event, may perform a modification on the layout of the size and position, the hierarchy, and the like of the view display area, and/or adjust or modify the layout of the size or/and position, the number, the type, the content, and the like of the layout of various items in the view display area. In some embodiments, the layout is modified and adjusted, including displaying or not displaying the view sections or the content of the items in the view sections on the screen.
And a user input interface for transmitting an input signal of a user to the controller or transmitting a signal output from the controller to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may send an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by a user to the user input interface, and then the input signal is forwarded to the controller by the user input interface; alternatively, the control device may receive an output signal such as audio, video, or data output from the user input interface via the controller, and display the received output signal or output the received output signal in audio or vibration form.
In some embodiments, a user may input a user command on a Graphical User Interface (GUI) displayed on the display 200, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
FIG. 5 ~ 7 illustrates a schematic diagram of user interface interaction with a user in the display device 200 according to an exemplary embodiment, for example, as shown in FIG. 5 ~ 7, a plurality of different items are laid out in the view display area 201, for example, a preview screen is displayed in the first user interface 201-1 of the view display area 201, the preview screen is an image video stream obtained from a camera and intercepted according to the aspect ratio of the display, one frame preview screen of a shooting scene is displayed in FIG. 5 (the displayed preview screen has a plurality of frames, one frame is taken here for example), and as can be seen from FIG. 5, the image mode selected by the user is "storage scale-full screen" (the pixel ratio of the width and height is 16: 9), the user can click on "beauty filter", add or change the effect to the preview of the special effect screen, the selectable special effect includes beauty, filter, sticker, etc., the user can click on "view picture" to enter the center album, and when the user clicks on "take picture", the user interface changes to the special effect as shown in FIG. 6.
As shown in fig. 6, a frame of picture in an image data stream acquired when a user sends a "take picture" instruction is displayed on the first user interface 201-1, and at this time, the user may scan a shared picture, or may click "save" or take a picture again; when the user clicks "save", in response to the "save" instruction, the user interface changes to display the picture just saved in the second user interface 201-2 of the view display area 201 as shown in fig. 7. At this time, the user obtains a display scale of the television display area of 16: 9 picture.
In some exemplary embodiments, the preview screen is formed by continuously displaying, at a preset frame rate, the first user interface after the controller captures an image acquired by the camera according to a second aspect ratio, where the second aspect ratio is a display aspect ratio. Illustratively, the display aspect ratio is 16: 9, respectively.
In some exemplary embodiments, the first aspect ratio is an aspect ratio of an image acquired by the camera.
In some exemplary embodiments, the preview screen has a special effect, and may be implemented by passing the acquired data stream or image through an interface that calls a special effect algorithm.
In some exemplary embodiments, the image storage scale is full screen mode.
Fig. 8 illustrates an image capturing method according to an exemplary embodiment, including:
s101, starting a first user interface at a television end according to a user instruction;
s102, displaying a preview picture of a shooting scene of a camera at a television end on the first user interface, wherein the preview picture is obtained by the controller according to a second aspect ratio, the first aspect ratio image is captured by the camera, the preview picture is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
s103, when a photographing instruction is received, acquiring an image with a second aspect ratio of one frame in the preview picture, and displaying the image with the second aspect ratio on a display.
Illustratively, the first user interface is a preview interface and the second user interface is a photo presentation interface.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
Illustratively, the preset ratio is a pixel ratio of 16: 9; after a preview interface of the mirror application is started at the television end according to the instruction of a user, the camera takes the pixel ratio of the width to the height of an image as 4: 3 (the camera captures a video stream consisting of a plurality of frames of image data), in order to adapt the aspect ratio of the television to 16: 9, the system Hardware Abstraction Layer (HAL) is used for processing an original image shot by a camera according to the pixel ratio of 16: and 9, intercepting the image, performing compression coding on the intercepted image, and transmitting the image to an upper application (for example, a social television mirror application), wherein the upper application analyzes the image, and continuously displays the image on a preview interface at a certain frame rate (the frame rate value is not limited herein), so as to form a camera preview picture.
The mirror application is an application newly added in the social television project, and the application supports the functions of camera image preview, face recognition, special effect effects of adding a beauty filter and the like, photographing, picture sharing and the like.
In some exemplary embodiments, the preview screen has a special effect.
Exemplary special effects include beauty, filters, stickers, and the like. The preview picture can have a special effect or not; if a special effect needs to be added to the preview picture, the camera object is provided by a special effect algorithm; the method for adding the special effect to the video picture specifically comprises the following steps: outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface.
If no special effect needs to be added to the preview picture, the mirror application does not process the integrated special effect algorithm, and a Camera Camera object is directly created to control and manage the Camera. The Camera object is used for controlling a Camera switch, configuring Camera parameters, managing Camera start/stop preview, photographing and the like. Camera has many interfaces for managing cameras, configuring parameters, starting/stopping previews, etc. the takePicture interface is used to start the photograph.
For example, when a preview interface displays a preview screen of a shooting scene of a television camera, a user can select an image storage ratio to be in a full-screen mode, and can also increase or change a special effect of the preview screen; when a user clicks 'take a picture', a frame of image is acquired when a taking instruction of the user is received, the user interface is switched to a photo display interface from a preview interface, and the image is displayed on the photo display interface.
In some exemplary embodiments, the first aspect ratio is associated with an aspect ratio of image data captured by the camera, and the second aspect ratio is associated with an aspect ratio of a preview screen displayed in the display.
In some exemplary embodiments, the first aspect ratio is an aspect ratio of 4: 3.
In some exemplary embodiments, the second aspect ratio is an aspect ratio of 16: 9.
For example, when the image storage ratio is full-screen mode, the aspect ratio of the width and height of the image is 16: 9, the image resolution presented at the second user interface may be 1920 x 1080, for example.
Fig. 9 is a diagram illustrating a comparison of display scales of a camera shooting area and a television display area according to an exemplary embodiment, and it can be seen that an actual shooting area of a camera angle of view is larger than a television preview screen display area.
Fig. 10 is a flowchart illustrating a process of capturing an image of a display area of a tv in an exemplary embodiment, where, at a tv end, an instruction of a user to open a mirror application at the tv end is received, after entering a preview interface, a special effect algorithm interface is called, a control required for display is initialized, and a camera is started in a special effect algorithm, where the camera has a width-to-height pixel ratio of 4: 3, the original image is acquired in order to adapt to the width and height of the television to be 16: 9, HAL of the system to the original image in terms of width and height pixel ratio 16: intercepting in a ratio of 9, performing compression coding on the intercepted image, uploading the image to an upper layer application (for example, a mirror application), analyzing the image by the upper layer application, (as a camera acquires a video stream which consists of a plurality of frames of images), forming a video picture without any special effect by the analyzed image at a certain frame rate (the frame rate value is not limited herein), and outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface. If the storage ratio selected by the user is in a full-screen mode (the aspect ratio of the image is 16: 9), and a command of 'taking a picture' of the user is received, acquiring a frame of image of a current video preview picture through a special effect algorithm interface (the frame of image has a special effect), and informing the preview picture, wherein the user can see a Bitmap format image (or pictures in other formats) on the preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this point, the user obtains a 16: 9 picture of the television display area with special effects, which may be 1920 x 1080 resolution, for example). If no special effect is added to the video preview picture, the step of shooting the image of the television display area specifically comprises the following steps: receiving an instruction of a user for entering a Camera related application (such as opening a mirror application) at a television end, and obtaining a Camera Camera object (the object is used for controlling a Camera switch, configuring Camera parameters, managing start/stop preview of a Camera, taking a picture and the like) after entering a preview interface; the camera is 4 according to the pixel ratio of width and height: 3, the HAL of the system to the original image is 16: and intercepting the image in a ratio of 9, performing compression coding on the intercepted image, and uploading the image to an upper layer application (for example, a mirror application), wherein the upper layer application analyzes the image, (as a video stream is acquired by a camera, the video stream consists of a plurality of frames of images) and continuously displays the analyzed image on a preview interface at a certain frame rate (the frame rate value is not limited herein), so as to form a video preview picture. At this time, the user sees the formed video preview screen on the preview interface.
If the storage ratio selected by the user is in a full-screen mode (the aspect ratio of the image is 16: 9), and a command of 'taking a picture' of the user is received, a frame of image of a current video preview picture is obtained (the frame of image does not have a special effect), and the user can see a Bitmap format image (or pictures in other formats) on a preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this point, the user obtains a 16: 9 aspect ratio photograph of the television display area without special effects, which may be 1920 x 1080 resolution, for example.
In some embodiments, when the user clicks to take a picture, one frame of image in the preview screen is acquired, the first user interface including the preview screen is quitted from being displayed, and the display displays the image with the second aspect ratio.
The following steps exemplarily show taking an image with or without special effect in the visible area of the camera:
another display device is provided in an exemplary embodiment of the present application, including:
a display configured to display a user interface, wherein the user interface comprises a view display area, wherein the view display area comprises a layout of one or more different items, and a selector indicating that the item is selected, wherein the position of the selector in the user interface can be moved by user input to cause the different item to be selected;
a controller in communication with the display, the controller configured to perform presenting the user interface;
the controller displays a first user interface of the view display area on the display according to an instruction of a user for opening the camera;
acquiring an image according to a first aspect ratio through a camera, and forming a preview picture of the image on the first user interface according to a second aspect ratio;
if the image aspect ratio selected by the user is the first aspect ratio, and when the controller receives an instruction for acquiring the image, the preview picture is stopped, and meanwhile, the camera is called to acquire the image according to the first aspect ratio and display the image on the second user interface of the view display area.
In some exemplary embodiments, the method further comprises:
displaying a first user interface of the view display area on a display according to an instruction of a user for opening a camera;
acquiring an image according to a first aspect ratio through a camera in a special effect algorithm, adding a special effect to the image with the first aspect ratio, and forming a preview picture on the first user interface according to a second aspect ratio;
if the image aspect ratio selected by the user is the first aspect ratio, and when an instruction for acquiring the image is received, stopping the preview picture, simultaneously calling the camera to acquire the image according to the first aspect ratio, and adding a special effect to be displayed on a second user interface of the view display area.
FIG. 11 ~ 13 illustrates a user interface interacting with a user in the display device 200 according to another exemplary embodiment, for example, in FIG. 11 ~ 13, a plurality of different items are laid out in the view display area 201, for example, a preview image of a shooting scene of a television camera is displayed in the first user interface 201-3 of the view display area 201, a preview image of one frame of the shooting scene is displayed in FIG. 11 (the displayed preview image has a plurality of frames, one frame is taken here for example), and as can be seen from FIG. 11, the image mode selected by the user is "storage scale-standard" (the ratio of pixels of image width and height is 4: 3), the user can click on "beauty filter" to add or change special effects to the preview image, the selectable effects include beauty, filter, sticker, etc., the user can also click on "view picture of a picture", and when the user clicks on "photograph", the user interface changes to the special effects as shown in FIG. 12 in response to a photograph instruction.
As shown in fig. 12, a picture of the last frame before the user sends the "take picture" instruction is displayed on the first user interface 201-3, at this time, the user may scan the shared picture, or click "save" or take picture again; when the user clicks "save", in response to the "save" instruction, the user interface changes to display the picture just saved in the second user interface 201-4 of the view display area 201 as shown in fig. 13. At this time, the display scale of the image obtained by the user, which is the display area of the camera, is 4: 3.
In some exemplary embodiments, a control signal input from a user input interface indicating that turning on or off of the camera is enabled is received;
responding to user input for starting the camera, presenting a first user interface in the display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first aspect ratio image collected by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
and receiving user input of selecting and indicating to acquire pictures in the first user interface through the selector by a user, responding to the user input, acquiring a first image of a first aspect ratio acquired currently by the camera, keeping a preview picture in the first user interface still for display, and displaying the first image of the first aspect ratio by the display.
In some exemplary embodiments, a control signal input from a user input interface indicating that turning on or off of the camera is enabled is received;
and responding to user input for starting the camera, presenting a first user interface in the display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first aspect ratio image collected by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio.
In some exemplary embodiments, acquiring an image according to a first aspect ratio through a camera, and forming a preview screen on the first user interface according to a second aspect ratio by using the image specifically includes:
and after the image data of the first aspect ratio acquired by the camera is intercepted according to the second aspect ratio, continuously displaying the image data on the first user interface according to a preset frame rate to form a preview picture.
Illustratively, the second aspect ratio is the display scale 16 of the display: 9.
in some exemplary embodiments, the preview screen has a special effect.
In some exemplary embodiments, after the controller receives a user input indicating to take a picture selected in the first user interface by the selector, specifically performing:
and responding to the user input, acquiring a first image of a first aspect ratio currently acquired by the camera, keeping a preview picture in the first user interface still for displaying, and displaying the first image of the first aspect ratio by a display.
In some exemplary embodiments, after the controller receives a user input indicating to take a picture selected in the first user interface by the selector, specifically performing:
and responding to the user input, acquiring a first image of a first aspect ratio currently acquired by the camera, keeping a preview picture in the first user interface still for display, quitting displaying the first user interface comprising the preview picture, and displaying the first image of the first aspect ratio by a display.
For example, an image of the camera visible area is displayed on the second user interface 201-4 (photo presentation interface), and the aspect ratio of the image is 4: 3. illustratively, the image resolution is, for example, 4656 x 3496 (which may be set to other values as well).
In some exemplary embodiments, the first aspect ratio is an aspect ratio corresponding to the user-selected image storage ratio in the standard mode.
In some exemplary embodiments, after the controller finishes photographing the currently displayed picture of the first user interface, the controller adds a special effect to the obtained image, and displays the image with the added special effect on the second user interface.
Illustratively, the photographed image is returned to the special effect algorithm to add the special effect, and the image with the special effect added is displayed on the second user interface 201-4.
Fig. 14 illustrates another image capturing method according to an exemplary embodiment, including:
s201, starting a first user interface at a television end according to a user instruction;
s202, displaying a preview picture of a shooting scene of a television camera on the first user interface;
s203, when a photographing instruction is received, acquiring a first image of a first aspect ratio acquired currently by the camera, keeping a preview picture in the first user interface still for display, and displaying the first image of the first aspect ratio by a display.
Illustratively, the first user interface is a preview interface and the second user interface is a photo presentation interface.
In some exemplary embodiments, the preview screen is a scaled screen. The predetermined ratio is a second aspect ratio.
In some exemplary embodiments, the preview screen has a special effect.
Exemplary special effects include beauty, filters, stickers, and the like.
Illustratively, the first aspect ratio is 4: 3-scale (image specific resolution aspect ratio of, for example, 4656 x 3496); and displaying the image in the second user interface as a camera display area image. The image may be an image with or without a special effect.
In some exemplary embodiments, the first aspect ratio is an aspect ratio corresponding to the user-selected image storage ratio in the standard mode.
Fig. 15 is a flowchart illustrating a process of capturing an image of a display area of a camera according to an exemplary embodiment, where, at a television, an instruction of a user to open a mirror application at the television is received, the camera is started, a control required for display is initialized, image data acquired by the camera is cut into a size suitable for display on a display, and a preview interface is entered. If the special effect picture needs to be displayed, the intercepted data stream calls a special effect algorithm interface, and a preview picture with a special effect is presented.
Specifically, the camera is a camera with a width and height pixel ratio of 4: 3, the original image is acquired in order to adapt to the width and height of the television to be 16: 9, HAL of the system to the original image in terms of width and height pixel ratio 16: intercepting in a ratio of 9, performing compression coding on the intercepted image, uploading the image to an upper layer application (for example, a mirror application), analyzing the image by the upper layer application, (as a camera acquires a video stream which consists of a plurality of frames of images), forming a video picture without any special effect by the analyzed image at a certain frame rate (the frame rate value is not limited herein), and outputting the video picture to a texture control; illustratively, a special effect algorithm identifies a human face on the texture control TextureView, adds special effect effects such as filter stickers and the like, superimposes the added special effect on the video image texture without any special effect, and synthesizes a new texture; and outputting the synthesized texture to a display control, so that a user can see a video preview picture with special effects on a preview interface.
If the storage ratio selected by the user is in the standard mode (the image aspect ratio is 4: 3), displaying the preview image according to the 1920-1080 preview resolution; and receiving a 'photographing' instruction of a user, stopping the interception and special effect processing of the image data acquired by the camera, and returning to a camera object (the camera is not in the application of a preview algorithm; calling a takePicture interface of the camera to photograph, automatically stopping a preview picture, and at the moment, the user sees one frame of a multi-frame picture when the photographing instruction is executed, wherein the camera object is used for controlling a camera switch, configuring camera parameters, managing the start/stop of the camera for previewing, photographing and the like); then calling a takePicture interface, starting photographing, generating an original photo obtained by a camera, calling a special effect algorithm to add a special effect to the photo, generating a photo with a special effect, and informing a preview interface, so that a user can see a Bitmap format image (or pictures with other formats) on the preview interface; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this time, the user obtains an aspect ratio with special effect of the visible area of the camera as 4: 3, for example, may be 4656 x 3496 resolution.
If no special effect is added to the video preview picture and the image finally obtained by the user does not have the special effect, the step of shooting the image in the display area of the camera specifically comprises the following steps: and at the television end, receiving an instruction of opening a mirror application at the television end by a user, starting a camera, initializing a control required for display, intercepting image data acquired by the camera into a size suitable for display of a display, and entering a preview interface. After entering a preview interface, a Camera object (the object 1 is used for controlling a Camera switch, configuring Camera parameters, managing Camera start/stop previewing, photographing and the like) is obtained.
The user selects the "store scale-standard" mode (4: 3 pixel ratio for image width and height), still displaying the preview image at 1920 x 1080 preview resolution; when a user clicks a 'photographing' instruction, firstly keeping a preview picture in static display and returning to a camera object (when a takePicture interface of the camera is called for photographing, the preview picture can be automatically kept in static, and at the moment, the user sees a frame of picture during photographing, wherein the camera object is used for controlling a camera switch, configuring camera parameters, managing the start/stop of the camera for previewing, photographing and the like); then calling a takePicture interface, starting to take a picture, and after the picture is taken, a user can see a Bitmap-format image (or pictures in other formats) on a second user interface, wherein the image is a picture of an actual visible area of the camera; when a command that a user clicks 'save' is received, responding to the 'save' command, switching the user interface from the preview interface to a photo display interface, and displaying a photo on the photo display interface; at this time, the user obtains an aspect ratio without special effect of the visible area of the camera as 4: 3, for example, may be 4656 x 3496 resolution.
By the method, the television-end camera displays the preview picture at 1920-1080 resolution, and when a user takes a picture, the corresponding image with the aspect ratio is obtained according to the image storage ratio (full screen or standard) selected by the user; specifically, when the image storage ratio selected by the user is full-screen mode, the ratio of the pixel width and height of the television display area is obtained as 16: 9, obtaining an image with a resolution of 1920 × 1080, when the image storage ratio selected by the user is in the standard mode, the pixel width and height of the visible area of the camera are 4: 3, resolution is for example 4656 x 3496 images. That is, the user can obtain photographs of different aspect ratios and different shooting angles by simply switching.
Accordingly, on the device side, a display apparatus according to an exemplary embodiment is exemplarily shown in fig. 16, including:
a first unit 11 that collects ambient environment data at a first aspect ratio;
a second unit 12, configured to start a first user interface at a television according to a user instruction, and display a preview image of a shooting scene of a camera at the television on the first user interface, where the preview image is obtained by the controller according to a second aspect ratio, where the first aspect ratio is captured by the camera, and is displayed according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
and a third unit 13, configured to, when a photographing instruction is received, convert a currently displayed picture of the second aspect ratio of the preview picture into an image, or acquire an image of the first aspect ratio acquired by the camera and display the image on a second user interface.
Another display device according to an exemplary embodiment is exemplarily shown in fig. 17, including:
an acquisition unit 21 that acquires ambient environment data at a first aspect ratio;
the preview unit 22 is configured to start a first user interface at a television according to a user instruction, display a preview image of a shooting scene of a camera at the television on the first user interface, where the preview image is obtained by the controller according to a second aspect ratio, where the first aspect ratio is captured by the camera, and is displayed according to the second aspect ratio and a preset frame rate, where the second aspect ratio is different from the first aspect ratio;
and the display unit 23 is configured to, when a photographing instruction is received, convert a currently displayed image of the second aspect ratio of the preview image into an image, or acquire the image of the first aspect ratio acquired by the camera and display the image on a second user interface.
Also exemplarily shown in fig. 18 is a display device according to an exemplary embodiment, including:
a processor 800 for reading the program in the memory 810 and executing the following processes:
starting a first user interface at a television according to a user instruction, displaying a preview picture of a shooting scene of a camera at the television on the first user interface, wherein the preview picture is obtained by intercepting a first aspect ratio image collected by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
and receiving user input of selecting and indicating to acquire pictures in the first user interface through the selector by a user, responding to the user input, acquiring a first image of a first aspect ratio acquired currently by the camera, keeping a preview picture in the first user interface still for display, and displaying the first image of the first aspect ratio by the display.
In some exemplary embodiments, the preview screen is a screen cut at a preset scale.
In some exemplary embodiments, the preview screen has a special effect.
In some exemplary embodiments, after the picture currently displayed on the first user interface is photographed, a special effect is added to the obtained image, and the image with the added special effect is displayed on the second user interface.
In fig. 18, among other things, the bus architecture may include any number of interconnected buses and bridges with various circuits linking together, one or more processors represented by processor 800 and memory represented by memory 810. The bus architecture may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The bus interface provides an interface.
The exemplary embodiments of the present application provide a display terminal, which may be specifically a desktop computer, a portable computer, a smart phone, a tablet computer, a Personal Digital Assistant (PDA), and the like. The Display terminal may include a Central Processing Unit (CPU), a memory, an input/output device, etc., the input device may include a keyboard, a mouse, a touch screen, etc., and the output device may include a Display device, such as a Liquid Crystal Display (LCD), a Cathode Ray Tube (CRT), etc.
For different display terminals, in some exemplary embodiments, the user interfaces 620, 820 may be interfaces capable of interfacing externally to desired devices including, but not limited to, keypads, displays, speakers, microphones, joysticks, and the like.
The processor is responsible for managing the bus architecture and general processing, and the memory may store data used by the processor 600 in performing operations.
In some exemplary embodiments, the processor may be a CPU (central processing unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable gate array), or a CPLD (Complex Programmable Logic Device).
The memory may include Read Only Memory (ROM) and Random Access Memory (RAM), and provides the processor with program instructions and data stored in the memory. In the embodiments of the present application, the memory may be used to store a program of any of the methods provided in the exemplary embodiments of the present application.
The processor is configured to execute any of the methods provided in the exemplary embodiments of the present application in accordance with the obtained program instructions by calling the program instructions stored in the memory.
The present application provides, in an exemplary embodiment, a computer storage medium for storing computer program instructions for an apparatus provided in the above-mentioned embodiment of the present application, which includes a program for executing any one of the methods provided in the above-mentioned embodiment of the present application.
The computer storage media may be any available media or data storage device that can be accessed by a computer, including, but not limited to, magnetic memory (e.g., floppy disks, hard disks, magnetic tape, magneto-optical disks (MOs), etc.), optical memory (e.g., CDs, DVDs, BDs, HVDs, etc.), and semiconductor memory (e.g., ROMs, EPROMs, EEPROMs, non-volatile memory (NAND FLASH), Solid State Disks (SSDs)), etc.
In summary, the exemplary embodiments of the present application provide a display device, so that an image is captured and displayed according to an aspect ratio set by a user at a television end. Specifically, when the image mode selected by the user is a full-screen mode (16: 9), shooting an image of a television visible area at the television end and displaying the image; when the image mode selected by the user is the standard mode (4: 3), shooting the image of the visible area of the camera at the television end and displaying the image; therefore, the user can obtain the photos with different aspect ratios and different shooting visual angles through simple switching.
As will be appreciated by one skilled in the art, the present application in exemplary embodiments may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.
It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.
Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A display device, comprising:
the camera is used for acquiring image data acquired by the first aspect ratio;
a display configured to display an image screen and a user interface, and a selector in the user interface to indicate that an item is selected in the user interface;
a controller in communication with the display, the controller configured to:
receiving a control signal input from a user input interface and indicating to start the opening or closing of the camera;
responding to user input for starting the camera, presenting a first user interface in the display, wherein the first user interface comprises a preview picture, the preview picture is obtained by intercepting the first aspect ratio image collected by the camera according to a second aspect ratio by the controller, and is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
and receiving user input of selecting and indicating to acquire pictures in the first user interface through the selector by a user, responding to the user input, acquiring a first image of a first aspect ratio acquired currently by the camera, keeping a preview picture in the first user interface still for display, and displaying the first image of the first aspect ratio by the display.
2. The display device according to claim 1, wherein the receiving, after selecting the user input indicating to take the picture in the first user interface through the selector, is further configured to perform:
and responding to the user input, acquiring a first image of a first aspect ratio currently acquired by the camera, keeping a preview picture in the first user interface still for display, quitting displaying the first user interface comprising the preview picture, and displaying the first image of the first aspect ratio by a display.
3. The display device of claim 1, wherein the presenting a first user interface in the display in response to the user input activating the camera comprises:
acquiring image data of a first aspect ratio acquired by a camera;
intercepting the data of the first aspect ratio according to a second aspect ratio to obtain image data of the second aspect ratio;
calling a special effect algorithm interface, and carrying out special effect processing on the intercepted image data with the second aspect ratio;
and presenting the image data of the second aspect ratio subjected to the special effect processing on a display.
4. The display device of claim 1, wherein the controller receives a user input indicating that a picture is to be taken by a user selecting in the first user interface through the selector, and in response to the user input, obtains a first image of a first aspect ratio currently captured by the camera, and keeps a preview screen in the first user interface still for display, and then further performs:
and carrying out special effect processing on the acquired first image, and displaying the first image subjected to the special effect processing by a display.
5. An image capturing method, characterized by comprising:
receiving a control signal input from a user input interface and indicating to start the opening or closing of the camera;
responding to user input for starting the camera, presenting a first user interface in the display, wherein the first user interface comprises a preview picture, the preview picture is obtained by the controller according to a second aspect ratio and the first aspect ratio image collected by the camera is intercepted, and the preview picture is displayed according to the second aspect ratio and a preset frame rate, and the second aspect ratio is different from the first aspect ratio;
and receiving user input of selecting and indicating to acquire pictures in the first user interface through the selector by a user, responding to the user input, acquiring a first image of a first aspect ratio acquired currently by the camera, and ensuring a preview picture in the first user interface to be displayed still, wherein the first image of the first aspect ratio is displayed by the display.
6. The method of claim 5, wherein after performing the receiving of the user input indicating that a picture is taken is selected in the first user interface by the selector, further comprising:
and responding to the user input, acquiring a first image of a first aspect ratio currently acquired by the camera, keeping a preview picture in the first user interface still for display, then quitting displaying the first user interface comprising the preview picture, and displaying the first image with the first aspect ratio by a display.
7. The method of claim 5, wherein said presenting a first user interface in the display in response to a user input that activates the camera comprises:
displaying a first user interface on a display according to an instruction of a user for opening a camera;
the method comprises the steps of obtaining an image according to a first aspect ratio through a camera in a special effect algorithm, adding a special effect to the image, and forming a preview picture on a first user interface according to a second aspect ratio.
8. The method of claim 5, wherein: after receiving a user input indicating that a picture is acquired by a user through the selector in the first user interface, acquiring a first image with a first aspect ratio currently acquired by the camera in response to the user input, and keeping a preview picture in the first user interface still, the method further comprises:
and carrying out special effect processing on the acquired first image, and displaying the first image subjected to the special effect processing by a display.
9. A computing device, comprising:
a memory for storing program instructions;
a processor for calling program instructions stored in said memory to execute the method of any of claims 6 ~ 8 in accordance with the obtained program.
10. A computer storage medium having stored thereon computer-executable instructions for causing a computer to perform the method of any one of claims 6 to 8.
CN201910878161.3A 2019-06-10 2019-09-17 Display device Pending CN110636354A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/079701 WO2020248640A1 (en) 2019-06-10 2020-03-17 Display device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2019104975639 2019-06-10
CN201910497563 2019-06-10

Publications (1)

Publication Number Publication Date
CN110636354A true CN110636354A (en) 2019-12-31

Family

ID=68971130

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201910877523.7A Pending CN112073765A (en) 2019-06-10 2019-09-17 Display device
CN201910878161.3A Pending CN110636354A (en) 2019-06-10 2019-09-17 Display device
CN201910877525.6A Active CN110636353B (en) 2019-06-10 2019-09-17 Display device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201910877523.7A Pending CN112073765A (en) 2019-06-10 2019-09-17 Display device

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201910877525.6A Active CN110636353B (en) 2019-06-10 2019-09-17 Display device

Country Status (2)

Country Link
CN (3) CN112073765A (en)
WO (1) WO2020248640A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111917998A (en) * 2020-08-12 2020-11-10 惠州市康冠科技有限公司 GPUImgae-based smart television special-effect camera generation method and device and smart television
WO2020248640A1 (en) * 2019-06-10 2020-12-17 海信视像科技股份有限公司 Display device
CN112261289A (en) * 2020-10-16 2021-01-22 海信视像科技股份有限公司 Display device and AI algorithm result acquisition method
CN113497979A (en) * 2020-03-20 2021-10-12 佛山市云米电器科技有限公司 Interface mode display method, cloud server, television, system and storage medium

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314606B (en) * 2020-02-21 2021-06-18 Oppo广东移动通信有限公司 Photographing method and device, electronic equipment and storage medium
CN114513690B (en) * 2020-10-27 2024-04-05 海信视像科技股份有限公司 Display device and image acquisition method
CN114650363B (en) * 2020-12-18 2023-07-21 华为技术有限公司 Image display method and electronic equipment
CN112822556B (en) * 2020-12-31 2022-11-15 上海米哈游天命科技有限公司 Game picture shooting method, device, equipment and storage medium
CN114339358A (en) * 2021-04-16 2022-04-12 海信视像科技股份有限公司 Dynamic processing method of shutdown selection interface and display device
CN113099308B (en) * 2021-03-31 2023-10-27 聚好看科技股份有限公司 Content display method, display equipment and image collector
CN115474073B (en) * 2021-06-11 2023-12-12 上海赛连信息科技有限公司 Method and device for intelligently switching picture layout
CN113112407B (en) * 2021-06-11 2021-09-03 上海英立视电子有限公司 Method, system, device and medium for generating field of view of television-based mirror
CN115809957A (en) * 2021-09-13 2023-03-17 北京字跳网络技术有限公司 Image processing method and apparatus
CN113938587B (en) * 2021-09-14 2024-03-15 青岛海信移动通信技术有限公司 Double-camera-based shooting method and electronic equipment
CN113971048A (en) * 2021-10-29 2022-01-25 Oppo广东移动通信有限公司 Application program starting method and device, storage medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104270579A (en) * 2014-09-24 2015-01-07 青岛海信移动通信技术股份有限公司 Terminal application interface pixel adjusting method and terminal
CN106293589A (en) * 2016-08-31 2017-01-04 宇龙计算机通信科技(深圳)有限公司 A kind of the method for preview resolution, device and terminal are set
CN106506932A (en) * 2015-09-08 2017-03-15 中兴通讯股份有限公司 The acquisition methods and device of image
CN106937043A (en) * 2017-02-16 2017-07-07 奇酷互联网络科技（深圳）有限公司 The method and apparatus of mobile terminal and its image procossing
WO2018088730A1 (en) * 2016-11-08 2018-05-17 Samsung Electronics Co., Ltd. Display apparatus and control method thereof

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8549442B2 (en) * 2005-12-12 2013-10-01 Sony Computer Entertainment Inc. Voice and video control of interactive electronically simulated environment
CN101510970A (en) * 2009-03-27 2009-08-19 四川长虹电器股份有限公司 Method for displaying 4:3 image on a 16:9 television
KR20110126346A (en) * 2010-05-17 2011-11-23 엘지전자 주식회사 Method of providing definition selection menu and broadcasting receiving apparatus
CN102681302A (en) * 2011-03-17 2012-09-19 天津三星光电子有限公司 Method and device for selecting image composition automatically and self-timing shoot and photographic device
JP5310837B2 (en) * 2011-12-28 2013-10-09 カシオ計算機株式会社 Image generating apparatus, digital camera, method, and program
KR101917650B1 (en) * 2012-08-03 2019-01-29 삼성전자 주식회사 Method and apparatus for processing a image in camera device
CN102957901B (en) * 2012-11-19 2016-05-18 天津三星电子有限公司 A kind of display system
US10168882B2 (en) * 2013-06-09 2019-01-01 Apple Inc. Device, method, and graphical user interface for switching between camera interfaces
CN103414945A (en) * 2013-07-17 2013-11-27 深圳Tcl新技术有限公司 Method and device for automatically clipping and displaying target image
CN103618933A (en) * 2013-11-28 2014-03-05 青岛海信电器股份有限公司 Method and device for displaying application interface images self-adaptively
KR102271853B1 (en) * 2014-03-21 2021-07-01 삼성전자주식회사 Electronic apparatus, image processing method, and computer-readable recording medium
CN104333701B (en) * 2014-11-28 2017-04-26 广东欧珀移动通信有限公司 Method and device for displaying camera preview pictures as well as terminal
US10748264B2 (en) * 2015-09-09 2020-08-18 Sony Corporation Image processing apparatus and image processing method
CN205378145U (en) * 2016-02-04 2016-07-06 许阳振 Electronic mirror
US20170302844A1 (en) * 2016-04-13 2017-10-19 Canon Kabushiki Kaisha Image capturing apparatus, control method therefor, and storage medium
CN105915872B (en) * 2016-06-06 2017-12-29 苏州佳世达光电有限公司 The output intent and projection arrangement of image
CN106339705B (en) * 2016-08-16 2019-07-02 北京小米移动软件有限公司 Image acquisition method and device
CN106331488A (en) * 2016-08-25 2017-01-11 天脉聚源(北京)传媒科技有限公司 Interface adjusting method and device
CN106657761A (en) * 2016-09-29 2017-05-10 乐视控股（北京）有限公司 Picture shooting method and device for intelligent terminal
CN106896999A (en) * 2017-01-06 2017-06-27 广东小天才科技有限公司 The mirror analogy method and device of a kind of mobile terminal
CN107155059A (en) * 2017-04-11 2017-09-12 深圳市金立通信设备有限公司 A kind of image preview method and terminal
KR102289716B1 (en) * 2017-08-01 2021-08-17 삼성디스플레이 주식회사 Display apparatus and method of driving the same
CN111213363A (en) * 2017-10-13 2020-05-29 深圳传音通讯有限公司 Terminal photographing control method, mobile terminal and readable storage medium
CN108337442A (en) * 2018-05-14 2018-07-27 Oppo广东移动通信有限公司 Shooting preview display methods, device, terminal and storage medium
CN108737732A (en) * 2018-06-04 2018-11-02 成都依能科技股份有限公司 A method of give a definition static high-definition image shooting area in dynamic image preview
CN109302629B (en) * 2018-08-27 2021-07-06 海信视像科技股份有限公司 Method for switching picture frames for pictures and display terminal
CN109120997A (en) * 2018-09-30 2019-01-01 北京微播视界科技有限公司 Method for processing video frequency, device, terminal and medium
CN109460174A (en) * 2018-11-09 2019-03-12 维沃移动通信有限公司 A kind of information processing method and terminal device
CN109547700A (en) * 2018-12-27 2019-03-29 维沃移动通信有限公司 Photographic method and terminal
CN112073765A (en) * 2019-06-10 2020-12-11 海信视像科技股份有限公司 Display device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104270579A (en) * 2014-09-24 2015-01-07 青岛海信移动通信技术股份有限公司 Terminal application interface pixel adjusting method and terminal
CN106506932A (en) * 2015-09-08 2017-03-15 中兴通讯股份有限公司 The acquisition methods and device of image
CN106293589A (en) * 2016-08-31 2017-01-04 宇龙计算机通信科技(深圳)有限公司 A kind of the method for preview resolution, device and terminal are set
WO2018088730A1 (en) * 2016-11-08 2018-05-17 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
CN106937043A (en) * 2017-02-16 2017-07-07 奇酷互联网络科技（深圳）有限公司 The method and apparatus of mobile terminal and its image procossing

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020248640A1 (en) * 2019-06-10 2020-12-17 海信视像科技股份有限公司 Display device
CN113497979A (en) * 2020-03-20 2021-10-12 佛山市云米电器科技有限公司 Interface mode display method, cloud server, television, system and storage medium
CN111917998A (en) * 2020-08-12 2020-11-10 惠州市康冠科技有限公司 GPUImgae-based smart television special-effect camera generation method and device and smart television
CN112261289A (en) * 2020-10-16 2021-01-22 海信视像科技股份有限公司 Display device and AI algorithm result acquisition method

Also Published As

Publication number Publication date
WO2020248640A1 (en) 2020-12-17
CN110636353A (en) 2019-12-31
CN110636353B (en) 2022-09-02
CN112073765A (en) 2020-12-11

Similar Documents

Publication Publication Date Title
CN110636353B (en) Display device
CN110611787B (en) Display and image processing method
CN112073798B (en) Data transmission method and equipment
CN112399212A (en) Display device, file sharing method and server
CN114296949A (en) Virtual reality equipment and high-definition screen capturing method
CN112073788A (en) Video data processing method and device and display equipment
CN112073770B (en) Display device and video communication data processing method
CN112399263A (en) Interaction method, display device and mobile terminal
CN112073778A (en) Display device and fault-tolerant method for key transmission
CN112073662A (en) Display device
CN112399233A (en) Display device and position self-adaptive adjusting method of video chat window
CN112068987A (en) Method and device for rapidly restoring factory settings
CN112463267B (en) Method for presenting screen saver information on display device screen and display device
CN112788378A (en) Display apparatus and content display method
CN112073790A (en) Display device and method for synchronizing starting state between two systems
CN112073663A (en) Audio gain adjusting method, video chatting method and display equipment
CN112073777B (en) Voice interaction method and display device
CN112073812B (en) Application management method on smart television and display device
WO2020248682A1 (en) Display device and virtual scene generation method
CN112399235A (en) Method for enhancing photographing effect of camera of smart television and display device
CN112073776A (en) Voice control method and display device
CN112073773A (en) Screen interaction method and device and display equipment
CN112071338A (en) Recording control method and device and display equipment
CN112399223B (en) Method for improving moire fringe phenomenon and display device
CN112073779B (en) Display device and fault-tolerant method for key transmission

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant after: Hisense Visual Technology Co., Ltd.

Address before: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20191231