WO2024152137A1 - 一种实现座舱影院观影特效的方法、装置、系统及车辆 - Google Patents

一种实现座舱影院观影特效的方法、装置、系统及车辆 Download PDF

Info

Publication number
WO2024152137A1
WO2024152137A1 PCT/CN2023/072244 CN2023072244W WO2024152137A1 WO 2024152137 A1 WO2024152137 A1 WO 2024152137A1 CN 2023072244 W CN2023072244 W CN 2023072244W WO 2024152137 A1 WO2024152137 A1 WO 2024152137A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
display unit
special effect
type
effect data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/072244
Other languages
English (en)
French (fr)
Inventor
吕冯麟
夏沛
周锦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to PCT/CN2023/072244 priority Critical patent/WO2024152137A1/zh
Priority to CN202380074420.1A priority patent/CN120239970A/zh
Publication of WO2024152137A1 publication Critical patent/WO2024152137A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance

Definitions

  • the present application relates to the field of intelligent vehicles, and in particular to a method, device, system and vehicle for realizing special effects of viewing movies in a cockpit theater.
  • the present application provides a method, device, system and vehicle for realizing special effects of watching movies in a cabin theater, which helps to enhance the immersive experience of users watching movies in the cabin.
  • the present application provides a method for realizing special effects for watching movies in a cabin theater, the method comprising: obtaining video picture content played by a first display unit, the first display unit belonging to a first category of display units, the first category of display units including one or more display units; performing effect processing on the video picture content to obtain special effect data, the special effect data being used to display one or more special effects; outputting the special effect data to one or more other display units in the first category of display units except the first display unit, so that the one or more other display units display a first special effect according to the special effect data.
  • the first type of display unit includes an image display device in the cockpit, and the image display device includes a display screen in the cockpit, for example, a first display unit, which can be a cockpit central control screen, and the image display device can also include an instrument display screen, a display screen in front of the passenger on the co-pilot seat (also called the front passenger), a display screen in front of the left rear passenger, a display screen in front of the right rear passenger, and other in-cabin display devices.
  • the cockpit central control screen is playing a movie
  • the video screen content in the central control screen is processed by effects to obtain special effect data, which includes one or more special effects, and then the special effect data is output to other display devices in the first type of display unit.
  • This implementation method can make full use of the display devices in the cockpit, create a cockpit theater viewing atmosphere, and enhance the user's viewing experience.
  • different display units in the first type of display units can display different special effects, which can further enhance the atmosphere and immersion.
  • the processing includes one or more of the following: cropping, stretching, blurring, gradient, extracting picture elements, and extracting main colors.
  • the method further includes outputting the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.
  • the second type of display unit may include one or more ambient lights in the cockpit, and the special effect data may be output to the ambient lights, which will then present the lighting effects and enhance the viewing atmosphere.
  • the outputting of the special effect data to one or more second-category display units includes outputting the special effect data to a control module so that the control module controls the display of one or more second-category display units according to the special effect data.
  • the second-category display unit may include an ambient light in the cabin, and the special effect data is output to the control module of the ambient light, and the control module further regulates and optimizes the display effect of the ambient light, for example, further adjusting the presentation effect of the special effect according to the surrounding environment to enhance the viewing atmosphere.
  • the audio features include amplitude and/or frequency.
  • the audio features are output to the control module of the ambient light, which adjusts the brightness of the ambient light according to the amplitude of the audio, and adjusts the flashing speed of the ambient light according to the frequency of the audio, and then combines the lighting effects of the ambient light to create a soothing or tense atmosphere corresponding to the video being played, thereby enhancing the user's viewing experience.
  • different display units in the second type of display unit may have the same or different special effects.
  • the ambient light surrounds the cockpit, and ambient lights in different positions may display different special effects, which may further enhance the ambient experience.
  • the present application provides a device, comprising: an acquisition module, used to acquire video screen content played by a first display unit, the first display unit belongs to a first category of display units, and the first category of display units includes one or more display units; a processing module, used to perform effect processing on the video screen content to obtain special effect data, and the special effect data is used to display one or more special effects; an output module, used to output the special effect data to one or more other display units in the first category of display units except the first display unit, so that the one or more other display units display the first special effect according to the special effect data.
  • the processing module performs one or more of the following effects on the video picture content: cropping, stretching, blurring, gradient, extracting picture elements, and extracting main colors.
  • the output module is further configured to output the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.
  • the device further includes a control module, the output module outputs the special effect data to the control module, and the control module is used to receive the special effect data and control the display of one or more second-type display units according to the special effect data.
  • the acquisition module is further used to acquire the audio content played by the first display unit; the processing module is further used to extract audio features according to the audio content; the output module is further used to output the audio features to the control module, and the control module controls the display of the one or more second-type display units according to the special effect data and the audio features.
  • the audio features include amplitude and/or frequency.
  • the second type of display unit includes an atmosphere light.
  • the atmosphere light includes a first atmosphere light and a second atmosphere light, and the first atmosphere light and the second atmosphere light have different lighting effects.
  • the first type of display unit includes an image display device.
  • the image display device includes the first display unit, a second display unit, and a third display unit, and the second display unit and the third display unit have different image special effects.
  • the present application provides a device, comprising a processor and a memory, wherein the processor is configured to read a computer program stored in the memory so that the device executes the method described in the first aspect or any of the methods described in the first aspect.
  • the present application provides a display system, including a computing platform and a display device, wherein the computing platform includes the device as described in the second aspect or the third aspect, and the display device includes a first type of display unit, wherein the first type of display unit is used to display a first special effect according to the special effect data output by the computing platform, and the first type of display unit includes one or more display units. Further, in a possible implementation, the first type of display unit includes an image display device.
  • the display device further includes a second type of display unit, the second type of display unit is used to display a second special effect according to the special effect data output by the computing platform, and the second display unit includes one or more display units. Further, in a possible implementation, the second type of display unit includes an atmosphere light.
  • the present application provides a vehicle, comprising any one of the device described in the second aspect, the device described in the third aspect, and the system described in the fourth aspect.
  • the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program.
  • the computer program runs on a computer, the first aspect or any method described in the first aspect is implemented.
  • the present application provides a chip comprising a processor and a communication interface, wherein the processor is used to read instructions to execute the method described in the first aspect or any of the methods described in the first aspect.
  • the present application provides a computer program product, comprising a computer program code, wherein when the computer program code is executed on a computer, the computer executes the method as described in the first aspect or any method of the first aspect.
  • FIG1 is a schematic diagram of a scene in a vehicle cabin provided by an embodiment of the present application.
  • FIG2 is a schematic diagram of the structure of a vehicle cockpit display system provided in an embodiment of the present application.
  • FIG3 is a schematic structural diagram of a first type of display unit provided in an embodiment of the present application.
  • FIG4 is a flow chart of a method for realizing a cockpit movie viewing special effect provided by an embodiment of the present application
  • FIG5 is a schematic diagram of a process for realizing a special effect of viewing a movie in a cockpit according to an embodiment of the present application
  • FIG6 is a schematic diagram of a partition when extracting the main color of a picture provided by an embodiment of the present application.
  • FIG7 is another schematic diagram of partitioning when extracting the main color of a picture provided by an embodiment of the present application.
  • FIG8 is a schematic diagram of another process for realizing a special effect of viewing a movie in a cockpit provided by an embodiment of the present application;
  • FIG9 is a schematic diagram of the structure of a device for realizing a special effect of viewing a movie in a cockpit provided by an embodiment of the present application;
  • FIG10 is a schematic structural diagram of another device for realizing cockpit movie viewing special effects provided by an embodiment of the present application.
  • FIG. 11 is a schematic diagram of the structure of a chip provided in an embodiment of the present application.
  • references to "one embodiment” or “some embodiments” in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application.
  • the phrases “in one embodiment”, “in some embodiments”, “in other embodiments”, “in other embodiments”, etc. appearing in different places do not necessarily refer to the same embodiment, but mean “one or more but not all embodiments", unless otherwise specifically emphasized.
  • the terms “including”, “comprising”, “having” and their variations all mean “including but not limited to”, unless otherwise specifically emphasized.
  • At least one means one or more
  • plural means two or more.
  • “And/or” describes the association relationship of associated objects, indicating that three relationships may exist.
  • a and/or B can mean: including the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural.
  • the character “/” generally indicates that the previous and next associated objects are in an “or” relationship.
  • “At least one of the following” or similar expressions refers to any combination of these items, including any combination of single or plural items.
  • At least one of a, b, or c can mean: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, c can be single or multiple.
  • FIG1 shows a schematic diagram of a scene in a vehicle cockpit provided by an embodiment of the present application.
  • the automobile head unit also known as the vehicle-mounted audio and video entertainment system
  • the screen connected thereto can also be called a central control display screen or a central control screen.
  • multiple display screens are provided in the cockpit, or a large screen that can be split into two screens, for displaying digital instrument panels, entertainment programs, related information, etc.
  • multiple display screens are provided in the cockpit, including a digital instrument display screen 101, a central control screen 102, an entertainment display screen 103 (co-pilot screen) located in front of the co-pilot passenger, an entertainment display screen 104 located in front of the left rear passenger, and an entertainment display screen 105 located in front of the right rear passenger.
  • One or more display devices with projection functions can also be provided in the cockpit, for example, a head-up display (HUD), an augmented-reality head-up display (AR-HUD) or other types of projectors.
  • HUD is a display device that projects images into the driver's or passenger's front field of view.
  • HUD can use the principle of optical reflection to project important relevant information in the form of two-dimensional images onto the front windshield of the vehicle or an independently displayed transparent screen. As shown in FIG1 , it can be projected onto the windshield 106.
  • one or more ambient lights 107 can be set in the cockpit. The ambient lights can display different colors at a certain frequency to set off the cockpit atmosphere.
  • FIG2 is a schematic diagram of the structure of a vehicle cockpit display system provided in an embodiment of the present application.
  • System 200 includes a computing platform 210 and a display device 220 .
  • the computing platform 210 may also be referred to as a controller, and may include one or more processors, such as processors 211 to 21m (m is a positive integer) shown in FIG2 .
  • a processor is a circuit having the ability to process signals.
  • the processor may be a circuit having the ability to read and execute instructions, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU), or a digital signal processor (DSP); in another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable, such as a processor being an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA).
  • ASIC application-specific integrated circuit
  • PLD programmable logic device
  • FPGA field programmable gate array
  • the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units.
  • the processor may also be a hardware circuit designed for artificial intelligence, which may be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc.
  • the computing platform 210 may also include a memory, the memory is used to store instructions, and some or all processors in the computing platform 210 may call instructions in the memory and execute the instructions to implement corresponding functions.
  • the display device 220 may include multiple types of display units, such as 221 to 22n (n is a positive integer) as shown in FIG2 .
  • Each type of display unit may include one or more display units.
  • the first type of display unit 221 may include k display units (the first display unit to the kth display unit, k is a positive integer).
  • the classification of display units may be based on the different display functions of the display units or the different device structures of the display units.
  • the display device shown in FIG1 is divided by taking the different device structures of the display units as an example, wherein the display device may be divided into three types of display units, each type of display unit includes one or more display units, wherein the first type of display unit is an image display device, including a central control screen 102, a digital instrument display screen 101, an entertainment display screen 103 located in front of the co-pilot passenger, an entertainment display screen 104 located in front of the left rear passenger, and an entertainment display 105 located in front of the right rear passenger; the second type of display unit includes an ambient light 107; the third type of display unit includes a windshield 106 onto which the HUD is projected. It should be understood that there are many ways to classify the above-mentioned display units, and this application does not limit this.
  • the display devices in the cockpit there are more and more display devices in the cockpit, but in the actual use process of users, these display devices are not fully and effectively utilized.
  • the video screen is displayed on the cockpit central control screen.
  • the user's viewing experience is not much different from the viewing experience of directly using the terminal device (such as a mobile phone or tablet), and the viewing atmosphere is not immersive enough. Therefore, the display devices in the cockpit can be fully utilized to enhance the user's viewing experience.
  • the present application provides a method, device, system and vehicle for realizing cockpit movie-watching special effects, which will be described in detail below.
  • the central control screen in the cockpit is playing a movie
  • the video screen content of the central control screen is obtained, and then the effect processing is performed to obtain the special effect data, and finally the special effect data is output to other display devices in the cockpit, so that these display devices can display the special effects according to the special effect data.
  • the display devices in the cockpit can be fully utilized to create a cockpit theater viewing atmosphere and enhance the user's viewing experience.
  • FIG4 is a flow chart of a method for realizing a cockpit movie viewing special effect provided by an embodiment of the present application. As shown in FIG4 , the method may include S401-S403:
  • the first display unit belongs to a first type of display unit Element, the first type of display unit includes one or more display units.
  • the first display unit may be a central control screen.
  • the video screen content may be a frame of the source video being played or the video screen content.
  • the video screen content may be one or more frames of screen content obtained by capturing the played video screen.
  • the display screen of the first display unit may be recorded to obtain one or more frames of video screen content of the recorded video.
  • the acquisition of the video screen content may be to acquire the video screen content of each frame of the playing media, or to acquire the video screen content periodically and regularly.
  • the video screen content may be acquired every 2 seconds.
  • the video picture content is processed by effects, including one or more of the processing methods such as cropping, stretching, blurring, gradient, extracting picture elements, extracting main colors, etc.
  • 500 is the video screen content played by the first display unit of the first type of display unit.
  • video screen content 510 of 25% on the left side of the video screen content 500 and video screen content 520 of 25% on the right side of the video screen content 500 are obtained.
  • the cropped video screen content 510 and the video screen content 520 are stretched, blurred and other effects are processed to obtain the processed first special effect data 511 and the second special effect data 521.
  • the special effect data may be obtained by cropping 50% of the video content on the left side of the video content, and then stretching, blurring, and gradient processing the cropped video content.
  • special effects data can also be obtained by extracting video screen elements. Extracting video screen elements can specifically include: identifying people, animals, plants, and backgrounds in the video screen content, and then extracting special effects data from the identified content through processing methods such as cutouts. Special effects data can also be obtained by stretching, blurring, and other processing on the identified content.
  • extracting the main color of the screen can specifically include: dividing the video screen content into x areas, extracting a color value from each area, and assuming that the color value of the i-th area is color(i).
  • the color value can be the color value of the middle position of the i-th area, or the color value of any position in the i-th area. Then, the color values extracted from all areas are averaged to obtain the main color of the video screen.
  • the main color of the video screen is represented by mainColor.
  • the video screen content is divided into 16 areas and 36 areas respectively, and the corresponding video screen main color can be obtained according to the above formula.
  • effect processing solutions described in the above embodiments do not represent all effect processing solutions, but various effect processing solutions for video picture content should be included in the scope of this application.
  • S403 output the special effect data to one or more other display units in the first type of display units except the first display unit, so that the one or more other display units display a first special effect according to the special effect data.
  • step S402 50% of the left side of the video content played on the central control screen is cropped. Then the cropped video content is stretched, blurred, and gradient processed to obtain special effect data. The special effect data is output to the co-pilot screen and the digital instrument display.
  • the first type of display unit may include an image display device, including the first display unit, and a second display unit and a third display unit, and the second display unit and the third display unit have different image effects.
  • the image display device includes a first display unit 500, a second display unit 512, and a third display unit 522.
  • the first special effect data 511 is output to the second display unit 512; the second special effect data 521 is output to the third display unit 522.
  • the second display unit 512 may be an instrument display screen, and the third display unit 522 may be an entertainment display screen located in front of the co-pilot passenger. In the above manner, the idle display screen in the cockpit can be fully utilized to enhance the user's viewing experience.
  • the method further includes outputting the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.
  • the second type of display unit may include one or more ambient lights in the cabin, and the main color special effect data of the video picture obtained in step S402 is output to one or more ambient lights in the cabin.
  • the color tone presented by the ambient light is adapted to the video picture, which is beneficial to creating a unified viewing atmosphere.
  • outputting the special effect data to one or more second-type display units includes outputting the special effect data to a control module so that the control module controls the display of one or more second-type display units according to the special effect data.
  • the second type of display unit may include one or more ambient lights in the cabin, and the main color effects of the video screen obtained in step S402 are output to a control module of the cabin ambient lights, which controls the cabin ambient lights to display the main color effects of the screen.
  • the second type of display unit may include a windshield onto which the HUD of the cockpit is projected.
  • the character element special effect data obtained by extracting the video screen elements in step S402 is output to the HUD device, and the special effects are projected onto the windshield according to the special effects data through the HUD device.
  • the character element special effects displayed on the windshield are constantly changing, thereby increasing the fun of watching the movie.
  • the audio content played by the first display unit can also be obtained, audio features can be extracted according to the audio content, and then the audio features can be output to the control module in the above embodiment, so that the control module can control the display of one or more second-type display units according to the special effect data and the audio features.
  • the audio content of the video played by the central control screen is obtained, the amplitude, frequency and other features of the audio are extracted from the audio content, and then the amplitude, frequency and other features of the audio are output to the control module of the atmosphere light, and the control module of the atmosphere light controls the display brightness of the atmosphere light according to the amplitude information of the audio, controls the flashing speed of the atmosphere light according to the frequency information of the audio, and controls the lighting effects of the atmosphere light according to the special effect data, so as to create a tense, fast-paced or soothing atmosphere.
  • the audio features of the played media are output to the HUD device, and the HUD device controls the size and/or color of the character screen in the projection according to the amplitude information of the audio, and controls the speed of character switching in the projection according to the frequency information of the audio.
  • the first display unit can be not only the central control screen, but also the entertainment display screen located in front of the front passenger, or the entertainment display screen located in front of the rear passengers, etc., which is not limited in this application.
  • the entertainment display screen located in front of the left rear passenger plays a media video
  • the video screen content can be extracted from the display screen, and then special effect data can be obtained after effect processing, and then the special effect data can be output to other display devices (entertainment display screen located in front of the right passenger, atmosphere light, etc.) respectively to improve the cockpit viewing effect of the rear passengers.
  • the cockpit The cabin can have a cinema mode.
  • the cabin viewing effect is triggered.
  • the user turns on the cinema mode during the viewing process, triggering the cabin viewing effect.
  • the triggering methods mentioned in the above embodiments are only illustrative and do not represent all triggering methods. It should be understood that this application does not make specific restrictions on the triggering methods, but the methods of triggering this application to achieve the cabin viewing effect should be included in the scope of this application.
  • an embodiment of the present application provides a device for realizing special effects of viewing movies in a cockpit, and the device can be applied to the flowcharts shown in FIG. 4 , FIG. 5 , and FIG. 8 to perform the functions in the above method embodiments.
  • the apparatus comprises:
  • An acquisition module 901 is used to acquire video screen content played by a first display unit, where the first display unit belongs to a first type of display unit, and the first type of display unit includes one or more display units;
  • a processing module 902 is used to perform effect processing on the video picture content to obtain special effect data, and the special effect data is used to display one or more special effects;
  • the output module 903 is used to output the special effect data to one or more other display units in the first type of display units except the first display unit, so that the one or more other display units display the first special effect according to the special effect data.
  • the processing module 902 performs one or more of the following effects on the video picture content: cropping, stretching, blurring, gradient, extracting picture elements, and extracting main colors.
  • the output module 903 is further used to output the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.
  • the device further includes a control module 904, and the output module 903 is further used to output the special effect data to the control module 904, and the control module 904 is used to control the display of one or more second-type display units according to the special effect data.
  • the acquisition module 901 is also used to acquire the audio content played by the first display unit; the processing module 902 is also used to extract audio features based on the audio content; the output module 903 is also used to output the audio features to the control module 904, so that the control module 904 controls the display of one or more second-type display units according to the special effect data and the audio features.
  • the audio features extracted by the processing module include amplitude and/or frequency.
  • the acquisition module 901 and the processing module 902 may be the computing platform 210 in FIG. 2 or a processing circuit or processor in the computing platform 210.
  • the acquisition module 901 and the processing module 902 are the processor 211 in the computing platform 210
  • the processor 211 may acquire the video screen content played by the first display unit, and may also acquire the audio features of the media.
  • the processor 211 may also perform effect processing on the video screen content to acquire special effect data, and may also extract audio features from the audio content.
  • the output module 903 may be the computing platform 210 in FIG. 2 or a processing unit in the computing platform 210. Taking the output module 903 as the processor 212 in the computing platform 210 as an example, the processor 212 can output the special effect data to one or more display units other than the first display unit in the first type of display unit, can also output the special effect data to the second type of display unit, can also output the special effect data to the control module 904, and can also output the audio feature to the control module 904.
  • control module 904 may be the computing platform 210 in Fig. 2 or a processing circuit or processor in the computing platform 210. Taking the control module 904 as the processor 213 in the computing platform 210 as an example, the processor 213 may control the display of one or more second-type display units according to the input special effect data and audio features.
  • the functions implemented by the above-mentioned acquisition module 901, the functions implemented by the processing module 902, the functions implemented by the output module 903, and the functions implemented by the control module 904 can be implemented by different processors respectively, or some functions can be implemented by the same processor, or all functions can be implemented by the same processor, and the embodiments of the present application are not limited to this.
  • All modules of the above device can be implemented in the form of software called by the processor, or in the form of hardware circuits, or partially in the form of software called by the processor and the rest in the form of hardware circuits.
  • the processor may be a circuit with signal processing capability.
  • the processor may be a circuit with instruction reading and execution capability, such as a CPU, a microprocessor, a GPU, or a DSP.
  • the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable, such as an ASIC, a PLD, an FPGA, or a hardware circuit designed for artificial intelligence, such as an NPU, a TPU, or a DPU.
  • the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above modules.
  • Each module in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.
  • processors or processing circuits configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.
  • the modules in the above device can be fully or partially integrated together, or can be implemented independently. In one implementation, these modules are integrated together and implemented in the form of a system on a chip (SoC).
  • SoC may include at least one processor for implementing any of the above methods or implementing the functions of the modules of the device.
  • the type of at least one processor included in the SoC may be different, for example, including a CPU and an FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.
  • An embodiment of the present application also provides a device 1000, as shown in Figure 10, the device 1000 includes a processor 1010 and a memory 1020, wherein the memory 1020 is used to store instructions, and the processor 1010 executes the instructions stored in the storage unit 1020 so that the device executes the method or steps executed in the above embodiment.
  • the embodiment of the present application further provides a display system 200, as shown in Fig. 2, the display system 200 includes a computing platform 210 and a display device 220.
  • the computing platform 210 may include the device 900 or the device 1000.
  • the display device 220 may include a first type of display unit, and may also include a second type of display unit.
  • An embodiment of the present application further provides a vehicle, which includes any one of the device 900 , the device 1000 , and the display system 200 .
  • the present application also provides a chip 1100, as shown in FIG11, including a processor 1110 and a communication interface 1120, wherein the processor 1110 is used to read instructions to execute the method or steps executed in the above embodiment.
  • the communication interface 1120 is used to communicate with other devices through a transmission medium.
  • the communication interface 1120 may be a transceiver, a circuit, a master, or a slave. Line, module or other types of communication interfaces.
  • the transceiver when the communication interface 1120 is a transceiver, the transceiver may include an independent receiver, an independent transmitter, or a transceiver with integrated transceiver functions, or an interface circuit.
  • the communication interface 1120 can obtain the video screen content played by the first display unit, and can also output the special effect data processed by the processor 1110 to one or more display units in the first type of display unit other than the first display unit.
  • the communication interface 1120 can obtain the audio content of the first display unit, and can also output the audio features extracted from the audio content to the control module in the above embodiment.
  • the embodiment of the present application further provides a computer program product, which includes: a computer program code, and when the computer program code is executed on a computer, the computer executes the above method.
  • the embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a program code.
  • the computer program code is executed on a computer, the computer executes the above method.
  • the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.
  • the size of the serial number of each process does not mean the order of execution.
  • the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
  • determining B based on A does not mean determining B based only on A.
  • B can also be determined based on A and/or other information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种实现座舱影院观影特效的方法、装置、系统及车辆，适用于智能汽车领域，所述方法包括：获取第一显示单元播放的视频画面内容，所述第一显示单元属于第一类显示单元，所述第一类显示单元包括一个或多个显示单元；对所述视频画面内容进行效果处理以得到特效数据，所述特效数据用于显示一个或多个特效；将所述特效数据输出到所述第一类显示单元中除所述第一显示单元以外的一个或多个其他显示单元，以使所述一个或多个其他显示单元根据所述特效数据显示第一特效。通过本申请，用户在座舱中观影时，座舱中的显示设备可以得到充分有效的利用，同时可以营造出与播放的媒体内容相适应的观影氛围，提升用户在座舱内的观影体验。

Description

一种实现座舱影院观影特效的方法、装置、系统及车辆 技术领域
本申请涉及智能车辆领域，特别涉及一种实现座舱影院观影特效的方法、装置、系统及车辆。
背景技术
在车辆智能化的场景下，智能座舱备受人们的关注，座舱的影音娱乐体验成为衡量智能座舱体验的重要因素之一。目前，用户在座舱内观影主要是通过车机中安装的视频类应用或者使用手机等终端设备与车机互联将视频投屏到车机中进行观看，沉浸式观影体验仍显不足。
发明内容
本申请提供一种实现座舱影院观影特效的方法、装置、系统及车辆，有助于提升用户在座舱中观影的沉浸式体验。
第一方面，本申请提供了一种实现座舱影院观影特效的方法，所述方法包括：获取第一显示单元播放的视频画面内容，所述第一显示单元属于第一类显示单元，所述第一类显示单元包括一个或多个显示单元；对所述视频画面内容进行效果处理以得到特效数据，所述特效数据用于显示一个或多个特效；将所述特效数据输出到所述第一类显示单元中除所述第一显示单元以外的一个或多个其他显示单元，以使所述一个或多个其他显示单元根据所述特效数据显示第一特效。
示例性的，所述第一类显示单元包括座舱内的图像显示装置，所述图像显示装置包括座舱内的显示屏，例如包括第一显示单元，第一显示单元可以是座舱中控屏，所述图像显示装置还可以包括仪表显示屏、副驾驶位上的乘客(也称为前排乘客)面前的显示屏、左侧后排乘客面前的显示屏、右侧后排乘客面前的显示屏等座舱内显示设备。当座舱中控屏在播放影片时，将中控屏中的视频画面内容经过效果处理，获取到特效数据，特效数据包括一个或多个特效，然后将特效数据输出到第一类显示单元中的其他的显示设备上。该实现方式可以充分利用座舱内的显示设备，营造一种座舱影院的观影氛围，提升用户的观影体验。
在一种可能的实现方式中，第一类显示单元中的不同显示单元可以显示不同的特效，可以进一步提升氛围以及沉浸感。
在一种可能的实现方式中，所述处理包括以下一种或多种：裁剪、拉伸、模糊、渐变、提取画面元素、提取主色。通过对视频画面内容的效果处理，所得到的特效数据跟视频画面内容保持很强的关联性，如主色调，有助于提升观影的氛围感。
在一种可能的实现方式中，还包括将所述特效数据输出到一个或多个第二类显示单元，以使所述一个或多个第二类显示单元根据所述特效数据显示第二特效。示例性的，所述第 二类显示单元可以包括座舱内的一个或多个氛围灯，将特效数据输出到氛围灯，由氛围灯来呈现灯光特效，烘托观影氛围。
在一种可能的实现方式中，所述将所述特效数据输出到一个或多个第二类显示单元包括，将所述特效数据输出到控制模块，以使所述控制模块根据所述特效数据控制一个或多个第二类显示单元的显示。示例性的，所述第二类显示单元可以包括座舱内的氛围灯，将特效数据输出到氛围灯的控制模块，由控制模块对氛围灯的展示效果做进一步的调控优化，例如根据周围环境进一步调整特效的呈现效果，提升观影的氛围。进一步地，在一种可能的实现方式中，还包括，获取所述第一显示单元播放的音频内容；根据所述音频内容提取音频特征；将所述音频特征输出到所述控制模块，以使所述控制模块根据所述特效数据以及所述音频特征控制所述一个或多个第二类显示单元的显示。在一种可能的实现方式中，所述音频特征包括振幅和/或频率。示例性的，将音频特征输出到氛围灯的控制模块，控制模块根据音频的振幅调整氛围灯的亮度，根据音频的频率调节氛围灯闪烁的快慢，然后再结合氛围灯的灯光特效，营造与播放的视频相对应的或舒缓或紧张的氛围，提升用户的观影体验。进一步地，在一种可能的实现方式中，所述第二类显示单元中的不同显示单元可以有相同或者不同的特效。示例性的，氛围灯是环绕在座舱中，不同位置的氛围灯可以显示不同的特效，可以进一步提升氛围体验。
第二方面，本申请提供了一种装置，包括：获取模块，用于获取第一显示单元播放的视频画面内容，所述第一显示单元属于第一类显示单元，所述第一类显示单元包含一个或多个显示单元；处理模块，用于效果处理对所述视频画面内容进行效果处理以得到特效数据，所述特效数据用于显示一个或多个特效；输出模块，用于将所述特效数据输出到所述第一类显示单元中除所述第一显示单元以外的一个或多个其他显示单元，以使所述一个或多个其他显示单元根据所述特效数据显示第一特效。
在一种可能的实现方式中，所述处理模块对所述视频画面内容的效果处理包括以下一种或多种：裁剪、拉伸、模糊、渐变、提取画面元素、提取主色。
在一种可能的实现方式中，所述输出模块还用于将所述特效数据输出到一个或多个第二类显示单元，以使所述一个或多个第二类显示单元根据所述特效数据显示第二特效。
在一种可能的实现方式中，所述装置还包括控制模块，所述输出模块将所述特效数据输出到所述控制模块，所述控制模块用于接收所述特效数据，根据所述特效数据控制一个或多个第二类显示单元的显示。
进一步地，在一种可能的实现方式中，所述获取模块还用于获取所述第一显示单元播放的音频内容；所述处理模块还用于根据所述音频内容提取音频特征；所述输出模块还用于将所述音频特征输出到所述控制模块，所述控制模块根据所述特效数据以及所述音频特征控制所述一个或多个第二类显示单元的显示。在一种可能的实现方式中，所述音频特征包括振幅和/或频率。
在一种可能的实现方式中，所述第二类显示单元包括氛围灯。进一步地，所述氛围灯包括第一氛围灯和第二氛围灯，所述第一氛围灯和所述第二氛围灯的灯光特效不同。
在一种可能的实现方式中，所述第一类显示单元包括图像显示装置。进一步地，所述图像显示装置包括所述第一显示单元，以及第二显示单元和第三显示单元，所述第二显示单元和所述第三显示单元的图像特效不同。
第三方面，本申请提供了一种装置，包括处理器和存储器，所述处理器用于读取所述存储器所存储的计算机程序，以使所述装置执行如第一方面或第一方面任意所述的方法。
第四方面，本申请提供一种显示系统，包括计算平台和显示装置，所述计算平台包括如第二方面或第三方面所述的装置，所述显示装置包括第一类显示单元，所述第一类显示单元用于根据所述计算平台输出的特效数据显示第一特效，所述第一类显示单元包括一个或多个显示单元。进一步地，在一种可能的实现方式中，所述第一类显示单元包括图像显示装置。
在一种可能的实现方式中，所述显示装置还包括第二类显示单元，所述第二类显示单元用于根据所述计算平台输出的特效数据显示第二特效，所述第二显示单元包括一个或多个显示单元。进一步地，在一种可能的实现方式中，所述第二类显示单元包括氛围灯。
第五方面，本申请提供一种车辆，包括如第二方面所述的装置、第三方面所述的装置以及第四方面所述的系统中的任意一项。
第六方面，本申请提供一种计算机可读存储介质，所述计算机可读存储介质用于存储计算机程序，当所述计算机程序在计算机上运行时，使得第一方面或第一方面任意所述的方法被实现。
第七方面，本申请提供一种芯片，包括处理器和通信接口，所述处理器用于读取指令以执行如第一方面或第一方面任意所述的方法。
第八方面，本申请提供一种计算机程序产品，包括计算机程序代码，所述计算机程序代码在计算机上运行时，使得所述计算机执行如第一方面或第一方面任意所述的方法。
附图说明
图1为本申请实施例提供的一种车辆座舱内的场景示意图；
图2为本申请实施例提供的一种车辆座舱显示系统的结构示意图；
图3为本申请实施例提供的一种第一类显示单元的结构示意图；
图4为本申请实施例提供的一种实现座舱观影特效的方法的流程示意图；
图5为本申请实施例提供的一种实现座舱观影特效的流程示意图；
图6为本申请实施例提供的一种提取画面主色时的分区示意图；
图7为本申请实施例提供的另一种提取画面主色时的分区示意图；
图8为本申请实施例提供的另一种实现座舱观影特效的流程示意图；
图9为本申请实施例提供的一种实现座舱观影特效的装置的结构示意图；
图10为本申请实施例提供的另一种实现座舱观影特效的装置的结构示意图；
图11为本申请实施例提供的一种芯片的结构示意图。
具体实施方式
下面将结合附图，对本申请实施例中的技术方案进行详细描述。附图中相同的附图标记表示功能相同或相似的元件。尽管在附图中示出了实施例的各种方面，但是除非特别指出，不必按比例绘制附图。
在本说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此，在本说明书中的 不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同实施例，而是意味着“一个或多个但不是所有的实施例”，除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。
本申请中术语“第一”“第二”等字样用于对作用和功能基本相同的相同项或相似项进行区分，应理解，“第一”、“第二”、“第n”之间不具有逻辑或时序上的依赖关系，也不对数量和执行顺序进行限定。
本申请中，“至少一个”是指一个或者多个，“多个”是指两个或两个以上。“和/或”，描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：包括单独存在A，同时存在A和B，以及单独存在B的情况，其中A，B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达，是指的这些项中的任意组合，包括单项(个)或复数项(个)的任意组合。例如，a，b，或c中的至少一项(个)，可以表示：a，b，c，a-b，a-c，b-c，或a-b-c，其中a，b，c可以是单个，也可以是多个。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
在这里专用的词“示例性”意为“用作例子、实施例或说明性”。这里作为“示例性”所说明的任何实施例不必解释为优于或好于其它实施例。
另外，为了更好的说明本申请，在下文的具体实施方式中给出了众多的具体细节。本领域技术人员应当理解，没有某些具体细节，本申请同样可以实施。
图1示出了本申请实施例提供的一种车辆座舱内的场景示意图。在车辆座舱内，车机(automobile head unit)，也称为车载影音娱乐系统，可以设置于车辆的中控区域，其连接的屏幕也可以称为中控显示屏或者中控屏。随着座舱内的数字化显示设备逐步扩展，在一些车辆中，座舱内设置有多块显示屏，或者一块可以分屏的大屏，用于显示数字仪表盘、娱乐节目、相关资讯等。如图1所示，座舱内设置有多块显示屏，包括数字仪表显示屏101、中控屏102、位于副驾驶乘客前方的娱乐显示屏103(副驾屏)、位于后排左侧乘客面前的娱乐显示屏104、位于后排右侧乘客面前的娱乐显示屏105。座舱内还可以设置有一个或多个具有投影功能的显示设备，例如，抬头显示(head-up display，HUD)、增强现实抬头显示(augmented-reality head-up display，AR-HUD)或其他类型的投影仪等。其中，HUD是一种将图像投射到驾驶员或乘客前方视野中的显示设备。HUD可以利用光学反射的原理，将重要的相关资讯以二维图像的方式投影到车辆的前挡风玻璃或独立显示的透明屏幕上，如图1所示，可以投影到挡风玻璃106上面。此外，座舱内还可以设置一个或多个氛围灯107，氛围灯可以以一定的频率显示不同的颜色，烘托座舱氛围。随着汽车智能化的不断发展，为满足用户对座舱的各种需求，提升用户的座舱使用体验，座舱内的显示设备越来越多，显示系统的功能也越来越复杂，下面对座舱的显示系统做简要的说明。
图2为本申请实施例提供的一种车辆座舱显示系统的结构示意图。如图2所示，显示 系统200包括计算平台210和显示装置220。
计算平台210又可以称为控制器，可以包括一个或者多个处理器,如图2所示的处理器211至21m(m为正整数)。处理器是一种具有信号的处理能力的电路，在一种实现中，处理器可以是具有指令读取与运行能力的电路，例如中央处理单元(central processing unit，CPU)、微处理器、图形处理器(graphics processing unit，GPU)、或数字信号处理器(digital signal processor，DSP)等；在另一种实现中，处理器可以通过硬件电路的逻辑关系实现一定功能，该硬件电路的逻辑关系是固定的或可以重构的，例如处理器为专用集成电路(application-specific integrated circuit，ASIC)、可编程逻辑器件(programmable logic device，PLD)、或现场可编程门阵列(field programmable gate array，FPGA)。在可重构的硬件电路中，处理器加载配置文档，实现硬件电路配置的过程，可以理解为处理器加载指令，以实现以上部分或全部单元的功能的过程。此外，处理器还可以是针对人工智能设计的硬件电路，其可以理解为一种ASIC，例如神经网络处理单元(neural network processing unit，NPU)、张量处理单元(tensor processing unit，TPU)、深度学习处理单元(deep learning processing unit，DPU)等。此外，计算平台210还可以包括存储器，存储器用于存储指令，计算平台210中的部分或全部处理器可以调用存储器中的指令，执行指令，以实现相应的功能。
显示装置220可以包括多类显示单元，如图2所示的221至22n(n为正整数)。每类显示单元可以包括一个或多个显示单元，示例性的，如图3所示，第一类显示单元221可以包括k个显示单元(第一显示单元至第k显示单元，k为正整数)。显示单元的分类，可以以显示单元的显示功能的不同来划分，也可以以显示单元的设备结构不同来划分。示例性的，这里以显示单元的设备结构不同为例对图1所示的显示设备进行划分，其中显示装置可以分为三类显示单元，每类显示单元包括一个或多个显示单元，其中第一类显示单元为图像显示装置，包括中控屏102、数字仪表显示屏101、位于副驾驶乘客前方的娱乐显示屏103、位于后排左侧乘客面前的娱乐显示屏104、位于后排右侧乘客面前的娱乐显示105；第二类显示单元包括氛围灯107；第三类显示单元包括HUD投影到的挡风玻璃106。应理解，对以上所述显示单元的分类划分有多种方式，本申请对此不做限定。
综上所述，座舱内的显示设备越来越多，但是在用户实际的使用过程中，这些显示设备并没有得到充分有效的利用。例如用户在座舱中使用车机中安装的视频类应用播放视频，或者使用终端设备与车机互联将视频投屏到车机中时，视频画面在座舱中控屏中呈现，用户的观影体验与直接使用终端设备(如手机或平板)的观影体验没有太大的区别，观影氛围的沉浸感不足。因此，可以充分的利用座舱内的显示设备来提升用户的观影体验。
本申请提供了一种实现座舱观影特效的方法、装置、系统以及车辆，下文将详细的进行介绍。示例性的，当座舱的中控屏在播放影片时，获取中控屏的视频画面内容，然后进行效果处理，获取到特效数据，最后将这些特效数据输出到座舱内其他的显示设备上，让这些显示设备根据特效数据显示出特效。这样可以充分利用座舱内的显示设备，营造出一种座舱影院的观影氛围，提升用户的观影体验。
图4示出了本申请实施例提供的实现座舱观影特效的方法的流程示意图。如图4所示，该方法可以包括S401-S403：
S401，获取第一显示单元播放的视频画面内容，所述第一显示单元属于第一类显示单 元，所述第一类显示单元包括一个或多个显示单元。
示例性的，第一显示单元可以为中控屏。
在一个实施例中，视频画面内容可以是播放的源视频的一帧画面内容或者视频画面内容。
在一个实施例中，视频画面内容可以是对播放的视频画面进行捕捉，获取到的一帧或多帧画面内容。
示例性的，可以对第一显示单元的显示画面进行录制，获取录制的视频的一帧或者多帧视频画面内容。
另外，对视频画面内容的获取，可以是获取播放媒体的每一帧视频画面内容，也可以是周期性的定时获取视频画面内容。示例性的，可以每隔2秒获取一次视频画面内容。
S402,对所述视频画面内容进行效果处理以得到特效数据，所述特效数据用于显示一个或多个特效。
在一个实施例中，对视频画面内容进行效果处理，包括裁剪、拉伸、模糊、渐变、提取画面元素、提取主色等处理方式中的一种或者多种。
示例性的，如图5所示，500为第一类显示单元的第一显示单元播放的视频画面内容，经过对视频画面内容进行裁剪处理，如图5所示，获得视频画面内容500左侧25％比例的视频画面内容510以及视频画面内容500右侧25％比例的视频画面内容520，然后对裁剪得到的视频画面内容510以及视频画面内容520进行拉伸、模糊等效果处理，得到处理后的第一特效数据511以及第二特效数据521。
示例性的，可以通过裁剪视频画面内容左侧50％比例的视频画面内容，然后对裁剪得到的视频画面内容进行拉伸、模糊、渐变处理，获得特效数据。
示例性的，也可以通过提取视频画面元素获取到特效数据，提取视频画面元素具体可以是：识别出视频画面内容中的人物、动物、植物以及背景等，然后对识别出的内容通过抠图等处理方式提取获得特效数据，也可以通过对识别的内容进行拉伸、模糊等处理，获得特效数据。
示例性的，也可以通过提取画面主色的方式获取特效数据，提取画面主色具体可以包括：将视频画面内容划分为x个区域，从每个区域中提取一个颜色值，设第i个区域的颜色值为color(i)，该颜色值可以取第i个区域中间位置的颜色值，也可以取第i个区域内任意一位置的颜色值，然后对从所有区域提取得到的颜色值取平均值得到视频画面主色，视频画面主色以mainColor来表示。
如图6以及图7所示，分别将视频画面内容划分为16个区域和36个区域，根据以上公式即可得出对应的视频画面主色。
应理解，以上实施例所述的效果处理方案不代表全部的效果处理方案，但针对视频画面内容的各种效果处理方案均应当包含在本申请的范围内。
S403，将所述特效数据输出到所述第一类显示单元中除所述第一显示单元以外的一个或多个其他显示单元，以使所述一个或多个其他显示单元根据所述特效数据显示第一特效。
示例性的，如S402步骤中通过裁剪中控屏播放的视频画面内容左侧50％比例的视频画 面内容，然后对裁剪得到的视频画面内容进行拉伸、模糊、渐变处理，获得特效数据。将该特效数据输出到副驾屏和数字仪表显示屏。
在一个实施例中，所述第一类显示单元可以包括图像显示装置，包括所述第一显示单元，以及第二显示单元和第三显示单元，所述第二显示单元和第三显示元的图像特效不同。
示例性的，如图5所示，图像显示装置包括第一显示单元500，以及第二显示单元512以及第三显示单元522。将第一特效数据511输出到第二显示单元512；将第二特效数据521输出到第三显示单元522。第二显示单元512可以是仪表显示屏，第三显示单元522可以是位于副驾驶乘客前方的娱乐显示屏。通过上述方式，可以充分利用座舱中的空闲显示屏，提升用户的观影体验。
在一个实施例中，还包括将所述特效数据输出到一个或多个第二类显示单元，以使所述一个或多个第二类显示单元根据所述特效数据显示第二特效。
示例性的，第二类显示单元可以包括座舱内的一个或多个氛围灯，将S402步骤获得的视频画面主色特效数据输出到座舱的一个或多个氛围灯，氛围灯呈现的色调和视频画面相适应，有益于营造统一的观影氛围。
在一个实施例中，如图8所示，所述将所述特效数据输出到一个或多个第二类显示单元包括，将所述特效数据输出到控制模块，以使所述控制模块根据所述特效数据控制一个或多个第二类显示单元的显示。
示例性的，第二类显示单元可以包括座舱内的一个或多个氛围灯，将S402步骤获得视频画面主色特效输出到座舱氛围灯的控制模块，由控制模块控制座舱的氛围灯显示画面主色特效。
示例性的，第二类显示单元可以包括座舱的HUD投影到的挡风玻璃，将S402步骤通过提取视频画面元素得到的人物元素特效数据输出到HUD装置，通过HUD装置根据特效数据将特效投影到挡风玻璃上，随着视频的播放，挡风玻璃上显示的人物元素特效不断地变化，增加观影的趣味性。
在一个实施例中，如图8所示，还可以获取所述第一显示单元播放的音频内容，根据所述音频内容提取音频特征，然后将所述音频特征输出到上述实施例中的控制模块，以使所述控制模块根据所述特效数据以及所述音频特征控制一个或多个第二类显示单元的显示。示例性的，获取中控屏播放的视频的音频内容，从音频内容中提取音频的振幅、频率等特征，然后将音频的振幅、频率等特征输出到氛围灯的控制模块，由氛围灯的控制模块根据音频的振幅信息控制氛围灯的显示亮度，根据音频的频率信息控制氛围灯的闪烁快慢，根据特效数据控制氛围灯的灯光特效，营造紧张快节奏或者舒缓的氛围。示例性的，将播放的媒体的音频特征输出到HUD装置，由HUD装置根据音频的振幅信息控制投影中人物画面的大小和/或颜色，根据音频的频率信息控制投影中人物切换的速度。
应理解，所述第一显示单元不仅可以是中控屏，也可以是位于副驾驶乘客前方的娱乐显示屏，还可以是位于后排乘客面前的娱乐显示屏等，本申请不做限定。示例性的，当位于后排左侧乘客面前的娱乐显示屏播放媒体视频时，此时可以从该显示屏中提取视频画面内容，然后经过效果处理，获取到特效数据，然后将特效数据分别输出到其他显示设备(右位于右侧乘客面前的娱乐显示屏、氛围灯等)上，提升后排乘客的座舱观影效果。
此外，触发本申请实现座舱观影特效的方式可以是多种多样的，在一个实施例中，座 舱可以有影院模式，当用户开启影院模式，然后使用车机播放视频时，触发座舱观影特效；在另一个实施例中，用户在观影过程中开启影院模式，触发座舱观影特效；还有一些实施例中，对用户使用的视频类应用有控制，示例性的，判断该视频应用是否是影院模式应用，如果是应用模式应用，则可以触发座舱观影特效。以上实施例所提及的触发方式仅为示意性的，不代表全部所有的触发方式，应理解，本申请对触发方式不做具体限制，但触发本申请实现座舱观影特效的方式均应包含在本申请的范围内。
此外，本文中描述的各个实施例可以为独立的方案，也可以根据内在逻辑进行组合，这些方案都落入本申请的保护范围中。
下面结合图9详细说明本申请实施例提供的装置。应理解，装置实施例的描述与方法实施例的描述相互对应，因此，未详细描述的内容可以参见上文的方法实施例。
如图9所示，本申请实施例提供了一种实现座舱观影特效的装置，该装置可适用于图4、图5、图8所示出的流程图中，执行上述方法实施例中的功能。
在一个实施例中，所述装置包括：
获取模块901，用于获取第一显示单元播放的视频画面内容，所述第一显示单元属于第一类显示单元，所述第一类显示单元包含一个或多个显示单元；
处理模块902，用于对所述视频画面内容进行效果处理以得到特效数据，所述特效数据用于显示一个或多个特效；
输出模块903，用于将所述特效数据输出到所述第一类显示单元中除所述第一显示单元以外的一个或多个其他显示单元，以使所述一个或多个其他显示单元根据所述特效数据显示第一特效。
在一个实施例中，所述处理模块902对所述视频画面内容的效果处理包括以下一种或多种：裁剪、拉伸、模糊、渐变、提取画面元素、提取主色。
在一个实施例中，所述输出模块903还用于将所述特效数据输出到的一个或多个第二类显示单元，以使所述一个或多个第二类显示单元根据所述特效数据显示第二特效。
在一个实施例中，所述装置还包括控制模块904，输出模块903还用于将所述特效数据输出到所述控制模块904，控制模块904，用于根据所述特效数据控制一个或多个第二类显示单元的显示。
在一个实施例中，所述获取模块901还用于获取所述第一显示单元播放的音频内容；所述处理模块902还用于根据所述音频内容提取音频特征；所述输出模块903还用于将所述音频特征输出到所述控制模块904，以使所述控制模块904根据所述特效数据以及所述音频特征控制一个或多个第二类显示单元的显示。
在一种实施例中，所述处理模块提取的音频特征包括振幅和/或频率。
示例性的，获取模块901、处理模块902可以是图2中的计算平台210或者计算平台210中的处理电路、处理器。以获取模块901、处理模块902是计算平台210中的处理器211为例，处理器211可以获取第一显示单元播放的视频视频画面内容，还可以获取所述媒体的音频特征。此外，处理器211还可以对视频画面内容做效果处理，以获取特效数据，还可以从音频内容中提取音频特征。
示例性的，输出模块903可以是图2中的计算平台210或者计算平台210中的处理电 路、处理器。以输出模块903是计算平台210中的处理器212为例，处理器212可以将特效数据输出到第一类显示单元中除第一显示单元以外的一个或多个显示单元，还可以将特效数据输出到第二类显示单元，还可以将特效数据输出到控制模块904，也可以将音频特征输出到控制模块904。
示例性的，控制模块904可以是图2中的计算平台210或者计算平台210中的处理电路、处理器。以控制模块904是计算平台210中的处理器213为例，处理器213可以根据输入的特效数据和音频特征控制一个或多个第二类显示单元的显示。
以上获取模块901所实现的功能、处理模块902所实现的功能、输出模块903所实现的功能以及控制模块904所实现的功能可以分别由不同的处理器实现，或者，也可以是部分功能由相同的处理器实现，或者，还可以所有功能均由相同的处理器实现，本申请实施例对此不作限定。
以上装置的所有模块可以全部通过处理器调用软件的形式实现，或全部通过硬件电路的形式实现，或部分通过处理器调用软件的形式实现，剩余部分通过硬件电路的形式实现。
在本申请实施例中，处理器可以是一种具有信号的处理能力的电路，在一种实现中，处理器可以是具有指令读取与运行能力的电路，例如CPU、微处理器、GPU、或DSP等；在另一种实现中，处理器可以通过硬件电路的逻辑关系实现一定功能，该硬件电路的逻辑关系是固定的或可以重构的，例如处理器为ASIC、PLD、FPGA、或针对人工智能设计的硬件电路，例如NPU、TPU、DPU。在可重构的硬件电路中，处理器加载配置文档，实现硬件电路配置的过程，可以理解为处理器加载指令，以实现以上部分或全部模块的功能的过程。
以上装置中的各模块可以是被配置成实施以上方法的一个或多个处理器(或处理电路)，例如：CPU、GPU、NPU、TPU、DPU、微处理器、DSP、ASIC、FPGA，或这些处理器形式中至少两种的组合。
此外，以上装置中的各模块可以全部或部分可以集成在一起，或者可以独立实现。在一种实现中，这些模块集成在一起，以片上系统(system on a chip，SoC)的形式实现。该SoC中可以包括至少一个处理器，用于实现以上任一种方法或实现该装置各模块的功能，该SoC所包含的至少一个处理器的种类可以不同，例如包括CPU和FPGA，CPU和人工智能处理器，CPU和GPU等。
本申请实施例还提供了一种装置1000，如图10所示，装置1000包括处理器1010和存储器1020，其中存储器1020用于存储指令，处理器1010执行存储单元1020所存储的指令，以使该装置执行上述实施例执行的方法或者步骤。
本申请实施例还提供了一种显示系统200，如图2所示，显示系统200包括计算平台210和显示装置220。计算平台210可以包括装置900或装置1000。显示装置220可以包括第一类显示单元，还可以包括第二类显示单元。
本申请实施例还提供了一种车辆，所述车辆包括装置900、装置1000以及显示系统200中的任意一项。
本申请实施例还提供了一种芯片1100，如图11所示，包括处理器1110和通信接口1120，处理器1110用于读取指令以执行上述实施例执行的方法或步骤。通信接口1120用于通过传输介质和其它设备进行通信。在本申请实施例中，通信接口1120可以是收发器、电路、总 线、模块或其它类型的通信接口。在本申请实施例中，通信接口1120为收发器时，收发器可以包括独立的接收器、独立的发射器，也可以是集成收发功能的收发器、或者是接口电路。示例性的，通信接口1120可以获取第一显示单元播放的视频画面内容，还可以将处理器1110处理后的特效数据输出到第一类显示单元中除第一显示单元以外的一个或多个显示单元等。示例性的，通信接口1120可以获取第一显示单元的音频内容，还可以将从音频内容中提取的音频特征输出到上述实施例中的控制模块。
本申请实施例还提供了一种计算机程序产品，所述计算机程序产品包括：计算机程序代码，当所述计算机程序代码在计算机上运行时，使得计算机执行上述方法。
本申请实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质存储有程序代码，当所述计算机程序代码在计算机上运行时，使得计算机执行上述方法。
应理解，本申请实施例中，存储器可以包括只读存储器和随机存取存储器，并向处理器提供指令和数据。
应理解，在本申请的各个实施例中，各个过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本申请实施例的实施过程构成任何限定。
应理解，根据A确定B并不意味着仅仅根据A确定B，还可以根据A和/或其它信息确定B。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (26)

  1. 一种实现座舱影院观影特效的方法，其特征在于，应用于车辆中，包括：
    获取第一显示单元播放的视频画面内容，所述第一显示单元属于第一类显示单元，所述第一类显示单元包括一个或多个显示单元；
    对所述视频画面内容进行效果处理以得到特效数据，所述特效数据用于显示一个或多个特效；
    将所述特效数据输出到所述第一类显示单元中除所述第一显示单元以外的一个或多个其他显示单元，以使所述一个或多个其他显示单元根据所述特效数据显示第一特效。
  2. 根据权利要求1所述的方法，其特征在于，所述处理包括以下一种或多种：裁剪、拉伸、模糊、渐变、提取画面元素、提取主色。
  3. 根据权利要求1或2所述的方法，其特征在于，所述方法还包括：
    将所述特效数据输出到一个或多个第二类显示单元，以使所述一个或多个第二类显示单元根据所述特效数据显示第二特效。
  4. 根据权利要求3所述的方法，其特征在于，所述将所述特效数据输出到一个或多个第二类显示单元包括，
    将所述特效数据输出到控制模块，以使所述控制模块根据所述特效数据控制一个或多个第二类显示单元的显示。
  5. 根据权利要求4所述的方法，其特征在于，还包括：
    获取所述第一显示单元播放的音频内容；
    根据所述音频内容提取音频特征；
    将所述音频特征输出到所述控制模块，以使所述控制模块根据所述特效数据以及所述音频特征控制所述一个或多个第二类显示单元的显示。
  6. 根据权利要求5所述的方法，其特征在于，所述音频特征包括振幅和/或频率。
  7. 根据权利要求3-6中任意一项所述的方法，其特征在于，所述第二类显示单元包括氛围灯。
  8. 根据权利要求7所述的方法，其特征在于，所述氛围灯包括第一氛围灯和第二氛围灯，所述第一氛围灯和所述第二氛围灯的灯光特效不同。
  9. 根据权利要求1-8中任意一项所述的方法，其特征在于，所述第一类显示单元包括图像显示装置。
  10. 根据权利要求9所述的方法，其特征在于，所述图像显示装置包括所述第一显示单元，以及第二显示单元和第三显示单元，所述第二显示单元和所述第三显示单元的图像特效不同。
  11. 一种装置，其特征在于，包括：
    获取模块，用于获取第一显示单元播放的视频画面内容，所述第一显示单元属于第一类显示单元，所述第一类显示单元包含一个或多个显示单元；
    处理模块，用于对所述视频画面内容进行效果处理以得到特效数据，所述特效数据用于显示一个或多个特效；
    输出模块，用于将所述特效数据输出到所述第一类显示单元中除所述第一显示单元以外的一个或多个其他显示单元，以使所述一个或多个其他显示单元根据所述特效数据显示第一特效。
  12. 根据权利要求11所述的装置，其特征在于，所述处理包括以下一种或多种：裁剪、拉伸、模糊、渐变、提取画面元素、提取主色。
  13. 根据权利要求11或12所述的装置，其特征在于，所述输出模块还用于将所述特效数据输出到一个或多个第二类显示单元，以使所述一个或多个第二类显示单元根据所述特效数据显示第二特效。
  14. 根据权利要求13所述的装置，其特征在于，还包括控制模块，
    所述输出模块具体用于，将所述特效数据输出到所述控制模块；
    所述控制模块，用于接收所述特效数据，根据所述特效数据控制一个或多个第二类显示单元的显示。
  15. 根据权利要求14所述的装置，其特征在于，还包括：
    所述获取模块还用于获取所述第一显示单元播放的音频内容；
    所述处理模块还用于根据所述音频内容提取音频特征；
    所述输出模块还用于将所述音频特征输出到所述控制模块；
    所述控制模块具体用于根据所述特效数据以及所述音频特征控制所述一个或多个第二类显示单元的显示。
  16. 根据权利要求15所述的装置，其特征在于，所述音频特征包括振幅和/或频率。
  17. 根据权利要求13-16中任意一项所述的装置，其特征在于，所述第二类显示单元包括氛围灯。
  18. 根据权利要求17所述的装置，其特征在于，所述氛围灯包括第一氛围灯和第二氛围灯，所述第一氛围灯和所述第二氛围灯的灯光特效不同。
  19. 根据权利要求11-18中任意一项所述的装置，其特征在于，所述第一类显示单元包括图像显示装置。
  20. 根据权利要求19所述的装置，其特征在于，所述图像显示装置包括所述第一显示单元，以及第二显示单元和第三显示单元，所述第二显示单元和所述第三显示单元的图像特效不同。
  21. 一种装置，其特征在于，包括处理器和存储器，所述处理器用于读取所述存储器所存储的计算机程序，以执行如权利要求1至10中任意一项所述的方法。
  22. 一种显示系统，其特征在于，包括计算平台和显示装置，所述计算平台包括如权利要求11至21中任意一项所述的装置，所述显示装置包括第一类显示单元，所述第一类显示单元用于根据所述计算平台输出的特效数据显示第一特效，所述第一类显示单元包括一个或多个显示单元。
  23. 根据权利要求22所述的显示系统，其特征在于，所述显示装置还包括第二类显示单元，所述第二类显示单元用于根据所述计算平台输出的特效数据显示第二特效，所述第二类显示单元包括一个或多个显示单元。
  24. 根据权利要求22或23所述的显示系统，其特征在于，所述第一类显示单元包括图像显示装置，所述第二类显示单元包括氛围灯。
  25. 一种车辆，其特征在于，包括如权利要求11至21中任意一项所述的装置或如权利要求22至24中任意一项所述的显示系统。
  26. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质用于存储计算机程 序，当所述计算机程序在计算机上运行时，使得所述计算机执行如权利要求1至10中任意一项所述的方法。
PCT/CN2023/072244 2023-01-16 2023-01-16 一种实现座舱影院观影特效的方法、装置、系统及车辆 Ceased WO2024152137A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2023/072244 WO2024152137A1 (zh) 2023-01-16 2023-01-16 一种实现座舱影院观影特效的方法、装置、系统及车辆
CN202380074420.1A CN120239970A (zh) 2023-01-16 2023-01-16 一种实现座舱影院观影特效的方法、装置、系统及车辆

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2023/072244 WO2024152137A1 (zh) 2023-01-16 2023-01-16 一种实现座舱影院观影特效的方法、装置、系统及车辆

Publications (1)

Publication Number Publication Date
WO2024152137A1 true WO2024152137A1 (zh) 2024-07-25

Family

ID=91955089

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/072244 Ceased WO2024152137A1 (zh) 2023-01-16 2023-01-16 一种实现座舱影院观影特效的方法、装置、系统及车辆

Country Status (2)

Country Link
CN (1) CN120239970A (zh)
WO (1) WO2024152137A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120540616A (zh) * 2025-03-19 2025-08-26 深圳引望智能技术有限公司 交互方法、装置和车辆

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070153139A1 (en) * 2005-12-30 2007-07-05 Dei Headquarters, Inc. Automotive entertainment console and dockable entertainment devices
WO2021057740A1 (zh) * 2019-09-26 2021-04-01 北京字节跳动网络技术有限公司 视频生成方法、装置、电子设备和计算机可读介质
CN114040249A (zh) * 2021-11-26 2022-02-11 康佳集团股份有限公司 基于画面的氛围灯调节方法、装置、智能终端及存储介质
CN114454836A (zh) * 2022-01-28 2022-05-10 岚图汽车科技有限公司 一种车载影院系统的控制方法及装置
CN115243107A (zh) * 2022-07-08 2022-10-25 华人运通(上海)云计算科技有限公司 短视频播放的方法、装置、系统、电子设备和介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070153139A1 (en) * 2005-12-30 2007-07-05 Dei Headquarters, Inc. Automotive entertainment console and dockable entertainment devices
WO2021057740A1 (zh) * 2019-09-26 2021-04-01 北京字节跳动网络技术有限公司 视频生成方法、装置、电子设备和计算机可读介质
CN114040249A (zh) * 2021-11-26 2022-02-11 康佳集团股份有限公司 基于画面的氛围灯调节方法、装置、智能终端及存储介质
CN114454836A (zh) * 2022-01-28 2022-05-10 岚图汽车科技有限公司 一种车载影院系统的控制方法及装置
CN115243107A (zh) * 2022-07-08 2022-10-25 华人运通(上海)云计算科技有限公司 短视频播放的方法、装置、系统、电子设备和介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120540616A (zh) * 2025-03-19 2025-08-26 深圳引望智能技术有限公司 交互方法、装置和车辆

Also Published As

Publication number Publication date
CN120239970A (zh) 2025-07-01

Similar Documents

Publication Publication Date Title
US10573085B2 (en) Reality mixer for mixed reality
CN110475065B (zh) 图像处理的方法、装置、电子设备及存储介质
US20120127284A1 (en) Head-mounted display device which provides surround video
EP4502779A1 (en) Control method and electronic device
NL2025869B1 (en) Video pass-through computing system
CN112035046B (zh) 榜单信息显示方法、装置、电子设备及存储介质
KR20160032170A (ko) 자동 이미지 크로핑 및 공유
US10846560B2 (en) GPU optimized and online single gaussian based skin likelihood estimation
CN114782659B (zh) 图像处理方法、装置、设备及存储介质
WO2020173199A1 (zh) 显示方法及装置、电子设备及存储介质
US20200292825A1 (en) Attention direction on optical passthrough displays
CN103997687A (zh) 用于向视频增加交互特征的技术
US12335564B2 (en) Parameter selection for media playback
WO2024022437A1 (zh) 一种显示方法、装置和移动载体
US20250156985A1 (en) Method and device for latency reduction of an image processing pipeline
CN111507889A (zh) 图像处理方法、装置、电子设备及计算机可读存储介质
CN118159341A (zh) 一种图像帧的渲染方法及相关装置
WO2024152137A1 (zh) 一种实现座舱影院观影特效的方法、装置、系统及车辆
CN116126182A (zh) 特效处理方法、装置、电子设备及存储介质
US11187914B2 (en) Mirror-based scene cameras
CN118069277A (zh) 一种多模态虚拟现实内容控制方法、装置、终端设备及介质
CN111231826A (zh) 一种全景影像中车辆模型转向灯的控制方法、装置、系统及存储介质
US20260129311A1 (en) Adaptive foveated image sensors for near-eye devices
CN120882604B (zh) 座舱控制方法、电子系统及车辆
CN111880876B (zh) 对象处理方法及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23916630

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202380074420.1

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 202380074420.1

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23916630

Country of ref document: EP

Kind code of ref document: A1