[go: up one dir, main page]

CN111263223A - Media volume adjusting method and display device - Google Patents

Media volume adjusting method and display device Download PDF

Info

Publication number
CN111263223A
CN111263223A CN202010098070.0A CN202010098070A CN111263223A CN 111263223 A CN111263223 A CN 111263223A CN 202010098070 A CN202010098070 A CN 202010098070A CN 111263223 A CN111263223 A CN 111263223A
Authority
CN
China
Prior art keywords
audio
sound input
opposite
video file
volume value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010098070.0A
Other languages
Chinese (zh)
Inventor
王光强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Media Network Technology Co Ltd
Juhaokan Technology Co Ltd
Original Assignee
Qingdao Hisense Media Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Media Network Technology Co Ltd filed Critical Qingdao Hisense Media Network Technology Co Ltd
Priority to CN202010098070.0A priority Critical patent/CN111263223A/en
Publication of CN111263223A publication Critical patent/CN111263223A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application discloses a media volume adjusting method, which comprises the steps of detecting sound input of local terminal equipment and sound input of opposite terminal equipment corresponding to audio and video communication when audio and video files are played and audio and video communication is carried out simultaneously; if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file; if the local terminal device does not have sound input and the opposite terminal device does not have sound input, the output volume of the audio and video file is not reduced. Therefore, the method provided by the embodiment of the invention can automatically reduce the output volume of the audio and video file when detecting that the sound input exists in the local terminal device or the opposite terminal device, and does not reduce the playing volume of the media resource when the sound input of the local terminal device and the opposite terminal device is not detected, so that the output volume of the audio and video file is automatically controlled according to the scene under the scene of chatting and watching, the effects of watching and communication experience are ensured, and the user experience is improved.

Description

Media volume adjusting method and display device
Technical Field
The application relates to the technical field of television software, in particular to a media volume adjusting method and display equipment.
Background
With the continuous development of communication technology, terminal devices such as computers, smart phones and display devices have become more and more popular. Among them, for the functions of the display device, different kinds of application programs can be installed in the display device generally due to the higher and higher demand of the user for the application experience. For realizing the video conversation function, install video conversation APP in the display device, and equipment such as the external camera of display device, microphone for it becomes possible to carry out the video conversation on display device. In addition, the display device can also play audio and video files.
At present, people have stronger and stronger requirements on entertainment through a large screen, and people can use display equipment to carry out video call and also can watch audio and video files such as movies and television channels. However, in order to prevent the influence of playing the audio and video files simultaneously on the video call experience when the video call is performed, the existing display device generally can only realize an independent function at the same time, that is, only the video call can be performed, or only the audio and video files can be watched, the video call and the audio and video files cannot be simultaneously watched, and the experience is not good.
Disclosure of Invention
The application provides a media volume adjusting method and display equipment, which are used for solving the problem that the existing display equipment influences each other when a video call is carried out and an audio and video file is watched at the same time.
In a first aspect, the present application provides a media volume adjusting method, including the following steps:
when an audio and video file is played and audio and video communication is carried out at the same time, detecting the sound input of local terminal equipment and the sound input of opposite terminal equipment corresponding to the audio and video communication;
if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file;
and if the local terminal equipment does not have sound input and the opposite terminal equipment does not have sound input, the output volume of the audio and video file is not reduced.
Further, the detecting of the sound input of the home terminal device corresponding to the audio and video communication includes:
detecting sound data input by a microphone of the local terminal equipment;
if the sound data meet the preset conditions, the local terminal equipment has sound input;
and if the sound data does not meet the preset condition, the local terminal equipment does not have sound input.
Further, the detecting of the sound input of the opposite terminal device corresponding to the audio and video communication includes:
detecting whether a callback instruction sent by opposite-end equipment is received, wherein the callback instruction is an instruction sent by the opposite-end equipment when the opposite-end equipment carries out audio and video communication with local-end equipment and the opposite-end equipment transmits voice data to the local-end equipment;
if the callback instruction is received, sound input exists in the opposite terminal equipment;
and if the callback instruction is not received, the opposite terminal equipment does not have sound input.
Further, the reducing the output volume of the audio and video file includes:
acquiring an initial output volume value of the audio/video file;
determining a playable volume value according to the initial output volume value, wherein the playable volume value is smaller than the initial output volume value;
and sending the playable volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the playable volume value, and sends the processed audio data and the processed voice data of the opposite terminal device to a loudspeaker for output after being superposed.
Further, after sending the playable volume value to the power amplifier manager, the method further includes:
if in the next detection period, if the equipment does not have sound input and the opposite-end equipment does not have sound input, acquiring an initial output volume value of the audio and video file;
and sending the initial output volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the initial output volume value, and sends the processed audio data and the processed voice data of the equipment at the opposite end to a loudspeaker for output after overlapping.
In a second aspect, the present application provides a display device comprising:
a display configured to display content of the audio-video file;
a speaker configured to output a sound of the audio-video file;
the controller is configured to detect the sound input of local terminal equipment and the sound input of opposite terminal equipment corresponding to audio and video communication when the audio and video file is played and the audio and video communication is carried out simultaneously;
if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file;
and if the local terminal equipment does not have sound input and the opposite terminal equipment does not have sound input, the output volume of the audio and video file is not reduced.
Further, the controller is further configured to:
detecting sound data input by a microphone of the local terminal equipment;
if the sound data meet the preset conditions, the local terminal equipment has sound input;
and if the sound data does not meet the preset condition, the local terminal equipment does not have sound input.
Further, the controller is further configured to:
detecting whether a callback instruction sent by opposite-end equipment is received, wherein the callback instruction is an instruction sent by the opposite-end equipment when the opposite-end equipment carries out audio and video communication with local-end equipment and the opposite-end equipment transmits voice data to the local-end equipment;
if the callback instruction is received, sound input exists in the opposite terminal equipment;
and if the callback instruction is not received, the opposite terminal equipment does not have sound input.
Further, the controller is further configured to:
acquiring an initial output volume value of the audio/video file;
determining a playable volume value according to the initial output volume value, wherein the playable volume value is smaller than the initial output volume value;
and sending the playable volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the playable volume value, and sends the processed audio data and the processed voice data of the opposite terminal device to a loudspeaker for output after being superposed.
Further, the controller is further configured to:
if in the next detection period, if the equipment does not have sound input and the opposite-end equipment does not have sound input, acquiring an initial output volume value of the audio and video file;
and sending the initial output volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the initial output volume value, and sends the processed audio data and the processed voice data of the equipment at the opposite end to a loudspeaker for output after overlapping.
In a third aspect, the present application further provides a storage medium, where the computer storage medium may store a program, and the program may implement, when executed, some or all of the steps in the embodiments of the media volume adjustment method provided in the present application.
According to the technical scheme, when the audio and video file is played and audio and video communication is performed at the same time, the method for adjusting the volume of the media detects the sound input of the local terminal device and the sound input of the opposite terminal device corresponding to the audio and video communication; if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file; if the local terminal device does not have sound input and the opposite terminal device does not have sound input, the output volume of the audio and video file is not reduced. Therefore, the method provided by the embodiment of the invention can automatically reduce the output volume of the audio and video file when detecting that the sound input exists in the local terminal device or the opposite terminal device, and does not reduce the playing volume of the media resource when the sound input of the local terminal device and the opposite terminal device is not detected, so that the output volume of the audio and video file is automatically controlled according to the scene under the scene of chatting and watching, the effects of watching and communication experience are ensured, and the user experience is improved.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment;
fig. 2 is a block diagram exemplarily showing a hardware configuration of a display device 200 according to an embodiment;
fig. 3 is a block diagram exemplarily showing a hardware configuration of the control apparatus 100 according to the embodiment;
fig. 4 is a diagram exemplarily showing a functional configuration of the display device 200 according to the embodiment;
fig. 5a schematically shows a software configuration in the display device 200 according to an embodiment;
fig. 5b schematically shows a configuration of an application in the display device 200 according to an embodiment;
fig. 6 is a flowchart illustrating a media volume adjustment method according to an embodiment;
fig. 7 is a data flow diagram illustrating a media volume adjustment method according to an embodiment;
FIG. 8 is a flow chart illustrating a method of detecting a voice input of a local device according to an embodiment;
FIG. 9 is a flow chart illustrating a method of detecting a peer device voice input according to an embodiment;
fig. 10 is a flowchart illustrating a method of reducing an output volume of an audiovisual file according to an embodiment;
fig. 11 is a block diagram exemplarily showing a structure of a display device according to the embodiment.
Detailed Description
To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.
All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.
It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.
Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.
The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application) that is typically wirelessly controllable over a relatively short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.
The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.
Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100.
The control device 100 may control the display device 200 in a wireless or other wired manner by using a remote controller, including infrared protocol communication, bluetooth protocol communication, other short-distance communication manners, and the like. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.
In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.
For example, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and implement the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the display device 200 can establish a control instruction protocol, synchronize a remote control keyboard to the mobile terminal 300, and control the display device 200 by controlling a user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.
As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library, by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The servers 400 may be a group or groups of servers, and may be one or more types of servers. Other web service contents such as video on demand and advertisement services are provided through the server 400.
The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.
The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include a web tv, a smart tv, an Internet Protocol Tv (IPTV), and the like.
A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2. As shown in fig. 2, the display device 200 includes a controller 210, a tuning demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.
A display 280 for receiving the image signal from the video processor 260-1 and displaying the video content and image and components of the menu manipulation interface. The display 280 includes a display screen assembly for presenting a picture, and a driving assembly for driving the display of an image. The video content may be displayed from broadcast television content, or may be broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network communication protocol and sent from the network server side can be displayed.
Meanwhile, the display 280 simultaneously displays a user manipulation UI interface generated in the display apparatus 200 and used to control the display apparatus 200.
And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen.
The communication interface 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 230 may be a Wifi chip 231, a bluetooth communication protocol chip 232, a wired ethernet communication protocol chip 233, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown).
The display apparatus 200 may establish control signal and data signal transmission and reception with an external control apparatus or a content providing apparatus through the communication interface 230. And an infrared receiver, an interface device for receiving an infrared control signal for controlling the apparatus 100 (e.g., an infrared remote controller, etc.).
The detector 240 is a signal used by the display device 200 to collect an external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor for collecting the intensity of ambient light, and parameters such as parameter changes can be adaptively displayed by collecting the ambient light.
The image acquisition device 241, such as a camera and a camera, may be used to acquire an external environment scene, acquire attributes of a user or interact gestures with the user, adaptively change display parameters, and recognize gestures of the user, so as to implement an interaction function with the user.
In some other exemplary embodiments, the detector 240, a temperature sensor, etc. may be provided, for example, by sensing the ambient temperature, and the display device 200 may adaptively adjust the display color temperature of the image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.
In other exemplary embodiments, the detector 240, and a sound collector, such as a microphone, may be used to receive a user's voice, a voice signal including a control instruction from the user to control the display device 200, or collect an ambient sound for identifying an ambient scene type, and the display device 200 may adapt to the ambient noise.
The input/output interface 250 controls data transmission between the display device 200 of the controller 210 and other external devices. Such as receiving video and audio signals or command instructions from an external device.
Input/output interface 250 may include, but is not limited to, the following: any one or more of high definition multimedia interface HDMI interface 251, analog or data high definition component input interface 253, composite video input interface 252, USB input interface 254, RGB ports (not shown in the figures), etc.
In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the above-mentioned plurality of interfaces.
The tuning demodulator 220 receives the broadcast television signals in a wired or wireless receiving manner, may perform modulation and demodulation processing such as amplification, frequency mixing, resonance, and the like, and demodulates the television audio and video signals carried in the television channel frequency selected by the user and the EPG data signals from a plurality of wireless or wired broadcast television signals.
The tuner demodulator 220 is responsive to the user-selected television signal frequency and the television signal carried by the frequency, as selected by the user and controlled by the controller 210.
The tuner-demodulator 220 may receive signals in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the modulation mode can be digital modulation or analog modulation. Depending on the type of television signal received, both analog and digital signals are possible.
In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the input/output interface 250.
The video processor 260-1 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.
Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.
The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.
And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.
And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.
The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.
The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.
The audio processor 260-2 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, amplification processing, and the like to obtain an audio signal that can be played in the speaker.
In other exemplary embodiments, video processor 260-1 may comprise one or more chips. The audio processor 260-2 may also comprise one or more chips.
And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated together with the controller 210 in one or more chips.
An audio output 272, which receives the sound signal output from the audio processor 260-2 under the control of the controller 210, such as: the speaker 272, and the external sound output terminal 274 that can be output to the generation device of the external device, in addition to the speaker 272 carried by the display device 200 itself, such as: an external sound interface or an earphone interface and the like.
The power supply provides power supply support for the display device 200 from the power input from the external power source under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display device 200, or may be a power supply interface installed outside the display device 200 to provide an external power supply in the display device 200.
A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 210. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.
For example, the user inputs a user command through the remote controller 100 or the mobile terminal 300, the user input interface responds to the user input through the controller 210 according to the user input, and the display device 200 responds to the user input.
In some embodiments, a user may enter a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
The controller 210 controls the operation of the display apparatus 200 and responds to the user's operation through various software control programs stored in the memory 290.
As shown in fig. 2, the controller 210 includes a RAM213 and a ROM214, and a graphic processor 216, a CPU processor 212, a communication interface 218, such as: a first interface 218-1 through an nth interface 218-n, and a communication bus. The RAM213 and the ROM214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.
A ROM213 for storing instructions for various system boots. If the display apparatus 200 starts power-on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM, copies the operating system stored in the memory 290 to the RAM213, and starts running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM213, and then starts running and starting the various application programs.
A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.
A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.
In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for one operation in a standby mode or the like.
The controller 210 may control the overall operation of the display apparatus 100. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.
Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.
The memory 290 includes a memory for storing various software modules for driving the display device 200. Such as: various software modules stored in memory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.
Wherein the basic module is a bottom layer software module for signal communication among the various hardware in the postpartum care display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.
For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between browsing servers. And the service module is used for providing various services and modules including various application programs.
Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.
A block diagram of the configuration of the control apparatus 100 according to an exemplary embodiment is exemplarily shown in fig. 3. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.
The control device 100 is configured to control the display device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. Such as: the user responds to the channel up and down operation by operating the channel up and down keys on the control device 100.
In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display apparatus 200 according to user demands.
In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similar to the control device 100 after installing an application that manipulates the display device 200. Such as: the user may implement the functions of controlling the physical keys of the device 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.
The controller 110 includes a processor 112 and RAM113 and ROM114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.
The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip, a bluetooth module, an NFC module, and other near field communication modules.
A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.
The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, the interface may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.
In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.
A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.
And a power supply 180 for providing operational power support to the various elements of the control device 100 under the control of the controller 110. A battery and associated control circuitry.
Fig. 4 is a diagram schematically illustrating a functional configuration of the display device 200 according to an exemplary embodiment. As shown in fig. 4, the memory 290 is used to store an operating system, an application program, contents, user data, and the like, and performs system operations for driving the display device 200 and various operations in response to a user under the control of the controller 210. The memory 290 may include volatile and/or nonvolatile memory.
The memory 290 is specifically configured to store an operating program for driving the controller 210 in the display device 200, and to store various application programs installed in the display device 200, various application programs downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an OS kernel, middleware, and applications, and to store input video data and audio data, and other user data.
The memory 290 is specifically used for storing drivers and related data such as the audio/video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuning demodulator 220, the input/output interface of the detector 240, and the like.
In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.
The memory 290, for example, includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external instruction recognition module 2907, a communication control module 2908, a light receiving module 2909, a power control module 2910, an operating system 2911, and other applications 2912, a browser module, and the like. The controller 210 performs functions such as: a broadcast television signal reception demodulation function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction recognition function, a communication control function, an optical signal reception function, an electric power control function, a software control platform supporting various functions, a browser function, and the like.
A block diagram of a configuration of a software system in a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 5 a.
As shown in fig. 5a, an operating system 2911, including executing operating software for handling various basic system services and for performing hardware related tasks, acts as an intermediary for data processing performed between application programs and hardware components. In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.
In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display screen, a camera, Flash, WiFi, and audio drivers.
The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.
A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.
The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.
Control applications 2911-4 for controllable process management, including runtime applications and the like.
The event transmission system 2914, which may be implemented within the operating system 2911 or within the application program 2912, in some embodiments, on the one hand, within the operating system 2911 and on the other hand, within the application program 2912, is configured to listen for various user input events, and to refer to handlers that perform one or more predefined operations in response to the identification of various types of events or sub-events, depending on the various events.
The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.
The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.
The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control device 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting gestures through gesture recognition, inputting sub-events through remote control key commands of the control equipment and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.
The interface layout manager 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, and other various execution operations related to the layout of the interface.
As shown in fig. 5b, the application layer 2912 contains various applications that may also be executed at the display device 200. The application may include, but is not limited to, one or more applications such as: live television applications, video-on-demand applications, media center applications, application centers, gaming applications, and the like.
The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.
A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.
The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.
The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200. The application program can provide the video call function of the display device.
When the display device is used for carrying out video call, in order to provide richer experience for a user, the display device provided by the embodiment of the invention can be used for continuously playing the audio and video file at the local terminal when carrying out video call with the opposite terminal, so that an application scene of 'chatting while watching' is realized.
In order to avoid that the output volume of the audio and video file affects the video call, so that a user at the local end cannot hear the speaking sound of the opposite end clearly, the embodiment of the invention provides a media volume adjusting method, which can automatically reduce the output volume of the audio and video file when the sound of the local end and the sound of the opposite end are collected, and automatically recover the output volume of the audio and video file when the sound of the local end or the sound of the opposite end is not collected. Therefore, the method provided by the embodiment can automatically control the output volume of the audio and video files according to the scene under the scene of chatting and watching, ensure the effects of watching and calling experience and improve the user experience.
The media volume adjusting method provided by the embodiment of the invention is applied to display equipment, the display equipment can be an intelligent television and the like, and the intelligent television is internally provided with an APP capable of playing audio and video files and an APP capable of carrying out audio and video communication (video call). The display device may be an intelligent terminal configured with a single system, or may be an intelligent terminal configured with a dual system, and this embodiment is not particularly limited.
Fig. 6 is a flowchart illustrating a media volume adjustment method according to an embodiment; fig. 7 is a data flow diagram illustrating a media volume adjustment method according to an embodiment. Referring to fig. 6 and 7, an embodiment of the present invention provides a media volume adjusting method, where an execution subject is a controller in a display device, the method includes the following steps:
and S1, detecting the sound input of the local terminal device and the sound input of the opposite terminal device corresponding to the audio and video communication when the audio and video file is played and the audio and video communication is carried out simultaneously.
The display device provided by the embodiment of the invention can play the audio and video files and carry out video call (audio and video communication) simultaneously when the social function is presented. For example, in the process of playing the audio and video file, a video call request sent by other users can be answered, or in the process of carrying out video call with other users, the audio and video file can be played, so that a scene of 'chatting while watching' is realized.
When the display device is started, the local user can receive video call requests from other users, wherein the display device is the local device, the devices used by the other users are opposite-end devices, and the devices of the opposite-end users can be display devices and other intelligent terminals.
For the multiple implementation scenarios of "chatting while watching", in order to avoid that the output volume of the audio/video file played in the display device affects users of both parties performing the audio/video communication when the display device performs the audio/video communication, the method provided by this embodiment can adjust the output volume of the audio/video file in the "chatting while watching" scenario, so as to ensure the effects of watching and talking experience of the user, and improve the user experience.
For example, when the local device is playing an audio/video file, in the process, other users send a video call request, and the process of adjusting the output volume of the audio/video file by the local device includes:
and S01, receiving the video call request when the media resource is played.
And S02, responding to the video call request, displaying the video call interface, and stopping playing the media resource.
And S03, responding to an interface switching instruction, reducing the playing volume value of the media resource, wherein the interface switching instruction is used for switching the video call interface into a small window interface.
If the local terminal user operates the display device to receive the video call request, the video call (audio and video communication) between the local terminal device and the opposite terminal device is connected, and at the moment, a video call interface is displayed on the display device. The video call interface may be in a full-screen display state or an enlarged display state, and this embodiment is not particularly limited.
When the local terminal display equipment is connected with the video call, the playing of the audio and video files is immediately stopped, and the influence of the sound output by the audio and video files in the playing state on the effect of the video call is avoided. If the local user operates the display device to be in the video call state all the time and does not enter the scene of chatting and watching at present, at the moment, the video call interface is kept in the full-screen display state or the amplified display state, the audio and video files are in the playing stop state before the video call is finished, and the audio and video files are continuously played until the video call is finished.
However, if the home terminal user operates the display device to reject the video call, at this time, the display device does not respond to the video call request, and the audio/video file continues to be played.
If the user at the home terminal wants to enter a scene of chatting and watching, namely, the user carries out video call (audio and video communication) and watches audio and video files, at the moment, the display equipment at the home terminal can be operated to switch the video call interface from a full-screen display state or an amplified display state into a small-window state. And the small window state is a floating window state, and the video call interface is reduced and displayed to form a small window interface so as to expose the playing interface of the audio and video file.
The home terminal user can talk with the remote controller to operate the display device and generate an interface switching instruction, so that the video call interface is switched to a small window state. And responding to the interface switching instruction by a controller of the display equipment, and continuously playing the audio and video file after finishing the video call interface switching. In order to avoid that the output volume of the audio and video file affects the process of the video call in the scene of chatting and watching, in this embodiment, the playing volume of the audio and video file is adjusted, so that the local user can clearly distinguish the volume of the audio and video file from the volume of the opposite terminal device in the video call while the audio and video file is played, and the effects of watching and calling experience are ensured.
In this embodiment, the playing volume of the audio/video file is adjusted according to the sound input of the local device and the sound input of the opposite device, and the input sounds of the devices at the two ends are detected to adjust in real time.
A flow chart of a method for detecting sound input of a local device according to an embodiment is illustrated in fig. 8. Specifically, referring to fig. 8, in step S1, detecting the sound input of the home device corresponding to the audio/video communication includes:
and S111, detecting voice data input by a microphone of the local terminal equipment.
And S112, if the voice data meet the preset conditions, the local terminal equipment has voice input.
And S113, if the sound data do not meet the preset conditions, the local terminal equipment does not have sound input.
The equipment used for receiving the sound of the local terminal equipment is a microphone, and the microphone is arranged on the display equipment and connected with the controller. The controller in the local terminal display equipment detects the sound data input by the local terminal microphone in real time, and if the sound data can be detected, the sound data indicates that the local terminal equipment generates sound in the environment.
The sound generated by the environment in which the local device is located may be the sound of the local user speaking, or may be noise generated by the environment in which the local device is located, such as the sound generated by other indoor appliances, the sound generated by outdoor vehicles or pedestrians. When the home terminal user uses the display device, the distance from the home terminal user to the display device is usually short, so that the sound data detected by the display device is large; and the sound of other equipment or from the outdoors is far away from the local display equipment, so that the sound data detected by the display equipment is small. Therefore, in order to accurately distinguish that the sound generated by the environment where the local terminal equipment is located is the sound from the speaking of the local terminal user, the sound data can be judged by setting the preset condition.
The preset condition may be a threshold of sound data, and the sound data may be expressed in decibels. If the voice data of the local terminal equipment is detected to meet the preset condition, namely the voice data is higher than the voice data threshold value, the voice of the local terminal can be determined to be the voice of the user, namely the voice input of the local terminal equipment is determined. And if the detected sound data of the local terminal does not meet the preset condition, namely is lower than the sound data threshold, determining that the sound of the local terminal is sound from the outside or the inside, namely determining that no sound input exists in the local terminal equipment.
In some embodiments, the microphone of the local device may be a microphone disposed on the display device body, or may be a microphone disposed on the remote controller.
In some embodiments, the signal strength/amplitude transmitted by the local microphone array to the processor may also be detected to characterize the input of sound data.
In some embodiments, the frequency spectrum of the sound data may be analyzed to determine whether the sound data satisfies a predetermined condition.
Fig. 9 is a flowchart illustrating a method for detecting a voice input of a peer device according to an embodiment. In step S1, referring to fig. 9, detecting a sound input of an opposite terminal device corresponding to the audio/video communication includes:
and S121, detecting whether a callback instruction sent by the opposite terminal device is received, wherein the callback instruction is an instruction sent by the opposite terminal device when the opposite terminal device carries out audio and video communication with the local terminal device and the opposite terminal device transmits voice data to the local terminal device.
And S122, if the callback instruction is received, the opposite terminal equipment has sound input.
And S123, if the callback instruction is not received, the opposite terminal equipment does not have sound input.
When the local terminal user and the opposite terminal user carry out video call, a call link is formed between the local terminal device and the opposite terminal device, and when the opposite terminal device speaks, the opposite terminal device sends session data to the local terminal device and simultaneously sends a callback instruction to the local terminal display device. Therefore, after the controller of the local display device receives the callback instruction sent by the opposite terminal device, it can be determined that the opposite terminal user is speaking, that is, the local display device can detect the opposite terminal radio reception state according to the callback instruction sent by the opposite terminal.
The method comprises the steps that a display device detects whether an opposite terminal device sends a callback instruction in real time in the process of chatting and watching, if the callback instruction sent by the opposite terminal is received, an opposite terminal user is speaking, and then the fact that sound input exists in the opposite terminal device can be determined; if the callback instruction sent by the opposite terminal equipment is not received, the fact that the opposite terminal user does not speak is indicated, and the fact that no sound input exists in the opposite terminal equipment can be determined.
And because the speaking sound of the opposite-end user is small sometimes, in order to accurately determine that the current conversation process is an effective conversation process, the display device can acquire the speaking volume of the opposite-end user, and when the volume of the opposite-end user is higher than a preset volume value, the effective conversation can be determined, and the preset volume value can be set to be 100 decibels or 200 decibels and can be determined according to specific conditions.
That is, only when the volume of the opposite terminal is higher than the preset volume value, the current call is determined as an effective call, and it is determined that the voice input exists in the opposite terminal device.
In some embodiments, the communication software does not output the local sound, but outputs the sound of the opposite end, and at this time, the audio data output by the communication software may be detected to determine whether the sound input is performed by the opposite end device.
In some embodiments, the communication software outputs the local sound and the opposite-end sound at the same time, so that the sound data of the opposite end can be obtained by detecting the audio data output by the communication software and the detected sound data input by the microphone to perform silencing, thereby determining whether the opposite end performs sound input.
And S2, if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file.
In the scene of chatting and watching, on the premise of ensuring the playing of the audio and video files and the simultaneous audio and video communication, in order to avoid the influence of the output volume of the played audio and video files on both parties of the audio and video communication, the method provided by the embodiment automatically reduces the output volume of the audio and video files when the two processes are simultaneously carried out.
Fig. 10 is a flowchart illustrating a method for reducing the output volume of an audio-video file according to an embodiment. In this embodiment, referring to fig. 10, reducing the output volume of the audio/video file includes:
s21, acquiring an initial output volume value of the audio/video file;
s22, determining a playable volume value according to the initial output volume value, wherein the playable volume value is smaller than the initial output volume value;
and S23, sending the playable volume value to the power amplifier manager, so that the power amplifier manager processes the audio data of the audio/video file according to the playable volume value, and sends the processed audio data and the processed audio data of the opposite terminal device to a loudspeaker for output after being superposed.
When an audio/video file is played and audio/video communication is carried out at the same time, a controller in the home terminal display equipment acquires an initial output volume value when the audio/video file is played; and calling a volume notification module, determining a playable volume value based on the initial output volume value, and sending the playable volume value to a power amplifier manager, wherein the playable volume value is 40% -60% of the initial volume value, and the power amplifier manager is used for adjusting the playable volume value of the audio/video file to the playable volume value.
The controller obtains the time for initially outputting the volume value of the audio/video file, and the controller can open and play the audio/video file when a video call interface in the display device is switched to a small window state or in the process of carrying out video call. For example, after the display device responds to the interface switching instruction, in order to adjust the output volume of the audio/video file, an initial output volume value of the audio/video file needs to be obtained first, wherein the initial output volume value refers to a volume value set by the display device when the audio/video file is played.
In this embodiment, the volume notification module is configured in the display device to transmit the volume. The volume notification module sends the determined playable volume value to the power amplifier manager, so that the power amplifier manager processes the audio data of the audio and video file according to the playable volume value, namely, the output volume of the audio and video file is reduced. The playable volume value can be 40% -60% of the initial output volume value, can be selected to be 50%, and the specific value can be determined according to the actual situation on the premise that the video call is not affected when the audio and video file is played.
When the power amplifier processor adjusts the output volume of the local terminal device, the power amplifier processor also needs to process the received sound input by the opposite terminal device, and finally, the processed audio data of the local terminal device and the processed audio data of the opposite terminal device are superposed and then sent to the loudspeaker for output.
And after entering a scene of chatting and watching, continuously playing the audio and video file and simultaneously carrying out audio and video communication based on the reduced playing volume value and the video call interface of the small window state. The display device plays the audio and video files while maintaining the video call state. At the moment, the video call interface is in a small window state, and the output volume of the audio and video file is 40% -60% of the original volume. The local terminal user can watch the media resources and carry out video call at the same time, and can clearly distinguish the volume of the media resources from the volume of the opposite terminal in the video call while playing the media resources, so that the effects of watching the video and calling experience are ensured.
Therefore, when the video call is carried out, the controller of the local terminal display equipment responds to the interface switching instruction and switches the video call interface into a small window interface; and responding to the audio and video file playing request, and reducing the output volume value of the audio and video file. And under the scene of chatting and watching, after the voice input of the local terminal equipment or the voice input of the opposite terminal equipment is detected, the playable volume value of the audio and video file is determined, and the output volume of the audio and video file is adjusted to make the output volume of the audio and video file lower than the initial output volume value.
And S3, if the local terminal device does not have sound input and the opposite terminal device does not have sound input, the output volume of the audio and video file is not reduced.
If the local controller does not detect that the local device has sound input and does not detect that the opposite device has sound input, which indicates that the local user and the opposite user are not speaking, then in order to ensure the normal playing of the audio/video file, the output volume of the audio/video file is not reduced, but the audio/video file is continuously played with the initial output volume value.
Wherein, the condition of not reducing the output volume of the audio and video file comprises: the condition that the output volume of the audio and video file is kept unchanged (the current detection process), and the condition that the reduced output volume is recovered to the initial output volume value (the next detection process).
In order to realize automatic adjustment of media volume according to a scene, namely control of output volume of an audio and video file, in the method provided by the embodiment of the invention, after a display device enters a scene of chatting and watching, whether a local terminal device has sound input or not and whether an opposite terminal device has sound input or not are continuously detected, so that the output volume of the audio and video file is controlled to be adjusted to normal volume when no sound input is collected at both ends; and when the sound at any end is collected for input, the output volume of the audio and video file is controlled to be adjusted to 40-60% of the original volume.
In order to adjust the output volume of the audio/video file efficiently, in this embodiment, when detecting whether the local device has sound input and the opposite device has sound input, it needs to judge with a certain frequency and a certain collection duration, and only if the local device and the opposite device have sound input within a period of time, the output volume value of the audio/video file is recovered.
Specifically, in order to avoid that the display device frequently reduces or recovers the play volume value of the media resource to cause the user dislike, the method provided in this embodiment detects whether the local device has sound input and the peer device has sound input according to the preset detection frequency and the preset times within the preset audio acquisition duration. The display equipment adjusts the output volume of the audio and video file according to whether the audio input of the local terminal equipment or the audio input of the opposite terminal equipment can be detected. If the local terminal equipment has sound input or the opposite terminal equipment has sound input within the preset audio acquisition duration, reducing the output volume of the audio/video file; and when the next preset audio acquisition time length is long, if the local terminal device does not have sound input and the opposite terminal device does not have sound input, determining that no sound is generated in the current video call process, namely the local terminal user and the opposite terminal user do not speak, and restoring the output volume value of the audio and video file to the initial output volume value.
In order to accurately control the output volume of the audio and video file, a preset detection frequency and preset times are set so as to ensure that the detection of the input sound of the local terminal equipment and the opposite terminal equipment is completed once within a preset audio acquisition duration. Specifically, the preset detection frequency may be set to be 500ms for one detection, the preset number of times is four, and the preset audio acquisition time is 2 s.
And detecting every 500ms within 2s, if the local terminal equipment does not have sound input and the opposite terminal equipment does not have sound input, indicating that the current local terminal user and the opposite terminal user do not chat, and calling a power amplifier manager to restore the output sound volume value of the audio and video file to the initial output sound volume value.
And if the display equipment recovers the output volume value of the audio/video file, the display equipment can continuously detect whether the local terminal equipment and the opposite terminal equipment have sound input in real time, and the local terminal equipment has sound input or the opposite terminal equipment has sound input, and the power amplifier manager is called to reduce the output volume of the audio/video file again.
For example, home user A chats with peer user B, C. If the A end speaks, the display equipment can utilize the microphone to receive sound, and the output volume of the audio and video file is reduced when the fact that the local end equipment has sound input is detected within 2 s; during the video call, the home terminal a and the opposite terminal B, C maintain a link of the call, and determine whether the opposite terminal device has sound input or not through the callback state of the link, that is, if the home terminal display device receives the callback instruction sent by the opposite terminal device within 2s, it detects that the opposite terminal device has sound input, and then reduces the output volume of the audio/video file. If the sound input of the local terminal device is not detected within 2s, and the sound input of the opposite terminal device is not detected, the output volume of the audio and video file is recovered, so that the user dislike caused by frequent switching is avoided.
In a detection period, a controller in the local terminal display device detects that sound input exists in the local terminal device or sound input exists in the opposite terminal device within a preset audio acquisition duration, and then the power amplifier manager reduces the output volume of the audio and video file according to the playable volume value; then, the detection is continued, and in the next detection period, the method provided in this embodiment further includes: in the next detection period, if the equipment does not have sound input and the opposite-end equipment does not have sound input, acquiring an initial output volume value of the audio and video file; and sending the initial output volume value to a power amplifier manager so that the power amplifier manager processes audio data of the audio and video file according to the initial output volume value, and sending the processed audio data and the processed voice data of the opposite terminal device to a loudspeaker for output after overlapping.
According to the method provided by the embodiment of the invention, when the audio and video file is adjusted in a scene of chatting and watching, the output volume of the audio and video file is automatically adjusted according to the sound input condition of the local terminal device and the sound input condition of the opposite terminal device which are detected in real time, for example, when the local terminal device has sound input or the opposite terminal device has sound input, the output volume of the audio and video file is reduced, and then if the sound input of the local terminal device and the sound input of the opposite terminal device cannot be detected, the output volume of the audio and video file is restored to the initial output volume value in time; and if the sound input of the local terminal equipment or the sound input of the opposite terminal equipment is detected again, the output volume of the audio and video file is reduced again. Therefore, the method can realize the automatic volume adjustment under the condition that the playing of the audio and video files and the audio and video communication are carried out simultaneously.
According to the technical scheme, when the audio and video file is played and audio and video communication is performed at the same time, the method for adjusting the volume of the media detects the sound input of the local terminal device and the sound input of the opposite terminal device corresponding to the audio and video communication; if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file; if the local terminal device does not have sound input and the opposite terminal device does not have sound input, the output volume of the audio and video file is not reduced. Therefore, the method provided by the embodiment of the invention can automatically reduce the output volume of the audio and video file when detecting that the sound input exists in the local terminal device or the opposite terminal device, and does not reduce the playing volume of the media resource when the sound input of the local terminal device and the opposite terminal device is not detected, so that the output volume of the audio and video file is automatically controlled according to the scene under the scene of chatting and watching, the effects of watching and communication experience are ensured, and the user experience is improved.
Fig. 11 is a block diagram exemplarily showing a structure of a display device according to the embodiment. Referring to fig. 11, the present application provides a display apparatus for performing the steps associated with the media volume adjustment method shown in fig. 6, the display apparatus including: a display 20 configured to display contents of the audio-video file; a speaker 30 configured to output a sound of the audio-video file; the controller 10 is configured to detect a sound input of a local terminal device and a sound input of an opposite terminal device corresponding to audio and video communication when the audio and video file is played and the audio and video communication is performed at the same time; if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file; and if the local terminal equipment does not have sound input and the opposite terminal equipment does not have sound input, the output volume of the audio and video file is not reduced.
Further, the controller 10 is further configured to: detecting sound data input by a microphone of the local terminal equipment; if the sound data meet the preset conditions, the local terminal equipment has sound input; and if the sound data does not meet the preset condition, the local terminal equipment does not have sound input.
Further, the controller 10 is further configured to: detecting whether a callback instruction sent by opposite-end equipment is received, wherein the callback instruction is an instruction sent by the opposite-end equipment when the opposite-end equipment carries out audio and video communication with local-end equipment and the opposite-end equipment transmits voice data to the local-end equipment; if the callback instruction is received, sound input exists in the opposite terminal equipment; and if the callback instruction is not received, the opposite terminal equipment does not have sound input.
Further, the controller 10 is further configured to: acquiring an initial output volume value of the audio/video file; determining a playable volume value according to the initial output volume value, wherein the playable volume value is smaller than the initial output volume value; and sending the playable volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the playable volume value, and sends the processed audio data and the processed voice data of the opposite terminal device to a loudspeaker for output after being superposed.
Further, the controller 10 is further configured to: if in the next detection period, if the equipment does not have sound input and the opposite-end equipment does not have sound input, acquiring an initial output volume value of the audio and video file; and sending the initial output volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the initial output volume value, and sends the processed audio data and the processed voice data of the equipment at the opposite end to a loudspeaker for output after overlapping.
In specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments of the media volume adjusting method provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).
Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.
The same and similar parts in the various embodiments in this specification may be referred to each other. In particular, for the embodiment of the display device, since it is substantially similar to the embodiment of the method, the description is simple, and for the relevant points, refer to the description in the embodiment of the method.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A method for adjusting media volume, comprising the steps of:
when an audio and video file is played and audio and video communication is carried out at the same time, detecting the sound input of local terminal equipment and the sound input of opposite terminal equipment corresponding to the audio and video communication;
if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file;
and if the local terminal equipment does not have sound input and the opposite terminal equipment does not have sound input, the output volume of the audio and video file is not reduced.
2. The method of claim 1, wherein the detecting the sound input of the home device corresponding to the audio/video communication comprises:
detecting sound data input by a microphone of the local terminal equipment;
if the sound data meet the preset conditions, the local terminal equipment has sound input;
and if the sound data does not meet the preset condition, the local terminal equipment does not have sound input.
3. The method according to claim 1, wherein the detecting the sound input of the opposite terminal device corresponding to the audio/video communication comprises:
detecting whether a callback instruction sent by opposite-end equipment is received, wherein the callback instruction is an instruction sent by the opposite-end equipment when the opposite-end equipment carries out audio and video communication with local-end equipment and the opposite-end equipment transmits voice data to the local-end equipment;
if the callback instruction is received, sound input exists in the opposite terminal equipment;
and if the callback instruction is not received, the opposite terminal equipment does not have sound input.
4. The method of claim 1, wherein reducing the output volume of the audio-video file comprises:
acquiring an initial output volume value of the audio/video file;
determining a playable volume value according to the initial output volume value, wherein the playable volume value is smaller than the initial output volume value;
and sending the playable volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the playable volume value, and sends the processed audio data and the processed voice data of the opposite terminal device to a loudspeaker for output after being superposed.
5. The method of claim 4, wherein after sending the playable volume value to the power amplifier manager, further comprising:
if in the next detection period, if the equipment does not have sound input and the opposite-end equipment does not have sound input, acquiring an initial output volume value of the audio and video file;
and sending the initial output volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the initial output volume value, and sends the processed audio data and the processed voice data of the equipment at the opposite end to a loudspeaker for output after overlapping.
6. A display device, comprising:
a display configured to display content of the audio-video file;
a speaker configured to output a sound of the audio-video file;
the controller is configured to detect the sound input of local terminal equipment and the sound input of opposite terminal equipment corresponding to audio and video communication when the audio and video file is played and the audio and video communication is carried out simultaneously;
if the local terminal equipment has sound input and/or the opposite terminal equipment has sound input, reducing the output volume of the audio and video file;
and if the local terminal equipment does not have sound input and the opposite terminal equipment does not have sound input, the output volume of the audio and video file is not reduced.
7. The display device of claim 6, wherein the controller is further configured to:
detecting sound data input by a microphone of the local terminal equipment;
if the sound data meet the preset conditions, the local terminal equipment has sound input;
and if the sound data does not meet the preset condition, the local terminal equipment does not have sound input.
8. The display device of claim 6, wherein the controller is further configured to:
detecting whether a callback instruction sent by opposite-end equipment is received, wherein the callback instruction is an instruction sent by the opposite-end equipment when the opposite-end equipment carries out audio and video communication with local-end equipment and the opposite-end equipment transmits voice data to the local-end equipment;
if the callback instruction is received, sound input exists in the opposite terminal equipment;
and if the callback instruction is not received, the opposite terminal equipment does not have sound input.
9. The display device of claim 6, wherein the controller is further configured to:
acquiring an initial output volume value of the audio/video file;
determining a playable volume value according to the initial output volume value, wherein the playable volume value is smaller than the initial output volume value;
and sending the playable volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the playable volume value, and sends the processed audio data and the processed voice data of the opposite terminal device to a loudspeaker for output after being superposed.
10. The display device of claim 9, wherein the controller is further configured to:
if in the next detection period, if the equipment does not have sound input and the opposite-end equipment does not have sound input, acquiring an initial output volume value of the audio and video file;
and sending the initial output volume value to a power amplifier manager so that the power amplifier manager processes the audio data of the audio and video file according to the initial output volume value, and sends the processed audio data and the processed voice data of the equipment at the opposite end to a loudspeaker for output after overlapping.
CN202010098070.0A 2020-02-18 2020-02-18 Media volume adjusting method and display device Pending CN111263223A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010098070.0A CN111263223A (en) 2020-02-18 2020-02-18 Media volume adjusting method and display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010098070.0A CN111263223A (en) 2020-02-18 2020-02-18 Media volume adjusting method and display device

Publications (1)

Publication Number Publication Date
CN111263223A true CN111263223A (en) 2020-06-09

Family

ID=70952755

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010098070.0A Pending CN111263223A (en) 2020-02-18 2020-02-18 Media volume adjusting method and display device

Country Status (1)

Country Link
CN (1) CN111263223A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114025230A (en) * 2021-11-09 2022-02-08 湖南快乐阳光互动娱乐传媒有限公司 Terminal video playing method and related device
CN114168203A (en) * 2020-09-10 2022-03-11 成都鼎桥通信技术有限公司 Dual-system running state control method and device and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7012652B1 (en) * 2003-01-09 2006-03-14 Sam Stuff Property Trust Audio hush for entertainment equipment and particularly television receivers
CN1909625A (en) * 2005-08-05 2007-02-07 鸿富锦精密工业(深圳)有限公司 Volume self-regulation television device and its control method
US20160134938A1 (en) * 2013-05-30 2016-05-12 Sony Corporation Display control device, display control method, and computer program
CN105872834A (en) * 2015-12-15 2016-08-17 乐视致新电子科技(天津)有限公司 Method and device for volume automatic adjustment in presence of double pictures and intelligent device
CN106791099A (en) * 2016-12-21 2017-05-31 珠海市魅族科技有限公司 Volume adjustment device and method
CN108415753A (en) * 2018-03-12 2018-08-17 广东欧珀移动通信有限公司 User interface display method and device and terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7012652B1 (en) * 2003-01-09 2006-03-14 Sam Stuff Property Trust Audio hush for entertainment equipment and particularly television receivers
CN1909625A (en) * 2005-08-05 2007-02-07 鸿富锦精密工业(深圳)有限公司 Volume self-regulation television device and its control method
US20160134938A1 (en) * 2013-05-30 2016-05-12 Sony Corporation Display control device, display control method, and computer program
CN105872834A (en) * 2015-12-15 2016-08-17 乐视致新电子科技(天津)有限公司 Method and device for volume automatic adjustment in presence of double pictures and intelligent device
CN106791099A (en) * 2016-12-21 2017-05-31 珠海市魅族科技有限公司 Volume adjustment device and method
CN108415753A (en) * 2018-03-12 2018-08-17 广东欧珀移动通信有限公司 User interface display method and device and terminal

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114168203A (en) * 2020-09-10 2022-03-11 成都鼎桥通信技术有限公司 Dual-system running state control method and device and electronic equipment
CN114168203B (en) * 2020-09-10 2024-02-13 成都鼎桥通信技术有限公司 Dual-system running state control method and device and electronic equipment
CN114025230A (en) * 2021-11-09 2022-02-08 湖南快乐阳光互动娱乐传媒有限公司 Terminal video playing method and related device

Similar Documents

Publication Publication Date Title
CN111741372B (en) A screen projection method, display device and terminal device for a video call
CN111050199B (en) Display device and scheduling method of Bluetooth communication resources of display device
CN111405338B (en) Intelligent image quality switching method and display device
CN111343489B (en) A display device and a method for playing music in a terminal
CN111757171A (en) Display device and audio playing method
CN111752518A (en) Screen projection method of display equipment and display equipment
CN111050198A (en) Display device and switching method of Bluetooth audio device
CN111208969A (en) Selection control method of sound output equipment and display equipment
CN112272417B (en) double-Bluetooth sound box reconnection method and display device
CN112104950B (en) Volume control method and display device
CN112214189A (en) Image display method and display device
CN112543359B (en) Display device and method for automatically configuring video parameters
CN113825032B (en) Media asset playing method and display device
CN111343495A (en) Display device and method for playing music in terminal
CN112399254B (en) A kind of display device and color gamut space dynamic adjustment method
CN112399232A (en) Display equipment, camera priority use control method and device
CN111405228A (en) Television, device and method for realizing automatic optimization of video call fluency
WO2021189358A1 (en) Display device and volume adjustment method
CN112188279A (en) Channel switching method and display equipment
CN113438539A (en) Digital television program recording method and display equipment
CN112153440A (en) Display device and display system
CN113495711B (en) Display apparatus and display method
CN111954059A (en) Screen saver display method and display device
CN111263223A (en) Media volume adjusting method and display device
CN110602540B (en) Volume control method of display equipment and display equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200609