The invention is applied to the application number of the Chinese patent application No. 18/04/2018: 201810350927.6, entitled "a screen transmission method, display device and screen transmission system thereof".
Detailed Description
The embodiment of the invention is applied to a scene of screen transmission between data source equipment and at least two pieces of display equipment, wherein the data source equipment is connected with the first-level display equipment in a wireless mode; and the display devices at all levels are connected in a wireless mode, and the audio and video data presented on the data source device are sequentially transmitted to the display devices at all levels.
The data source device can be a smart phone, a notebook computer, a tablet computer and the like.
In the embodiment of the invention, the data source equipment, the first-level display equipment and each display equipment can be wirelessly connected in a WiFi connection mode, a Bluetooth connection mode and the like.
Taking an example that the screen transmission system comprises a data source device and two display devices, a mode of establishing wireless connection between the three devices is described below;
the two display devices are respectively a first display device and a second display device.
The first display device has an access point function, that is, the first display device supports a softAP function; thus, the wireless connection between the data source device and the first display device is established by utilizing the softAP function of the first display device, and correspondingly, the wireless connection between the second display device and the first display device is established by utilizing the softAP function of the first display device.
The second display device is provided with a wireless receiving module; the second display device may be a display or a display screen (liquid crystal display screen or laser display screen) with a wireless receiving box.
When the data source equipment is a mobile phone, intercepting the audio and video data currently presented on a mobile phone screen through screen transmission software in a mode of running the screen transmission software on the mobile phone, and transmitting the intercepted audio and video data to first display equipment;
when the data source device is a computer, the audio and video data currently presented on the computer screen can be transmitted to the first display device by adopting the following two ways:
mode 1, intercepting audio and video data currently presented on a computer screen through screen transmission software in a mode of running the screen transmission software on a computer, and transmitting the intercepted audio and video data to first display equipment;
mode 2, externally connecting an extension device to a computer, intercepting the audio and video data currently presented on a computer screen through screen transmission software in the extension device, and transmitting the intercepted audio and video data to a first display device;
specifically, the expansion equipment is connected with the computer through a USB port of the computer;
when the expansion equipment is used for screen transmission for the first time, the expansion equipment is connected with first display equipment, the first display equipment writes softAP information of the first display equipment into the expansion equipment, and when the expansion equipment is connected with a computer, wireless connection between the first display equipment and the computer is established;
wherein the softAP information includes but is not limited to:
SSID (Service Set Identifier), password, channel information, and frequency.
Optionally, the expansion device is a pass screen Dongle.
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the following description, the matching implementation of the data source device and the display device is described first, but this does not mean that the matching implementation is necessary, and actually, when the data source device and the display device are implemented separately, the problems existing on the data source device and the display device are solved, and only when the data source device and the display device are used in combination, a better technical effect is obtained.
As shown in fig. 1, the screen transmission system according to the embodiment of the present invention includes a data source device 10 and at least two display devices 20;
the data source device 10 is used for intercepting the currently presented audio and video data and sending the audio and video data to a display device connected with the data source device;
the display device 20 is configured to receive audio and video data sent by a previous device; when the fact that the user needs to participate in the on-screen display is determined according to the first selection of the user, the audio and video data are displayed according to the received audio and video data; the upper-level equipment is the data source equipment or the display equipment;
if the display device 20 is a non-final-stage display device, the display device 20 is further configured to intercept currently presented audio and video data, and send the intercepted audio and video data to a next-stage display device.
The display equipment receives the audio and video data sent by the upper-level equipment, and the audio and video data is the audio and video data currently presented by the upper-level equipment; when the display equipment determines that the display equipment needs to participate in the on-screen display, the display equipment presents the audio and video data according to the received audio and video data, so that the screen transmission between the upper-level equipment and the display equipment is realized; and when the display device is not the last stage of display device, the display device also needs to intercept the currently presented audio and video data and send the intercepted audio and video data to the next stage of display device, thereby realizing the screen transmission between the display device and the next stage of display device. By adopting the method of the embodiment of the invention, the audio and video presented by the data source equipment can be transmitted to a plurality of display equipment for display.
When the data source equipment intercepts the currently presented audio and video data, the data source equipment records a current screen, obtains the currently presented video data, intercepts audio data corresponding to the current screen, and packages the obtained video data and audio data to obtain the currently presented audio and video data.
When the display equipment determines that the display equipment needs to participate in the on-screen display and is not the last-stage display equipment, intercepting currently presented audio and video data by the display equipment;
when the display equipment intercepts the currently presented audio and video data, calling a screen intercepting interface of the display equipment, intercepting the video data presented by the current screen, intercepting the audio data corresponding to the current screen, and packaging the acquired video data and audio data to obtain the currently presented audio and video data.
It should be noted that, the method used by the data source device and the display device in the embodiment of the present invention to intercept the currently presented audio and video data is a method in the prior art, and details are not described here.
Aiming at any one display device in at least two stages of display devices in a screen transmission system, the display device receives audio and video data sent by a previous stage of device; the following description is directed to any one of at least two levels of display devices in a touch screen system.
It should be noted that, when the display device is a first-stage display device connected to a data source device, a previous-stage display device of the display device is the data source device, and the display device receives audio and video data sent by the data source device; when the display equipment is not the first-level display equipment, the upper-level display equipment of the display equipment is the display equipment, and the display equipment receives audio and video data sent by the upper-level display equipment.
After receiving audio and video data sent by a previous-level device, a display device determines whether the display device needs to participate in on-screen display according to the selection of a user, and determines a processing mode of the received audio and video data;
specifically, when the selection of the user is a first selection, the display device determines that the same-screen display needs to be participated; when the user's selection is the second selection, the display apparatus determines that participation in the on-screen display is not required.
Optionally, when the display device determines that the same-screen display needs to be participated, the display device presents the audio/video data according to the received audio/video data; if the display equipment is not the last-stage display equipment, the display equipment intercepts the currently presented audio and video data and sends the intercepted audio and video data to the next-stage display equipment;
and when the display equipment determines that the display equipment does not need to participate in the on-screen display, if the display equipment is the non-final-stage display equipment, the display equipment transmits the received audio and video data to the next-stage display equipment.
The following description will be made in each case.
The method comprises the following steps that firstly, the display equipment determines that the same-screen display needs to be participated:
after receiving audio and video data sent by the previous-level equipment, the display equipment determines that the display equipment needs to participate in the same-screen display if the selection of the current user is determined to be a first selection; and the display equipment displays according to the received audio and video data.
If the display equipment is not the last-stage display equipment, the display equipment intercepts the currently presented audio and video data and sends the intercepted audio and video data to the next-stage display equipment;
if the display device is the last stage of display device, the display device does not need to intercept the currently presented audio and video data.
Taking the screen transmission system comprising a data source device and two display devices as an example, the flow of screen transmission will be described;
the two display devices are respectively a first display device and a second display device, the first display device is wirelessly connected with the data source device, and the first display device is wirelessly connected with the second display device.
As shown in fig. 2, a first screen transmission flowchart in the embodiment of the present invention:
step 201, intercepting currently presented audio and video data by data source equipment;
step 202, the data source equipment sends the intercepted audio and video data to first display equipment;
step 203, the first display device determines to participate in the same-screen display according to the first selection of the user;
step 204, the first display device presents according to the received audio and video data;
step 205, intercepting currently presented audio and video data by first display equipment;
step 206, the first display device sends the intercepted audio and video data to a second display device;
and step 207, the second display device presents according to the received audio and video data.
And the display equipment determines that the display equipment does not need to participate in the same-screen display:
after receiving the audio and video data sent by the previous-level equipment, the display equipment determines that the display equipment does not need to participate in the same-screen display if the selection of the current user is determined to be a second selection; and if the display equipment is not the last-stage display equipment, the display equipment transmits the received audio and video data to the next-stage display equipment.
It should be noted that when the display device determines that the display device does not need to participate in the on-screen display, the received audio/video data is directly transmitted to the next-level display device; the received audio and video data do not need to be processed in other ways and presented according to the received audio and video data.
When the display equipment determines that the display equipment does not need to participate in the on-screen display, the display equipment receives user data input by a user through a UI (user interface); and drawing an image according to the user data, and displaying the drawn image.
The display equipment does not need to participate in on-screen display, and directly transmits the received audio/video file to the next-level display equipment, and the display equipment does not need to present the same content as the data source equipment; the display equipment can receive user data input by a user, and performs image drawing and display according to the received user data; therefore, in this manner, the display device can perform display independently.
Taking the screen transmission system comprising a data source device and two display devices as an example, the flow of screen transmission will be described;
the two display devices are respectively a first display device and a second display device, the first display device is wirelessly connected with the data source device, and the first display device is wirelessly connected with the second display device.
As shown in fig. 3, a first screen transmission flowchart in the embodiment of the present invention:
step 301, intercepting currently presented audio and video data by a data source device;
step 302, the data source device sends the intercepted audio and video data to a first display device;
step 303, the first display device determines that the same-screen display does not need to be participated in according to the second selection of the user;
step 304, the first display device transmits the received audio and video data to a second display device;
305, presenting the received audio and video data by the second display device;
and step 306, the first display device receives user data input by a user through the UI, performs image drawing according to the user data, and displays the drawn image.
It should be noted that, the step 304 and the step 306 do not differ in sequence, or the step 304 and the step 306 may be executed simultaneously.
The following describes a screen transmission mode by using the embodiment of the invention in a common teaching scene.
As shown in fig. 4, the touch screen system includes a PC 40 (personal computer), a touch-screen unit 41, and a terminal display device 42 composed of a wireless receiving box 43 and a display screen 44.
The wireless receiving box is connected with the display screen through an HDMI (high-definition multimedia interface) wire;
the touch integrated machine supports the softAP function;
the PC is externally connected with a Dongle through a USB to realize screen transmission;
and establishing wireless connection between a screen Dongle of the PC and the touch all-in-one machine by utilizing the softAP function of the touch all-in-one machine, and establishing wireless connection between the touch all-in-one machine and a wireless receiving box of the terminal display equipment.
The screen transmission process in the teaching scene in the embodiment of the invention comprises the following steps:
1. and the screen transmitting Dongle runs preset screen transmitting software, intercepts the audio and video data currently presented by the PC and transmits the intercepted audio and video data to the touch all-in-one machine.
2. The touch all-in-one machine acquires the selection of a user and judges whether the user needs to participate in the on-screen display;
wherein, the touch integrated machine is preset with options of same-screen display or different-screen display, as shown in fig. 5;
when the user selects the on-screen display, the user determines that the on-screen display needs to be participated, and when the user selects the off-screen display, the user determines that the on-screen display does not need to be participated.
3. And when the touch all-in-one machine determines that the touch all-in-one machine needs to participate in on-screen display, the touch all-in-one machine presents the audio and video data according to the received audio and video data.
4. The touch all-in-one machine intercepts the currently presented audio and video data through a screen capture interface of the touch all-in-one machine, and sends the intercepted audio and video data to a wireless receiving box of the terminal display equipment.
5. And when the touch all-in-one machine determines that the touch all-in-one machine does not need to participate in on-screen display, transmitting the received audio and video data to a wireless receiving box of the terminal display equipment.
6. After receiving the audio and video data, a wireless receiving box of the terminal display equipment sends the audio and video data to a display screen through an HDMI line;
it should be noted that, the audio and video data received by the wireless receiving box is coded data, and the coded data display screen cannot be directly identified; the wireless receiving box needs to decode the received audio and video data, encode the decoded data again, and output and display the data through the HDMI.
7. The display screen is connected to the HDMI terminal of the wireless receiving box through the HDMI line, and then data in the wireless receiving box is displayed.
As shown in fig. 5, an embodiment of the present invention provides a display device, which is located in a screen transmission system including a data source device and at least two stages of display devices, and includes: at least one processing unit 500 and at least one memory unit 501, wherein the memory unit 501 stores program code that, when executed by the processing unit 500, causes the processing unit 500 to perform the following:
receiving audio and video data sent by the upper-level equipment; the audio and video data is the currently presented audio and video data intercepted by the upper-level equipment; the upper-level equipment is the data source equipment or the display equipment;
when the fact that the user needs to participate in the on-screen display is determined according to the first selection of the user, the audio and video data are displayed according to the received audio and video data;
and if the display equipment is not the last-stage display equipment, intercepting the currently presented audio and video data, and sending the intercepted audio and video data to the next-stage display equipment.
Optionally, the processing unit 500 is further configured to:
and when determining that the user does not need to participate in the on-screen display according to the second selection of the user, if the display equipment is not the last-stage display equipment, transmitting the received audio and video data to the next-stage display equipment.
Optionally, the processing unit 500 is further configured to:
after determining that the user does not need to participate in the on-screen display according to the second selection of the user, receiving user data input by the user through a UI (user interface); and drawing an image according to the user data, and displaying the drawn image.
As shown in fig. 6, another display device provided in an embodiment of the present invention includes:
the receiving module 601 is configured to receive audio and video data sent by a previous device; the audio and video data is the currently presented audio and video data intercepted by the upper-level equipment; the upper-level equipment is the data source equipment or the display equipment;
the presentation module 602 is configured to present the received audio and video data when it is determined that the same-screen display needs to be participated in according to a first selection of a user;
the processing module 603 is configured to intercept currently presented audio and video data when the display device is a non-last-stage display device, and send the intercepted audio and video data to a next-stage display device.
Optionally, as shown in fig. 7, the display device further includes a transparent transmission module 604, configured to, when it is determined that participation in on-screen display is not required according to a second selection of the user, transmit the received audio and video data to a next-stage display device if the display device is a non-last-stage display device.
Optionally, as shown in fig. 8, the display device further includes a drawing module 605, configured to receive user data input by the user through the UI interface after determining that participation in the on-screen display is not required according to the second selection of the user; and drawing an image according to the user data, and displaying the drawn image.
Based on the same inventive concept, the embodiment of the invention also provides a screen transmission method, and as the principles of solving the problems of the methods are similar to the screen transmission system in the embodiment of the invention, the implementation of the methods can refer to the implementation of the system, and repeated parts are not described again.
As shown in fig. 9, an embodiment of the present invention provides a screen transmission method, including:
step 901, the display device receives audio and video data sent by a previous-level device; the audio and video data is the currently presented audio and video data intercepted by the upper-level equipment; the upper-level equipment is the data source equipment or the display equipment;
step 902, when the display device determines to participate in the on-screen display according to a first selection of a user, presenting the audio/video data according to the received audio/video data;
and 903, if the display equipment is not the last-stage display equipment, intercepting the currently presented audio and video data, and sending the intercepted audio and video data to the next-stage display equipment.
Optionally, the method further includes:
and when determining that the user does not need to participate in the on-screen display according to the second selection of the user, if the display equipment is not the last-stage display equipment, the display equipment transmits the received audio and video data to the next-stage display equipment.
After determining that participation in on-screen display is not required according to the second selection of the user, the display device further includes:
the display equipment receives user data input by a user through a UI (user interface);
and the display equipment performs image drawing according to the user data and displays the drawn image.
Optionally, the data source device is wirelessly connected with the first-level display device; and the display devices at all levels are connected in a wireless mode.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.