CN114615491A - Video conference network perception evaluation method, system, electronic equipment and medium - Google Patents

Abstract

The invention discloses a video conference network perception evaluation method, system, electronic equipment and medium. The method includes: slicing UDP session streams of a video conference; calculating the time interval for receiving payload data packets in each slice and the valid Average size of payload packets; determine the type of video conference according to the time interval for receiving payload packets in slices and the average size of payload packets; Mark each slice as good/bad; calculate the ratio of good/bad slices to evaluate the network perception of the video conference. According to the method provided by the embodiment of the present invention, the user's network perception situation during the video conference is evaluated through a simple and single index throughout the entire video conference.

Description

A video conference network perception evaluation method, system, electronic device and medium

technical field

The present application relates to the technical field of video conference quality evaluation, in particular to a video conference network perception evaluation method.

Background technique

With the rapid development of mobile communication technology, the network speed has been improved, and the network delay has been reduced. The mobile communication service provides a strong foundation for the realization of remote office such as cloud office and remote conference. The corresponding mobile phone remote conference emerges as the times require. Through remote conference software, people can conduct video conference discussions anytime and anywhere, changing the way people work. ,Improved work efficiency. There are many user perception indicators in the teleconferencing software carried on the mobile communication network, among which the network status perception is the important perception information in the user's use process. in accordance with.

The current video conferencing software mainly transmits data packets through UDP (User Datagram Protocol), because in the process of video conferencing, there are various conference status scenarios, such as pure audio, pure video, audio and video mixing, changes in the number of users and sharing Desktop, etc., as well as the changes of one or more of the above-mentioned scenarios, in each scenario to ensure good user perception, the requirements for speed or delay are different, and the existing technology cannot use a simple and single indicator to penetrate the entire video conference. Evaluate users' network awareness during video conferences.

SUMMARY OF THE INVENTION

In view of one or more of the above-mentioned problems, embodiments of the present invention provide a method for evaluating network perception of a video conference, so as to solve the problem that a simple and effective indicator cannot currently be used to evaluate the network perception of a user during a conference.

In order to solve the above technical problems, an embodiment of the present application provides a video conference network perception evaluation method, including:

Slice the UDP session stream of the video conference;

Calculate the time interval for receiving payload data packets in each slice and the average size of the payload data packets;

Determine the type of video conference according to the time interval of receiving payload data packets in the slice and the average size of the payload data packets;

Calculate the slice rates of different conference types, and judge and mark the quality/bad quality of each slice according to the calculation results of the slice rates;

The ratio of the high-quality/poor-quality slices is calculated to evaluate the network perception of the video conference.

Preferably, slicing the UDP session stream of the video conference includes: slicing the UDP session stream of the video conference according to the duration of 1s.

Preferably, the state type of the video conference is judged according to the time interval for receiving the payload data packet in the slice and the average size of the payload data packet, including:

If the time interval of the payload data packets in the received slice is >500ms, it is determined that the video conference is in a suspended state;

If the time interval of the payload data packets in the received slice is >40ms and <500ms, it is determined that the video conference is in a shared static desktop state;

If the time interval of the payload data packet in the received slice is >15ms and <40ms, and the length of the payload data packet is >400byte, it is determined that the video conference is in a shared static video state;

If the time interval of the payload data packet in the received slice is >15ms and <40ms, and the length of the payload data packet is ≤400byte, it is determined that the video conference is in an audio conference state;

If the time interval of the payload data packet in the received slice is <15ms, and the length of the payload data packet is >400byte, then it is determined that the video conference is in the audio state of the shared desktop;

If the time interval of the payload data packets in the received slice is <15ms, and the length of the payload data packets is less than or equal to 400 bytes, it is determined that the video conference is a shared dynamic video or dynamic desktop state.

Preferably, the slice rates of different conference types are calculated, and the quality/bad quality of each slice is judged, including:

When the video conference is in a suspended state, marking the slice as a high-quality slice;

When the video conference is in a shared static desktop state, marking the slice as a high-quality slice;

When the video conference is in the state of sharing static video, if the average rate of the slice is >250Kbps, the slice is marked as a high-quality slice; if the average rate is ≤ 250Kbps, the slice is marked as a poor-quality slice slice;

When the video conference is in an audio conference state, if the average rate of the slice is >70Kbps, the slice is marked as a high-quality slice; if the average rate is ≤70Kbps, the slice is marked as a poor-quality slice ;

When the video conference is in the audio state of the shared desktop, if the average rate of the slice is >120Kbps, the slice is marked as a high-quality slice; if the average rate of the slice is ≤120Kbps, the slice is marked as poor quality slices;

When the video conference is in the state of sharing dynamic video or dynamic desktop, if the average rate of the slice is >500Kbps, the slice will be marked as a high-quality slice; if the average rate of the slice is ≤500Kbps, the slice will be marked as a high-quality slice. Labeled as poor quality slices.

Preferably, calculating the ratio of the high-quality/poor-quality slices to perform network-aware evaluation, including:

The ratio of poor quality slices is the number of poor quality slices/total slice data*100%, and the ratio of poor quality slices is taken as the video conference freeze ratio.

An online video conference network perception evaluation system, characterized in that the system includes:

The session stream processing module is used to slice the UDP session stream of the online video conference;

a slice data calculation module for calculating the time interval for receiving payload data packets in each slice and the average size of the payload data packets;

A conference type judging module, used for judging the type of online video conference according to the time interval of receiving payload data packets in the slice and the average size of the payload data packets;

A slice quality judgment module, configured to calculate slice rates of different conference types, and to judge and mark the high quality/poor quality of each slice according to the calculation results of the slice rates;

The network perception evaluation module is used to calculate the ratio of the high-quality/poor-quality slices to evaluate the network perception of the online video conference.

Preferably, the network perception evaluation module is further configured to use the value of the number of poor quality slices/total slice data*100% as the freeze ratio of the online video conference, and to determine whether the online video conference is stuck.

An electronic device for video conference network perception evaluation, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements the above-mentioned video when executing the program. Conferencing Network Awareness Evaluation Method.

A computer-readable storage medium comprising instructions, when executed on a computer, cause the computer to perform the method as described above.

The technical solution of the present application can identify changes in one or more combinations of scenarios such as pure audio, pure video, audio and video mixing, changes in the number of users, and shared desktops during a video conference through the features of UDP session stream slices , and then according to different current scenarios of the video conference, the corresponding indicator threshold is used to judge the user's perception situation.

This application uses a single indicator to evaluate the user perception in the whole conference process, and can be applied to evaluate the video conference service perception in multiple dimensions such as users or networks, monitor the indicators in real-time single (multiple) user video conferences, and also It can be used for statistical analysis of single (multiple) user video conferences and to guide the implementation of related network optimization solutions, so as to ensure that users can obtain good perception when conducting real-time conferences.

Description of drawings

The present invention can be better understood from the following description of specific embodiments of the present invention in conjunction with the accompanying drawings, wherein:

Other features, objects and advantages of the present invention will become more apparent upon reading the following detailed description of non-limiting embodiments with reference to the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar features.

FIG. 1 is a flowchart of a method for evaluating network perception of a video conference provided by an embodiment of the present application;

2 is an example diagram of identifying different conference scenarios in a video conference network perception evaluation method provided by an embodiment of the present application;

FIG. 3 is a flowchart of algorithm judgment in a video conference network perception evaluation method provided by an embodiment of the present application.

Detailed ways

Features and exemplary embodiments of various aspects of the invention are described in detail below. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced without some of these specific details. The following description of the embodiments is only intended to provide a better understanding of the present invention by illustrating examples of the invention. The present invention is in no way limited to any specific configurations and algorithms set forth below, but covers any modification, substitution and improvement of elements, components and algorithms without departing from the spirit of the invention. In the drawings and the following description, well-known structures and techniques have not been shown in order to avoid unnecessarily obscuring the present invention.

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. In the figures, the thickness of regions and layers may be exaggerated for clarity. The same reference numerals in the drawings denote the same or similar structures, and thus their detailed descriptions will be omitted.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of embodiments of the present invention. However, one skilled in the art will appreciate that the technical solutions of the present invention may be practiced without one or more of the specific details, or with other methods, components, materials, etc. being employed. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring the main technical idea of the present invention.

At present, video conferencing software supports multi-terminal and multi-mode membership, which not only fits people's usage habits in the mobile Internet era, but also has richer and more intelligent functions, such as desktop sharing, file sharing, live conference, video recording, With interactive functions such as raising your hand to speak, employees can quickly organize, initiate, and participate in meetings through their own meeting accounts, greatly improving the efficiency of internal collaboration and communication within the enterprise.

UDP does not need to establish a connection between the client and the server before transmitting data, and there is no mechanism such as timeout and retransmission, so the transmission speed is very fast; the current video conferencing software mainly transmits data packets through the UDP protocol.

Please refer to FIG. 1. FIG. 1 is a flowchart of a method for evaluating network perception of a video conference provided by an embodiment of the present application. in:

Step S1: slicing the UDP session stream of the video conference;

A session stream can be UDP data from an fetch server, which is then sliced.

Step S2: Calculate the time interval for receiving payload data packets in each slice and the average size of the payload data packets;

Step S3: Judging the type of video conference according to the time interval of receiving payload data packets in the slice and the average size of the payload data packets;

Step S4: Calculate the slice rates of different conference types, and judge and mark the quality/bad quality of each slice according to the calculation result of the slice rates;

Step S5: Calculate the ratio of the high-quality/poor-quality slices, and evaluate the network perception of the video conference.

In the above embodiment, due to the existence of various conference state scenarios in the video conference, the transmission rate of the code stream (session stream) in different scenarios is different. A combination of various scenarios, etc., and the transmission rate is used as a basis for judging whether the video is stuck in the perception of online conference use, so this embodiment first slices the UDP session stream, and then calculates the payload data packets in each slice (payload data packets). Packet) time interval, judge the conference status scenario according to the time interval, calculate the rate of slices of different conference status, determine whether each slice is a high-quality/bad-quality session stream, calculate the ratio of the poor-quality session stream, and use it as a video conference card The pause indicator is used to judge the user's usage perception.

In the above-mentioned embodiment, according to the situation that the user perception is guaranteed to be good in each scenario, the requirements for the network rate or delay are different, and the user perception (stutter) during the conference process is evaluated by UDP session stream slicing, and simple indicators are used. Throughout the entire video conference, the user's network perception situation during the video conference is evaluated, which effectively provides an important basis for the follow-up to ensure the user's good network perception.

In another embodiment of the present application, slicing the UDP session stream of the video conference includes: slicing the UDP session stream of the video conference according to the duration of 1s.

The network resources are flexibly allocated according to the duration of 1s, and the network is formed on demand; for example, the UDP session stream in a video conference is sliced according to the duration of 1s, as the basic data source for computing, and the following characteristics are obtained:

Data size of the first packet of the session stream: 355 or 356bytes;

Bits 109 to 116 Characteristics: c0 9f c0 5d c0 61c0 57.

Of course, slicing according to the 1s duration in the above embodiment is a preferred implementation in this application. In practical applications, an appropriate slicing duration can be selected as the basic data source according to the actual situation, which is not limited in this application.

Please refer to FIG. 2 and FIG. 3. FIG. 2 is an example diagram of identifying different conference scenarios in a video conference network perception evaluation method provided by an embodiment of the application; FIG. 3 is another video conference network perception provided by an embodiment of the application. In the evaluation method, the algorithm judges the flow chart. In another embodiment of the present application, the state type of the video conference is determined according to the time interval at which the payload data packets are received in the above 1s duration slice (Bits/1s) and the average size of the payload data packets. The slice rate of the conference type is calculated, and the quality/bad quality of each slice is judged. It can be concluded from Figure 2 that when slicing with 1s duration as the data source:

If the time interval between the payload packets (Payload packets) in the received slice is >500ms, the corresponding video conference state is paused; for example, when entering the conference, the video is turned off, the audio is muted, and the desktop whiteboard is not shared; at this time, the slice can be Directly marked as high quality slices.

If the time interval between the payload packets in the received slice is >40ms and <500ms, the corresponding video conference state is the shared static desktop state; for example, during the conference, the video is turned off, the audio is muted, and only the static desktop whiteboard is shared, similar to the above only sharing The conference is in the paused state of the static desktop whiteboard (for example, only 1 page of PPT is shared, and no pages are turned); at this time, the slice can be directly marked as a high-quality slice.

If the time interval of the payload packets in the received slice is >15ms and <40ms, and the length of the payload packets is >400byte, the corresponding video conference is in a shared static video state, for example, the video is shared, but the audio is muted (That is, only one person's avatar video is displayed in the meeting). Among them, if the average rate of the slice is > 250Kbps, it is marked as a high-quality slice, otherwise it is marked as a poor-quality slice.

If the time interval of the payload packets in the received slice is >15ms and <40ms, and the length of the payload packets is ≤400byte, the corresponding video conference state is the audio conference state; for example, the video is not enabled, but only the voice conference is enabled. . Among them, if the average rate of the slice is > 70Kbps, it is marked as a high-quality slice, otherwise it is marked as a poor-quality slice.

If the time interval of the payload packets in the received slice is <15ms, and the length of the payload packet is >400byte, the corresponding video conference status is the audio status of the shared desktop, for example, only the audio is turned on in the conference, and the desktop is shared. Content; among them, if the average rate of the slice is >120Kbps, it is marked as a high-quality slice, otherwise it is marked as a poor-quality slice.

If the time interval of the payload data packets in the received slice is <15ms, and the length of the payload data packets is less than or equal to 400 bytes, the corresponding video conference state is a shared dynamic video or dynamic desktop state. Among them, if the average rate of the slice is > 500Kbps, it is marked as a high-quality slice, otherwise it is marked as a poor-quality slice.

The above embodiment is derived from a 1s duration slice (Bits/1s) as a basic data source, and is a preferred implementation in this application. The slice duration can be selected as the data source according to the actual situation, which is not specifically limited in this application, but the corresponding solution should also fall within the protection scope of this application.

Among the many user perception indicators of video conferencing, network status perception is an important perceptual information in the user's use process, and timely discovery of the advantages and disadvantages of network conditions can provide an important basis for subsequent improvement of user perception experience; at the same time, the video conference freeze rate It is also an important perception item in video conferences. In an embodiment of the present application, the ratio of poor quality slices is used as the video conference freeze ratio for network perception evaluation. Of course, the proportion of high quality slices can also be used as network good evaluation. basis; where:

The ratio of poor quality slices is the number of poor quality slices/total slice data*100%.

To sum up, in the above-mentioned embodiments of the technical solution of the present application, an evaluation method (based on) UDP code stream fragmentation is proposed by decoding (session stream) based on the code stream and according to the code stream characteristics of the video conference. Collect UDP stream, identify the conference scene, and calculate the size and slice rate of the payload data packet in the corresponding scene, so as to realize the perceptual evaluation in the video conference (including the proportion of freezes, etc.), which solves the problem of the existing technology. It is not possible to use a single indicator to evaluate the user's network perception in the whole conference process, and the solution is simple and effective.

It is to be understood, however, that the present invention is not limited to the specific arrangements and processes described above and illustrated in the drawings. Also, for the sake of brevity, detailed descriptions of known methods and techniques are omitted here. In the above-described embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order of steps after comprehending the spirit of the present invention.

The functional blocks shown in the above-described structural block diagrams may be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, elements of the invention are programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted over a transmission medium or communication link by a data signal carried in a carrier wave. A "machine-readable medium" may include any medium that can store or transmit information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, and the like. The code segments may be downloaded via a computer network such as the Internet, an intranet, or the like.

The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. For example, the algorithms described in particular embodiments may be modified without departing from the basic spirit of the invention in system architecture. Accordingly, the present embodiments are to be considered in all respects as illustrative and not restrictive, and the scope of the present invention is defined by the appended claims rather than the foregoing description, and falls within the meaning and equivalents of the claims. All changes within the scope are thus included in the scope of the invention.

The embodiment of the present application also provides an online video conference network perception evaluation system, including:

The session stream processing module is used to slice the UDP session stream of the online video conference;

a slice data calculation module for calculating the time interval for receiving payload data packets in each slice and the average size of the payload data packets;

A conference type judging module, used for judging the type of online video conference according to the time interval of receiving payload data packets in the slice and the average size of the payload data packets;

A slice quality judgment module, configured to calculate slice rates of different conference types, and to judge and mark the high quality/poor quality of each slice according to the calculation results of the slice rates;

The network perception evaluation module is used to calculate the ratio of the high-quality/poor-quality slices to evaluate the network perception of the online video conference.

Preferably, the network perception evaluation module is further configured to use the value of the number of poor quality slices/total slice data*100% as the freeze ratio of the online video conference, and to determine whether the online video conference is stuck.

The embodiment of the present application also provides an electronic device for video conferencing network perception evaluation, including a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that the processor executes all The above-mentioned video conferencing network perception evaluation method is implemented when the above procedure is executed.

The embodiments of the present application also provide a computer-readable storage medium, which includes instructions, which, when executed on a computer, cause the computer to execute the above method.

The specific implementation manners of the foregoing electronic systems, devices, and computer-readable storage media are the same as the method embodiments, and are not repeated here.

Those skilled in the art should understand that the above-mentioned embodiments are all illustrative and not restrictive. Different technical features appearing in different embodiments can be combined to achieve beneficial effects. Those skilled in the art should be able to understand and implement other variant embodiments of the disclosed embodiments on the basis of studying the drawings, the description and the claims. In the claims, the term "comprising" does not exclude other means or steps; the indefinite article "a" does not exclude a plurality; the terms "first" and "second" are used to designate names rather than to indicate any particular Order. Any reference signs in the claims shall not be construed as limiting the scope. The functions of several parts presented in the claims can be implemented by a single hardware or software module. The mere presence of certain technical features in different dependent claims does not imply that these features cannot be combined to advantage.

Claims (9)

1. a video conference network perception evaluation method, is characterized in that, comprises: Slice the UDP session stream of the video conference; Calculate the time interval for receiving payload data packets in each slice and the average size of the payload data packets; Determine the type of video conference according to the time interval of receiving payload data packets in the slice and the average size of the payload data packets; Calculate the slice rates of different conference types, and judge and mark the quality/bad quality of each slice according to the calculation results of the slice rates; The ratio of the high-quality/poor-quality slices is calculated to evaluate the network perception of the video conference. 2. video conference network perception evaluation method according to claim 1, is characterized in that, the UDP session flow of video conference is sliced and comprises: The UDP session stream of the video conference is sliced according to the duration of 1s. 3. video conference network perception evaluation method according to claim 2, is characterized in that, according to the time interval of receiving payload data packet in described slice and the average size of described payload data packet to judge the state type of video conference, include: If the time interval of the payload data packets in the received slice is >500ms, it is determined that the video conference is in a suspended state; If the time interval of the payload data packets in the received slice is >40ms and <500ms, it is determined that the video conference is in a shared static desktop state; If the time interval of the payload data packet in the received slice is >15ms and <40ms, and the length of the payload data packet is >400byte, it is determined that the video conference is in a shared static video state; If the time interval of the payload data packet in the received slice is >15ms and <40ms, and the length of the payload data packet is ≤400byte, it is determined that the video conference is in an audio conference state; If the time interval of the payload data packet in the received slice is <15ms, and the length of the payload data packet is greater than 400 bytes, it is determined that the video conference is in the audio state of the shared desktop; If the time interval of the payload data packets in the received slice is <15ms, and the length of the payload data packets is less than or equal to 400 bytes, it is determined that the video conference is a shared dynamic video or dynamic desktop state. 4. The video conferencing network perception evaluation method according to any one of claims 1-3, wherein the slice rates of different conference types are calculated, and the quality/bad quality of each slice is judged, comprising: When the video conference is in a suspended state, marking the slice as a high-quality slice; When the video conference is in a shared static desktop state, marking the slice as a high-quality slice; When the video conference is in the state of sharing static video, if the average rate of the slice is >250Kbps, the slice is marked as a high-quality slice; if the average rate is ≤ 250Kbps, the slice is marked as a poor-quality slice slice; When the video conference is in an audio conference state, if the average rate of the slice is >70Kbps, the slice is marked as a high-quality slice; if the average rate is ≤70Kbps, the slice is marked as a poor-quality slice ; When the video conference is in the audio state of the shared desktop, if the average rate of the slice is >120Kbps, the slice is marked as a high-quality slice; if the average rate of the slice is ≤120Kbps, the slice is marked as poor quality slices; When the video conference is in the state of sharing dynamic video or dynamic desktop, if the average rate of the slice is >500Kbps, the slice will be marked as a high-quality slice; if the average rate of the slice is ≤500Kbps, the slice will be marked as a high-quality slice. Labeled as poor quality slices. 5. The video conference network perception evaluation method according to any one of claims 1, wherein, calculating the ratio of the high-quality/poor quality slices, and performing network-aware evaluation, comprising: The ratio of poor quality slices is the number of poor quality slices/total slice data*100%, and the ratio of poor quality slices is taken as the video conference freeze ratio. 6. A video conferencing network perception evaluation system, wherein the system comprises: The session stream processing module is used to slice the UDP session stream of the video conference; a slice data calculation module for calculating the time interval for receiving payload data packets in each slice and the average size of the payload data packets; A conference type judging module, used for judging the type of video conference according to the time interval of receiving payload data packets in the slice and the average size of the payload data packets; A slice quality judgment module, configured to calculate slice rates of different conference types, and to judge and mark the high quality/poor quality of each slice according to the calculation results of the slice rates; The network perception evaluation module is used to calculate the ratio of the high-quality/poor-quality slices to evaluate the network perception of the video conference. 7. The video conference network perception evaluation system according to claim 6, is characterized in that, comprising: The network perception evaluation module is further configured to take the value of the number of bad quality slices/total slice data*100% as the freeze ratio of the video conference, and to determine whether the video conference freezes. 8. An electronic device for video conferencing network perception evaluation, comprising a memory, a processor and a computer program stored on the memory and running on the processor, wherein the processor implements the program as claimed in the right when executing the program. The steps of the video conference network perception evaluation method described in any one of 1 to 5 are required. 9. A computer-readable storage medium comprising instructions which, when executed on a computer, cause the computer to perform the steps of the method of claims 1-5.

Images