WO2018184189A1 - Adaptive code rate adjustment method and system thereof - Google Patents
Adaptive code rate adjustment method and system thereof Download PDFInfo
- Publication number
- WO2018184189A1 WO2018184189A1 PCT/CN2017/079667 CN2017079667W WO2018184189A1 WO 2018184189 A1 WO2018184189 A1 WO 2018184189A1 CN 2017079667 W CN2017079667 W CN 2017079667W WO 2018184189 A1 WO2018184189 A1 WO 2018184189A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- value
- resolution
- module
- video stream
- ipc
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 41
- 230000000630 rising effect Effects 0.000 claims abstract description 49
- 230000005540 biological transmission Effects 0.000 claims abstract description 29
- 238000012545 processing Methods 0.000 claims description 110
- 238000004458 analytical method Methods 0.000 claims description 18
- 230000003247 decreasing effect Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 5
- 238000009432 framing Methods 0.000 description 4
- 238000007405 data analysis Methods 0.000 description 3
- 238000004806 packaging method and process Methods 0.000 description 3
- 230000011664 signaling Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/24—Systems for the transmission of television signals using pulse code modulation
Definitions
- the present invention relates to a video stream real-time transmission method, and more particularly to a code rate adaptive adjustment method and system thereof.
- the mainstream video transmission technology is mainly based on the RTP real-time transport stream protocol and the RTCP real-time transport stream control protocol.
- the current mainstream video transmission technology has instability, which affects the transmission quality of the network video stream.
- Chinese Patent 201310034273.3 discloses a method for adaptively adjusting code rate in wireless transmission, which is used for adaptive adjustment of video code rate.
- the method comprises: obtaining image complexity parameter according to video feature type parameter of video source data; receiving and receiving end Transmitted wireless channel transmission quality information; obtain wireless transmission index parameters according to wireless channel transmission quality information; obtain target rate parameters according to wireless transmission index parameters; and query code rate control empirical data according to image complexity parameters and target rate parameters a table, obtaining an image output frame rate parameter; sending the image output frame rate parameter to the video encoding module, so that the video encoding module uses the image output frame rate parameter to output the encoded standard video data when the video source data is video encoded Rate is adjusted.
- the invention also discloses an apparatus and system for adaptive adjustment of code rate in wireless transmission.
- the above patent is aimed at the problem that the code rate adjustment algorithm has stable channel bandwidth requirement and low jitter resistance in the prior art, and obtains an image output frame rate parameter, and then adjusts the output bit rate, and does not combine the code rate of the video. And the packet loss rate is judged and adjusted.
- a code rate adaptive adjustment method and the method includes:
- step S23 If the code rate and the frame rate do not reach the upper limit, increase the frame rate and the code rate, and proceed to step S30.
- step S24 If the code rate and the frame rate reach an upper limit, determine whether the GOP value reaches a default value, and proceeds to step S25.
- step S26 If the GOP value does not reach the default value, decrease the GOP value, and proceed to step S30.
- step S27 If the GOP value reaches a default value, determine whether the resolution reaches a maximum value, and proceed to step S28;
- step S32 If the code rate and the frame rate do not reach the lower limit, reduce the frame rate and the code rate, and proceed to step S30.
- step S33 if the code rate and the frame rate reach the lower limit value, determine whether the GOP value reaches a maximum value, and proceeds to step S34;
- step S34 If the GOP value does not reach the maximum value, then the GOP value is adjusted upward, and the process proceeds to step S30.
- step S35 If the GOP value reaches a maximum value, determine whether the resolution reaches a lower limit value, and proceed to step S36;
- the code rate adaptive adjustment method further includes a switching step, performing analysis and judgment according to the received video stream, and entering a handover adjustment according to the analysis and judgment result, acquiring a new video stream and playing.
- Step 1 The video stream transmission step, the IPC_STAE receives the video stream of the IPC_AP, and transmits the video stream to the mobile terminal;
- Step 2 data processing step, the mobile terminal receives the video stream, performs data statistics, and feeds back the statistical result to the IPC_STAE, the IPC_STAE analyzes the data sent by the mobile terminal, and sends the analyzed result to the IPC_AP;
- Step 3 The triggering step, the IPC_AP automatically triggers the rate adjustment adaptively, and the IPC_AP sends a video stream switching request to the IPC_STAE;
- Step 4 request processing step, after receiving the video code stream switching request, the IPC_STAE sends the video code stream switching request to the mobile terminal, and the mobile terminal performs video code stream switching analysis, and the mobile terminal sends a video code stream switching response to the IPC_STAE;
- Step 5 The handover response processing step, the IPC_STAE sends the video code stream switching response to the IPC_AP, and determines whether the adjustment direction of the video stream quality is a rising direction step in the IPC_AP to obtain a new video stream.
- Step 6 The playing step sends a new video stream to the IPC_STAE, and the IPC_STAE sends the video stream to the mobile terminal for video playback.
- the invention also provides a code rate adaptive adjustment system, comprising a judging unit, a rising processing unit and a non-rising processing unit;
- the determining unit is configured to determine whether the adjustment direction of the video stream quality is an upward direction
- the rising processing unit is configured to determine and adjust other elements if the adjustment direction of the video stream quality is in the rising direction, and perform judgment processing on the current code rate, frame rate, GOP value, and resolution, according to the determining process. As a result, a corresponding notification is made;
- the non-rising processing unit When the direction of adjustment of the video stream quality is not the rising direction, the non-rising processing unit performs a determination process on the current code rate, the frame rate, the GOP value, and the resolution, and performs a corresponding notification based on the result of the determination process.
- the rising processing unit includes a preliminary processing module, an upper limit determining module, a non-upper processing module, a default value determining module, a non-default value processing module, a maximum value determining module, a maximum processing module, and a non-maximum Value processing module and notification module;
- the preliminary processing module is configured to judge and adjust other elements
- the upper limit determining module is configured to determine whether the code rate and the frame rate reach an upper limit
- the non-upper limit processing module is configured to increase a frame rate and a code rate if a code rate and a frame rate do not reach an upper limit
- the default value determining module is configured to determine whether the GOP value reaches a default value if the code rate and the frame rate reach an upper limit;
- the non-default value processing module is configured to reduce a GOP value if the GOP value does not reach a default value
- the maximum value determining module is configured to determine that the GOP value reaches a default value and determine whether the resolution reaches a maximum value
- the maximum processing module is configured to notify that the flow parameter has reached an optimal condition if the resolution reaches a maximum value
- the non-maximum processing module is configured to: if the resolution does not reach a maximum value, report a notification that the resolution needs to be manually adjusted, and manually adjust the resolution;
- the notification module is configured to report a notification of setting a flow parameter.
- the non-rising processing unit includes a lower limit determining module, a non-lower limit processing module, a GOP value maximum determining module, a GOP value maximum processing module, a resolution lower limit determining module, a resolution lower limit processing module, and a resolution lower limit.
- the lower limit determining module is configured to determine whether the code rate and the frame rate reach a lower limit value
- the non-lower limit processing module is configured to reduce the frame rate and the code rate if the code rate and the frame rate do not reach the lower limit value;
- the GOP value maximum judging module is configured to determine whether the GOP value reaches a maximum value if the code rate and the frame rate reach a lower limit value;
- the GOP value maximum processing module is configured to: if the GOP value does not reach a maximum value, up-regulate the GOP value;
- the resolution lower limit determining module is configured to determine whether the resolution reaches a lower limit value if the GOP value reaches a maximum value
- the lower resolution processing module is configured to notify that the flow parameter has been unadjustable if the resolution reaches a lower limit value
- the non-lower limit module of the resolution is used for notifying that the resolution does not reach the lower limit value, and then reporting the need to manually lower the resolution, and manually lowering the resolution.
- the code rate adaptive adjustment system further includes a switching unit, configured to perform analysis and judgment according to the received video stream, and enter a handover adjustment according to the analysis and judgment result, acquire a new video stream, and play .
- the switching unit includes a video stream transmission module, a data processing module, a trigger module, a request processing module, a handover response processing module, and a play module.
- the video stream transmission module is configured to receive, by the IPC_STAE, a video stream of the IPC_AP, and transmit the video stream to the mobile terminal;
- the data processing module is configured to: after the mobile terminal receives the video stream, perform data statistics, and feed back the statistical structure to the IPC_STAE, and the IPC_STAE analyzes the data sent by the mobile terminal, and sends the analyzed result to the IPC_AP;
- the triggering module is configured to automatically trigger the rate adjustment of the IPC_AP, and the IPC_AP sends a video stream switching request to the IPC_STAE, or manually triggers the rate adjustment on the mobile terminal;
- the request processing module is configured to send the video code stream switching request to the mobile terminal after the PC_STAE receives the video code stream switching request, and the mobile terminal performs the video code stream switching analysis, and the mobile terminal sends the video code stream switching response to the IPC_STAE;
- the handover response processing module is configured to send, by the IPC_STAE, a video code stream switching response to the IPC_AP to obtain a new video stream;
- the playing module is configured to send a new video stream to the IPC_STAE, and the IPC_STAE sends the video stream to the mobile terminal for video playback.
- the beneficial effects of the present invention compared with the prior art are: the code rate adaptive adjustment method of the present invention, by judging the adjustment direction of the video quality, according to the judgment result, the current resolution, the code rate and the frame rate, and the GOP
- the value judgment process realizes adaptive adjustment of the code rate, thereby achieving a code rate of the output which is the best match with the current network bandwidth, and improving the transmission success rate of the more complete video stream.
- FIG. 1 is a flow chart of a code rate adaptive adjustment method according to an embodiment of the present invention
- FIG. 2 is a block diagram of a specific process of adjusting a video stream quality in a rising direction according to an embodiment of the present invention
- FIG. 3 is a specific process block diagram of a video stream quality adjustment direction that is not a rising direction according to an embodiment of the present invention
- FIG. 4 is a P2P and mobile terminal-IPC signal interaction diagram 1 (automatic trigger) according to a code rate adaptive adjustment method according to an embodiment of the present invention
- FIG. 5 is a second diagram of a P2P interaction with a mobile terminal-IPC signal according to a code rate adaptive adjustment method according to an embodiment of the present invention (manual triggering);
- FIG. 6 is a structural block diagram of a code rate adaptive adjustment system according to an embodiment of the present invention.
- FIG. 7 is a structural block diagram of a rising processing unit according to an embodiment of the present invention.
- FIG. 8 is a structural block diagram of a non-rising processing unit according to an embodiment of the present invention.
- FIG. 9 is a structural block diagram of a switching unit according to an embodiment of the present invention.
- FIG. 10 is a block diagram of a packet loss determination and retransmission system according to an embodiment of the present invention.
- the code rate adaptive adjustment method provided in this embodiment can be used in the process of video stream transmission to achieve the best match between the output rate and the current network bandwidth.
- the bit rate which improves the transmission success rate of a more complete video stream.
- a rate adaptive adjustment method comprising the following specific steps:
- the above-mentioned code rate adaptive adjustment method realizes adaptive adjustment of the code rate by judging the adjustment direction of the video quality, judging the current resolution, the code rate, the frame rate, and the GOP value according to the judgment result. Therefore, the output code rate is matched with the best match rate under the current network bandwidth, and the transmission success rate of the more complete video stream is improved.
- step S23 If the code rate and the frame rate do not reach the upper limit, increase the frame rate and the code rate, and proceed to step S30.
- step S24 If the code rate and the frame rate reach an upper limit, determine whether the GOP value reaches a default value, and proceeds to step S25.
- step S26 If the GOP value does not reach the default value, decrease the GOP value, and proceed to step S30.
- step S27 If the GOP value reaches a default value, determine whether the resolution reaches a maximum value, and proceed to step S28;
- the reduced GOP value increases the proportion of the I frame in the total number of frames.
- step S32 If the code rate and the frame rate do not reach the lower limit, reduce the frame rate and the code rate, and proceed to step S30.
- step S33 if the code rate and the frame rate reach the lower limit value, determine whether the GOP value reaches a maximum value, and proceeds to step S34;
- step S34 If the GOP value does not reach the maximum value, then the GOP value is adjusted upward, and the process proceeds to step S30.
- step S35 If the GOP value reaches a maximum value, determine whether the resolution reaches a lower limit value, and proceed to step S36;
- the code rate adaptive adjustment method further includes a switching step of performing analysis and judgment according to the received video stream, and entering a handover adjustment according to the analysis and determination result, acquiring a new video stream and playing.
- the switching step includes the following steps:
- Step 1 The video stream transmission step, the IPC_STAE receives the video stream of the IPC_AP, and transmits the video stream to the mobile terminal;
- Step 2 data processing step, the mobile terminal receives the video stream, performs data statistics, and feeds back the statistical result to the IPC_STAE, the IPC_STAE analyzes the data sent by the mobile terminal, and sends the analyzed result to the IPC_AP;
- Step 3 The triggering step, the IPC_AP automatically triggers the rate adjustment adaptively, and the IPC_AP sends a video stream switching request to the IPC_STAE;
- Step 4 request processing step, after receiving the video code stream switching request, the IPC_STAE sends the video code stream switching request to the mobile terminal, and the mobile terminal performs video code stream switching analysis, and the mobile terminal sends a video code stream switching response to the IPC_STAE;
- Step 5 The handover response processing step, the IPC_STAE sends the video code stream switching response to the IPC_AP, and determines whether the adjustment direction of the video stream quality is a rising direction step in the IPC_AP to obtain a new video stream.
- Step 6 The playing step sends a new video stream to the IPC_STAE, and the IPC_STAE sends the video stream to the mobile terminal for video playback.
- the code rate adaptive adjustment may be manually triggered on the mobile terminal.
- the embodiment further provides a code rate adaptive adjustment system, including a determining unit 10, a rising processing unit 20, and a non-rising processing unit 30.
- the determining unit 10 is configured to determine whether the adjustment direction of the video stream quality is a rising direction.
- the rising processing unit 20 is configured to determine and adjust other elements if the adjustment direction of the video stream quality is in the rising direction, and determine the current code rate, the frame rate, the GOP value, and the resolution, and determine the processing result according to the determination. , for the corresponding notification.
- the non-rising processing unit 30 When the video stream quality adjustment direction is not the rising direction, the non-rising processing unit 30 performs a determination process on the current code rate, the frame rate, the GOP value, and the resolution, and performs a corresponding notification based on the determination processing result.
- the rising processing unit 20 includes a preliminary processing module 21, an upper limit determining module 22, a non-upper limit processing module 23, a default value determining module 24, a non-default value processing module 25, and a maximum value determining module 26, and a maximum value.
- the preliminary processing module 21 is used for judging and adjusting other elements.
- the upper limit determining module 22 is configured to determine whether the code rate and the frame rate reach an upper limit.
- the non-upper limit processing module 23 is configured to increase the frame rate and the code rate if the code rate and the frame rate do not reach the upper limit.
- the default value judging module 24 is configured to determine whether the GOP value reaches a default value if the code rate and the frame rate reach an upper limit.
- the non-default value processing module 25 is configured to reduce the GOP value if the GOP value does not reach the default value.
- the maximum value judging module 26 is configured to determine that the GOP value reaches a default value and determine whether the resolution reaches a maximum value.
- the maximum value processing module 27 is configured to notify that the flow parameter has reached an optimal condition if the resolution reaches a maximum value.
- the non-maximum processing module 28 is configured to report the resolution that needs to be manually adjusted if the resolution does not reach the maximum value, and manually adjust the resolution.
- the notification module 29 is configured to report the notification of setting the stream parameter.
- the non-rising processing unit 30 includes a lower limit determining module 31, a non-lower limit processing module 32, a GOP value maximum determining module 33, a GOP value maximum processing module 34, a resolution lower limit determining module 35, and a lower resolution processing.
- Module 36 and resolution non-lower limit module 37 are included in the non-rising processing unit 30.
- the lower limit determining module 31 is configured to determine whether the code rate and the frame rate have reached a lower limit value.
- the non-lower limit processing module 32 is configured to reduce the frame rate and the code rate if the code rate and the frame rate do not reach the lower limit value.
- the GOP value maximum judging module 33 is configured to determine whether the GOP value reaches a maximum value if the code rate and the frame rate reach a lower limit value.
- the GOP value maximum processing module 34 is configured to up-regulate the GOP value if the GOP value does not reach the maximum value.
- the resolution lower limit determining module 35 is configured to determine whether the resolution reaches a lower limit value if the GOP value reaches a maximum value.
- the lower resolution processing module 36 is configured to notify that the flow parameter has not been adjusted if the resolution reaches the lower limit.
- the resolution non-lower limit module 37 for the resolution not reaching the lower limit value, reports a notification that the resolution needs to be manually decreased, and performs manual drop resolution.
- the above-mentioned rate adaptive adjustment system further includes a switching unit 40, configured to perform analysis and judgment according to the received video stream, and enter a handover adjustment according to the analysis judgment result, acquire a new video stream, and play.
- a switching unit 40 configured to perform analysis and judgment according to the received video stream, and enter a handover adjustment according to the analysis judgment result, acquire a new video stream, and play.
- the switching unit 40 includes a video stream transmission module 41, a data processing module 42, a trigger module 43, a request processing module 44, a handover response processing module 45, and a playback module 46.
- the video stream transmission module 41 is configured to receive the video stream of the IPC_AP by the IPC_STAE, and transmit the video stream to the mobile terminal.
- the data processing module 42 is configured to perform data statistics after the mobile terminal receives the video stream, and feed back the statistical structure to the IPC_STAE, and the IPC_STAE analyzes the data sent by the mobile terminal, and sends the analyzed result to the IPC_AP.
- the triggering module 43 is configured to automatically trigger the rate adjustment of the IPC_AP, and the IPC_AP sends a video stream switching request to the IPC_STAE, or manually triggers the rate adaptation on the mobile terminal.
- the request processing module 44 is configured to send the video code stream switching request to the mobile terminal after the PC_STAE receives the video code stream switching request, and the mobile terminal performs the video code stream switching analysis, and the mobile terminal sends the video code stream switching response to the IPC_STAE.
- the handover response processing module 45 is configured to send a video code stream switching response to the IPC_AP by the IPC_STAE to acquire a new video stream.
- the playing module 46 is configured to send a new video stream to the IPC_STAE, and the IPC_STAE sends the video stream to the mobile terminal for video playback.
- the judgment unit 10 determines the adjustment direction of the video quality, and according to the determination result, the current resolution, the code rate, the frame rate, and the GOP by the rising processing unit 20 and the non-rising processing unit 30.
- the value judgment process realizes adaptive adjustment of the code rate, thereby achieving a code rate of the output which is the best match with the current network bandwidth, and improving the transmission success rate of the more complete video stream.
- the present invention further provides another solution, a packet loss determination and retransmission system, to ensure that the output data is complete and effective video stream data, thereby improving the video presentation quality and improving the video.
- a packet loss determination and retransmission system to ensure that the output data is complete and effective video stream data, thereby improving the video presentation quality and improving the video.
- the scheme can be used in parallel or independently with the above-described rate adaptive adjustment system.
- the packet loss determination and retransmission system includes a packet sequence reordering module, a packet loss determination module, a packet loss feedback module, a framing buffer management module, and a state feedback module, wherein the packet sequence reordering module and the relocation module
- the packet determination module is connected, the packet loss determination module is connected to the packet loss feedback module, the packet loss feedback module is connected to the group frame buffer management module, and the group frame buffer management module is connected to the state feedback module.
- the packet loss determination and retransmission system further includes a data statistics module, a data analysis module, a framing buffer module, a receive data cache module, a packet filtering module, a receiving module, a sending module, a packaging module, a sending data cache module, a packet loss retransmission module, a signaling processing module, a parameter configuration module, a data input module, a data output module, a status query module, and a status reporting module, wherein the data statistics module and the packet loss determination module, the data analysis module, and the status respectively Querying the module connection; the data analysis module is respectively connected to the state feedback module and the state reporting module, and the receiving data buffering module is respectively connected to the framing buffer module, the packet filtering module and the packet sequence reordering module, wherein the framing frame
- the cache module is connected to the data output module, the packet filter module is connected to the receiving module, the sending module is connected to the packet loss retransmission module and the packaging module, and the packaging module and the data input
- the above code rate adaptive adjustment system and a packet loss determination and retransmission system are all based on the RTCP streaming control protocol for signal transmission.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
Description
Claims (10)
- 码率自适应调节方法,其特征在于,所述方法包括: A code rate adaptive adjustment method, the method comprising:S1、判断视频流质量的调整方向是否是上升方向;S1, determining whether the adjustment direction of the video stream quality is a rising direction;S2、若视频流质量的调整方向是上升方向,则对其他要素进行判断和调整,并对当前的码率和帧率、GOP值以及分辨率进行判断处理,根据判断处理结果,进行对应的通知;S2. If the adjustment direction of the video stream quality is the rising direction, the other elements are judged and adjusted, and the current code rate, the frame rate, the GOP value, and the resolution are judged, and the corresponding notification is performed according to the judgment processing result. ;S3、若视频流质量的调整方向不是上升方向,则对当前的码率和帧率、GOP值以及分辨率进行判断处理,根据判断处理结果,进行对应的通知。S3. If the adjustment direction of the video stream quality is not the rising direction, the current code rate, the frame rate, the GOP value, and the resolution are judged, and the corresponding notification is performed according to the result of the determination processing.
- 根据权利要求1所述的码率自适应调节方法,其特征在于,若视频流质量的调整方向是上升方向,具体包括以下步骤:The code rate adaptive adjustment method according to claim 1, wherein if the adjustment direction of the video stream quality is an upward direction, the method includes the following steps:S21、对其他要素进行判断和调整;S21. Judging and adjusting other elements;S22、判断码率和帧率是否达到上限;S22. Determine whether the code rate and the frame rate reach an upper limit.S23、若码率和帧率未达到上限,则增大帧率和码率,并进入S30步骤;S23. If the code rate and the frame rate do not reach the upper limit, increase the frame rate and the code rate, and proceed to step S30.S24、若码率和帧率达到上限,则判断GOP值是否达到缺省值,并进入S25步骤;S24. If the code rate and the frame rate reach an upper limit, determine whether the GOP value reaches a default value, and proceeds to step S25.S26、若GOP值未达到缺省值,则降低GOP值,并进入S30步骤;S26. If the GOP value does not reach the default value, decrease the GOP value, and proceed to step S30.S27、若GOP值达到缺省值,则判断分辨率是否达到最大值,并进入S28步骤;S27. If the GOP value reaches a default value, determine whether the resolution reaches a maximum value, and proceed to step S28;S28、若分辨率达到最大值,则上报流参数已达到最优的通知,并进入结束步骤;S28. If the resolution reaches a maximum value, reporting that the flow parameter has reached an optimal notification, and entering an end step;S29、若分辨率未达到最大值,则上报需手动上调分辨率的通知,进行手动上调分辨率,并进入结束步骤;S29. If the resolution does not reach the maximum value, report the notification that the resolution needs to be manually adjusted, manually adjust the resolution, and enter the end step;S30、上报设置流参数的通知,并进入结束步骤。S30. Report the notification of setting the flow parameter, and enter the end step.
- 根据权利要求2所述的码率自适应调节方法,其特征在于,若视频流质量的调整方向不是上升方向,具体包括以下步骤:The code rate adaptive adjustment method according to claim 2, wherein if the adjustment direction of the video stream quality is not the rising direction, the method includes the following steps:S31、判断码率和帧率是否达到下限值;S31. Determine whether the code rate and the frame rate reach a lower limit value;S32、若码率和帧率未达到下限值,则降低帧率和码率,并进入S30步骤;S32. If the code rate and the frame rate do not reach the lower limit, reduce the frame rate and the code rate, and proceed to step S30.S33、若码率和帧率达到下限值,则判断GOP值是否达到最大值,并进入S34步骤;S33, if the code rate and the frame rate reach the lower limit value, determine whether the GOP value reaches a maximum value, and proceeds to step S34;S34、若GOP值未达到最大值,则上调GOP值,并进入S30步骤;S34. If the GOP value does not reach the maximum value, then the GOP value is adjusted upward, and the process proceeds to step S30.S35、若GOP值达到最大值,则判断分辨率是否达到下限值,并进入S36步骤;S35. If the GOP value reaches a maximum value, determine whether the resolution reaches a lower limit value, and proceed to step S36;S36、若分辨率达到下限值,则上报流参数已无法调节的通知,并进入结束步骤;S36. If the resolution reaches the lower limit, report that the flow parameter has been unadjustable, and enter the end step;S37、若分辨率未达到下限值,则上报需手动下降分辨率的通知,进行手动下降分辨率,并进入结束步骤。S37. If the resolution does not reach the lower limit value, report a notification that the resolution needs to be manually decreased, perform manual drop resolution, and enter the end step.
- 根据权利要求1至3任一项所述的码率自适应调节方法,其特征在于,所述码率自适应调节方法还包括切换步骤,根据接收的视频流进行分析判断,并根据分析判断结果进入切换调整,获取新的视频流并播放。The code rate adaptive adjustment method according to any one of claims 1 to 3, wherein the code rate adaptive adjustment method further comprises a switching step of performing analysis and judgment according to the received video stream, and determining the judgment result according to the analysis. Enter the switch adjustment to get a new video stream and play it.
- 根据权利要求4所述的码率自适应调节方法,其特征在于,所述切换步骤包括以下步骤:The code rate adaptive adjustment method according to claim 4, wherein the switching step comprises the following steps:步骤1、视频流传输步骤,IPC_STAE接收IPC_AP的视频流,并将该视频流传输至移动终端;Step 1. The video stream transmission step, the IPC_STAE receives the video stream of the IPC_AP, and transmits the video stream to the mobile terminal;步骤2、数据处理步骤,移动终端接收视频流后进行数据统计,并将统计的结果反馈至IPC_STAE,IPC_STAE对移动终端发送的数据进行分析,并将分析的结果发送至IPC_AP;Step 2: data processing step, the mobile terminal receives the video stream, performs data statistics, and feeds back the statistical result to the IPC_STAE, the IPC_STAE analyzes the data sent by the mobile terminal, and sends the analyzed result to the IPC_AP;步骤3、触发步骤,IPC_AP自动触发码率自适应调节,IPC_AP发送视频码流切换请求至IPC_STAE;Step 3: The triggering step, the IPC_AP automatically triggers the rate adjustment adaptively, and the IPC_AP sends a video stream switching request to the IPC_STAE;步骤4、请求处理步骤,IPC_STAE接收视频码流切换请求后,将该视频码流切换请求发送至移动终端,由移动终端进行视频码流切换分析,移动终端发送视频码流切换应答给IPC_STAE;Step 4: request processing step, after receiving the video code stream switching request, the IPC_STAE sends the video code stream switching request to the mobile terminal, and the mobile terminal performs video code stream switching analysis, and the mobile terminal sends a video code stream switching response to the IPC_STAE;步骤5、切换应答处理步骤,IPC_STAE将视频码流切换应答发送至IPC_AP,在IPC_AP内进行判断视频流质量的调整方向是否是上升方向步骤,以获取新的视频流;Step 5: The handover response processing step, the IPC_STAE sends the video code stream switching response to the IPC_AP, and determines whether the adjustment direction of the video stream quality is a rising direction step in the IPC_AP to obtain a new video stream.步骤6、播放步骤,将新的视频流发送至IPC_STAE,IPC_STAE将视频流发送至移动终端,进行视频播放。Step 6. The playing step sends a new video stream to the IPC_STAE, and the IPC_STAE sends the video stream to the mobile terminal for video playback.
- 码率自适应调节系统,其特征在于,包括判断单元、上升处理单元以及非上升处理单元;a rate adaptive adjustment system, comprising: a determining unit, a rising processing unit, and a non-rising processing unit;所述判断单元,用于判断视频流质量的调整方向是否是上升方向;The determining unit is configured to determine whether the adjustment direction of the video stream quality is an upward direction;所述上升处理单元,用于若视频流质量的调整方向是上升方向,则对其他要素进行判断和调整,并对当前的码率和帧率、GOP值以及分辨率进行判断处理,根据判断处理结果,进行对应的通知;The rising processing unit is configured to determine and adjust other elements if the adjustment direction of the video stream quality is in the rising direction, and perform judgment processing on the current code rate, frame rate, GOP value, and resolution, according to the determining process. As a result, a corresponding notification is made;所述非上升处理单元,若视频流质量的调整方向不是上升方向,则对当前的码率和帧率、GOP值以及分辨率进行判断处理,根据判断处理结果,进行对应的通知。When the direction of adjustment of the video stream quality is not the rising direction, the non-rising processing unit performs a determination process on the current code rate, the frame rate, the GOP value, and the resolution, and performs a corresponding notification based on the result of the determination process.
- 根据权利要求6所述的码率自适应调节系统,其特征在于,所述上升处理单元包括初步处理模块、上限判断模块、非上限处理模块、缺省值判断模块、非缺省值处理模块、最大值判断模块,最大值处理模块、非最大值处理模块以及通知模块;The rate adaptive adjustment system according to claim 6, wherein the rising processing unit comprises a preliminary processing module, an upper limit determining module, a non-upper processing module, a default value determining module, a non-default value processing module, a maximum value determination module, a maximum value processing module, a non-maximum processing module, and a notification module;所述初步处理模块,用于对其他要素进行判断和调整;The preliminary processing module is configured to judge and adjust other elements;所述上限判断模块,用于判断码率和帧率是否达到上限;The upper limit determining module is configured to determine whether the code rate and the frame rate reach an upper limit;所述非上限处理模块,用于若码率和帧率未达到上限,则增大帧率和码率;The non-upper limit processing module is configured to increase a frame rate and a code rate if a code rate and a frame rate do not reach an upper limit;所述缺省值判断模块,用于若码率和帧率达到上限,判断GOP值是否达到缺省值;The default value determining module is configured to determine whether the GOP value reaches a default value if the code rate and the frame rate reach an upper limit;所述非缺省值处理模块,用于若GOP值未达到缺省值,降低GOP值;The non-default value processing module is configured to reduce a GOP value if the GOP value does not reach a default value;所述最大值判断模块,用于GOP值达到缺省值,判断分辨率是否达到最大值;The maximum value determining module is configured to determine that the GOP value reaches a default value and determine whether the resolution reaches a maximum value;所述最大值处理模块,用于若分辨率达到最大值,上报流参数已达到最优的通知;The maximum processing module is configured to notify that the flow parameter has reached an optimal condition if the resolution reaches a maximum value;所述非最大值处理模块,用于若分辨率未达到最大值,上报需手动上调分辨率的通知,进行手动上调分辨率;The non-maximum processing module is configured to: if the resolution does not reach a maximum value, report a notification that the resolution needs to be manually adjusted, and manually adjust the resolution;所述通知模块,用于上报设置流参数的通知。The notification module is configured to report a notification of setting a flow parameter.
- 根据权利要求7所述的码率自适应调节系统,其特征在于,所述非上升处理单元包括下限判断模块、非下限处理模块、GOP值最大判断模块、GOP值最大处理模块、分辨率下限判断模块、分辨率下限处理模块以及分辨率非下限模块;The code rate adaptive adjustment system according to claim 7, wherein the non-rising processing unit comprises a lower limit judgment module, a non-low limit processing module, a GOP value maximum judgment module, a GOP value maximum processing module, and a lower resolution limit determination. Module, lower resolution processing module and resolution non-lower limit module;所述下限判断模块,用于判断码率和帧率是否达到下限值;The lower limit determining module is configured to determine whether the code rate and the frame rate reach a lower limit value;所述非下限处理模块,用于若码率和帧率未达到下限值,降低帧率和码率;The non-lower limit processing module is configured to reduce the frame rate and the code rate if the code rate and the frame rate do not reach the lower limit value;所述GOP值最大判断模块,用于若码率和帧率达到下限值,判断GOP值是否达到最大值;The GOP value maximum judging module is configured to determine whether the GOP value reaches a maximum value if the code rate and the frame rate reach a lower limit value;所述GOP值最大处理模块,用于若GOP值未达到最大值,上调GOP值;The GOP value maximum processing module is configured to: if the GOP value does not reach a maximum value, up-regulate the GOP value;所述分辨率下限判断模块,用于若GOP值达到最大值,判断分辨率是否达到下限值;The resolution lower limit determining module is configured to determine whether the resolution reaches a lower limit value if the GOP value reaches a maximum value;所述分辨率下限处理模块,用于若分辨率达到下限值,上报流参数已无法调节的通知;The lower resolution processing module is configured to notify that the flow parameter has been unadjustable if the resolution reaches a lower limit value;所述分辨率非下限模块,用于分辨率未达到下限值,则上报需手动下降分辨率的通知,进行手动下降分辨率。The non-lower limit module of the resolution is used for notifying that the resolution does not reach the lower limit value, and then reporting the need to manually lower the resolution, and manually lowering the resolution.
- 根据权利要求8所述的码率自适应调节系统,其特征在于,所述码率自适应调节系统还包括切换单元,所述切换单元用于根据接收的视频流进行分析判断,并根据分析判断结果进入切换调整,获取新的视频流并播放。The code rate adaptive adjustment system according to claim 8, wherein the code rate adaptive adjustment system further comprises a switching unit, wherein the switching unit is configured to perform analysis and judgment according to the received video stream, and according to the analysis and judgment The result enters a switch adjustment, gets a new video stream and plays it.
- 根据权利要求9所述的码率自适应调节系统,其特征在于,所述切换单元包括视频流传输模块、数据处理模块、触发模块、请求处理模块、切换应答处理模块以及播放模块; The code rate adaptive adjustment system according to claim 9, wherein the switching unit comprises a video stream transmission module, a data processing module, a trigger module, a request processing module, a handover response processing module, and a play module;所述视频流传输模块,用于IPC_STAE接收IPC_AP的视频流,并将该视频流传输至移动终端;The video stream transmission module is configured to receive, by the IPC_STAE, a video stream of the IPC_AP, and transmit the video stream to the mobile terminal;所述数据处理模块,用于移动终端接收视频流后进行数据统计,并将统计的结构反馈至IPC_STAE,IPC_STAE对移动终端发送的数据进行分析,并将分析的结果发送至IPC_AP;The data processing module is configured to: after the mobile terminal receives the video stream, perform data statistics, and feed back the statistical structure to the IPC_STAE, and the IPC_STAE analyzes the data sent by the mobile terminal, and sends the analyzed result to the IPC_AP;所述触发模块,用于IPC_AP自动触发码率自适应调节,IPC_AP发送视频码流切换请求至IPC_STAE,或手动在移动终端上触发码率自适应调节;The triggering module is configured to automatically trigger the rate adjustment of the IPC_AP, and the IPC_AP sends a video stream switching request to the IPC_STAE, or manually triggers the rate adjustment on the mobile terminal;所述请求处理模块,用于PC_STAE接收视频码流切换请求后,将该视频码流切换请求发送至移动终端,由移动终端进行视频码流切换分析,移动终端发送视频码流切换应答给IPC_STAE;The request processing module is configured to send the video code stream switching request to the mobile terminal after the PC_STAE receives the video code stream switching request, and the mobile terminal performs the video code stream switching analysis, and the mobile terminal sends the video code stream switching response to the IPC_STAE;所述切换应答处理模块,用于IPC_STAE将视频码流切换应答发送至IPC_AP,以获取新的视频流;The handover response processing module is configured to send, by the IPC_STAE, a video code stream switching response to the IPC_AP to obtain a new video stream;所述播放模块,用于将新的视频流发送至IPC_STAE,IPC_STAE将视频流发送至移动终端,进行视频播放。The playing module is configured to send a new video stream to the IPC_STAE, and the IPC_STAE sends the video stream to the mobile terminal for video playback.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/079667 WO2018184189A1 (en) | 2017-04-07 | 2017-04-07 | Adaptive code rate adjustment method and system thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/079667 WO2018184189A1 (en) | 2017-04-07 | 2017-04-07 | Adaptive code rate adjustment method and system thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018184189A1 true WO2018184189A1 (en) | 2018-10-11 |
Family
ID=63712611
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/079667 WO2018184189A1 (en) | 2017-04-07 | 2017-04-07 | Adaptive code rate adjustment method and system thereof |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2018184189A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109819333A (en) * | 2019-01-10 | 2019-05-28 | 广州视源电子科技股份有限公司 | Video stream code rate allocation method and device and computer readable storage medium |
CN111416999A (en) * | 2020-03-09 | 2020-07-14 | 西安万像电子科技有限公司 | Data transmission method, terminal and system |
CN113141541A (en) * | 2020-01-17 | 2021-07-20 | 北京达佳互联信息技术有限公司 | Code rate switching method, device, equipment and storage medium |
CN116614393A (en) * | 2023-07-21 | 2023-08-18 | 中融云数(北京)技术有限公司 | Weak network scene bandwidth estimation method and system based on RTC communication |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060115237A1 (en) * | 2001-02-09 | 2006-06-01 | Microsoft Corporation | Advancing playback of video data based on parameter values of video data |
CN101222296A (en) * | 2008-01-31 | 2008-07-16 | 上海交通大学 | Adaptive transmission method and system in uplink cellular video communication |
CN101252689A (en) * | 2008-02-29 | 2008-08-27 | 杭州爱威芯科技有限公司 | Self-adapting code rate control method |
CN101466035A (en) * | 2007-12-21 | 2009-06-24 | 深圳市融合视讯科技有限公司 | Method for distributing video image set bit based on H.264 |
CN102457728A (en) * | 2010-10-27 | 2012-05-16 | 杭州华三通信技术有限公司 | Video image coding method and device |
CN103826121A (en) * | 2013-12-20 | 2014-05-28 | 电子科技大学 | Scene switching detection based code rate control method in low-delay video coding |
-
2017
- 2017-04-07 WO PCT/CN2017/079667 patent/WO2018184189A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060115237A1 (en) * | 2001-02-09 | 2006-06-01 | Microsoft Corporation | Advancing playback of video data based on parameter values of video data |
CN101466035A (en) * | 2007-12-21 | 2009-06-24 | 深圳市融合视讯科技有限公司 | Method for distributing video image set bit based on H.264 |
CN101222296A (en) * | 2008-01-31 | 2008-07-16 | 上海交通大学 | Adaptive transmission method and system in uplink cellular video communication |
CN101252689A (en) * | 2008-02-29 | 2008-08-27 | 杭州爱威芯科技有限公司 | Self-adapting code rate control method |
CN102457728A (en) * | 2010-10-27 | 2012-05-16 | 杭州华三通信技术有限公司 | Video image coding method and device |
CN103826121A (en) * | 2013-12-20 | 2014-05-28 | 电子科技大学 | Scene switching detection based code rate control method in low-delay video coding |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109819333A (en) * | 2019-01-10 | 2019-05-28 | 广州视源电子科技股份有限公司 | Video stream code rate allocation method and device and computer readable storage medium |
CN113141541A (en) * | 2020-01-17 | 2021-07-20 | 北京达佳互联信息技术有限公司 | Code rate switching method, device, equipment and storage medium |
CN113141541B (en) * | 2020-01-17 | 2022-06-10 | 北京达佳互联信息技术有限公司 | Code rate switching method, device, equipment and storage medium |
CN111416999A (en) * | 2020-03-09 | 2020-07-14 | 西安万像电子科技有限公司 | Data transmission method, terminal and system |
CN116614393A (en) * | 2023-07-21 | 2023-08-18 | 中融云数(北京)技术有限公司 | Weak network scene bandwidth estimation method and system based on RTC communication |
CN116614393B (en) * | 2023-07-21 | 2023-11-28 | 中融云数(北京)技术有限公司 | Weak network scene bandwidth estimation method and system based on RTC communication |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018184189A1 (en) | Adaptive code rate adjustment method and system thereof | |
WO2012092803A1 (en) | Video communication method and system for dynamically changing video encoding | |
WO2021141197A1 (en) | Ip speaker system having embedded video surveillance amplifier | |
WO2015076643A1 (en) | Apparatus and method for processing header compressed packet in electronic device | |
WO2015065080A1 (en) | Method and apparatus for reconfiguring a bearer | |
WO2012011746A2 (en) | Method and apparatus for providing multimedia streaming service | |
WO2012015234A9 (en) | Apparatus and method for controlling session connection in communication system | |
WO2016021773A1 (en) | Qos guaranteed video stream method and system, and transmission server | |
WO2012165893A2 (en) | Method for simultaneous data transmission service and device used therefor | |
WO2014148836A2 (en) | Apparatus and method for acquiring synchronization in cooperative communication system | |
WO2019015016A1 (en) | Set top box-based coexistence optimization method, device and system for wifi and bluetooth | |
WO2015199420A1 (en) | Technique for transmitting and receiving system time information in broadcasting system | |
WO2018128226A1 (en) | Method for transmitting content on heterogeneous network and apparatus therefor | |
WO2018076293A1 (en) | Method and apparatus for adjusting parameter of multimedia communication, and mobile terminal | |
WO2022092624A1 (en) | Data processing node device and information transmission method performed in same device | |
WO2015160223A1 (en) | Method and apparatus for allowing call service in overload condition of packet exchange mobile communication system | |
WO2011071334A2 (en) | Method and apparatus for transmitting video contents compressed by codec | |
WO2019052463A1 (en) | Multimedia file sharing method, device and system based on wifi display | |
WO2020263025A1 (en) | Method and apparatus for playing multimedia streaming data | |
WO2016035923A1 (en) | Image stream providing method and system, and relay device | |
WO2021020600A1 (en) | Multimedia service providing device and multimedia service providing method | |
WO2018101554A1 (en) | Method for providing streaming service and apparatus therefor | |
WO2011031097A2 (en) | Method for setting plurality of sessions and node using same | |
WO2017128593A1 (en) | Method and device for processing high code rate transmission of digital television and high-definition digital television | |
WO2014129854A1 (en) | Apparatus for transmitting high quality (hd class) digital image signal over long distance using utp cable |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17904631 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17904631 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11.02.2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17904631 Country of ref document: EP Kind code of ref document: A1 |