CN117651315A - 802.11ax wireless local area network access method - Google Patents

Abstract

This application provides an 802.11ax wireless LAN access method, which relates to the field of wireless communication technology. The method includes: determining an allocation mode of resource units; sending uplink parameter information to a network device based on the allocation mode of resource units; and the uplink parameter information is used to control wireless local area network access. The 802.11ax wireless LAN access method provided by this application can reduce random competition in the collection process of parameters required for wireless LAN access and achieve low-latency wireless LAN access.

Description

802.11ax wireless LAN access method

Technical field

The present application relates to the field of wireless communication technology, and in particular, to an 802.11ax wireless LAN access method.

Background technique

With the rapid development of mobile Internet and smart terminals, user personalized services and terminal density have increased explosively, and High Density High Bandwidth Wireless Local Area Network (HDHB WLAN) has become the main form of wireless communication. Wireless standard - 802.11ax applies antenna arrays, Orthogonal Frequency Division Multiple Access (OFDMA), Multi-User Multiple-Input Multiple-Output (MU-MIMO) and beams Innovative technologies such as forming provide higher bandwidth and better network performance, which to a certain extent alleviate the pressure of single-point traffic in high-density and high-bandwidth Wireless Local Area Network (WLAN). However, the current WLAN access method still uses the Received Signal Strength Indication (RSSI) access method and the random competition resource acquisition mode, which will cause long and prolonged access to WLAN.

Contents of the invention

This application provides an 802.11ax wireless LAN access method to solve the defects in the existing technology and achieve low-time-consuming and low-latency wireless LAN access.

In the first aspect, this application provides an 802.11ax wireless LAN access method, which is applied to terminals and includes:

Determine how resource units are allocated;

Uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

In one embodiment, sending uplink parameter information to the network device based on the resource unit allocation method includes:

When the terminal is in an active state, the resource unit is allocated in a designated allocation manner, and the terminal sends uplink parameter information to the network device through the designated resource unit.

In one embodiment, sending uplink parameter information to the network device based on the resource unit allocation method includes:

When the terminal is in an inactive state, the resource unit is allocated in an uplink orthogonal frequency division multiple access random access manner, and the terminal sends uplink parameter information to the network device through resource units obtained through competition.

In one embodiment, the uplink parameter information includes cache status report information and network location information;

Send uplink parameter information to network devices, including:

Place the cache status report information in the frame header of the cache status report response frame, and place the network location information in the frame body of the cache status report response frame;

Send uplink parameter information to the network device through the cache status report response frame.

In one embodiment, determining the allocation method of resource units includes:

Obtain the uplink parameter request message sent by the network device;

The resource unit allocation method is determined based on the target field in the uplink parameter request message; the resource unit allocation method is determined based on the active state of the terminal.

In the second aspect, this application provides an 802.11ax wireless LAN access method, which is applied to network equipment, including:

Receive uplink parameter information sent by the terminal; the uplink parameter information is sent based on the allocation method of resource units;

Control wireless local area network access based on the uplink parameter information.

In one embodiment, the 802.11ax wireless LAN access method further includes:

Determine the allocation method of resource units based on the active status of the terminal;

Send an uplink parameter request message to the terminal; the uplink parameter request message is used to indicate an allocation mode of resource units.

In one embodiment, determining the allocation method of resource units based on the active status of the terminal includes:

When the terminal is in an active state, determine that the allocation method of the resource unit is designated allocation; or,

When the terminal is in an inactive state, it is determined that the allocation mode of the resource unit is uplink orthogonal frequency division multiple access random access.

In one embodiment, wireless LAN access control based on the uplink parameter information includes:

Determine target parameters based on the uplink parameter information;

Input the target parameters into the target model to obtain the wireless LAN access policy output by the target model;

Perform wireless LAN access control based on the wireless LAN access policy;

Wherein, the target model is determined based on the priority experience replay algorithm and Huber loss function that adjusts the time difference error loss function.

In one embodiment, the 802.11ax wireless LAN access method further includes:

Using the target parameter as a sample and the wireless LAN access policy corresponding to the target parameter as a label, the initial model is trained to obtain the target model.

In a third aspect, embodiments of the present application provide an 802.11ax wireless LAN access device, including:

Determination module, used to determine the allocation method of resource units;

A sending module, configured to send uplink parameter information to the network device based on the allocation method of the resource unit; the uplink parameter information is used to control wireless local area network access.

In the fourth aspect, embodiments of the present application provide an 802.11ax wireless LAN access device, including:

A receiving module, configured to receive uplink parameter information sent by the terminal; the uplink parameter information is sent based on the allocation method of resource units;

A control module, configured to control wireless local area network access based on the uplink parameter information.

In a fifth aspect, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the first and second aspects. method described.

In a sixth aspect, the present application also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the methods described in the first and second aspects are implemented.

In a seventh aspect, the present application also provides a computer program product, including a computer program that implements the methods described in the first and second aspects when executed by a processor.

The 802.11ax wireless LAN access method provided by the embodiments of this application sends uplink parameter information by determining the resource unit allocation method. Wireless LAN access control can be performed based on the uplink parameter information, thereby reducing the need for collecting parameters required for wireless LAN access. Random competition in the process reduces parameter collection time, improves parameter collection accuracy, and enables low-latency wireless LAN access.

Description of drawings

In order to explain the technical solutions in this application or the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are of the present invention. For some embodiments of the application, those of ordinary skill in the art can also obtain other drawings based on these drawings without exerting creative efforts.

Figure 1 is one of the flow diagrams of the 802.11ax wireless LAN access method provided by this application;

Figure 2 is the second flow diagram of the 802.11ax wireless LAN access method provided by this application;

Figure 3 is one of the structural schematic diagrams of the 802.11ax wireless LAN access device provided by this application;

Figure 4 is the second structural schematic diagram of the 802.11ax wireless LAN access device provided by this application;

Figure 5 is a schematic structural diagram of an electronic device provided by this application.

Detailed ways

Common wireless LAN access methods are as follows:

(1) The electronic device obtains the network standard information of the gateway device and one or more network slice information from the gateway device, so that the user can determine whether the WLAN network provides 5G Internet access and/or which 5G network capabilities are more efficient based on the WLAN network. Flexible selection of desired WLAN network.

(2) Obtain the wireless access point (AP) around the device to be accessed, determine the identifier of the wireless access point, the identifier carries application information suitable for access, and send the identifier to the device to be accessed. . The application information suitable for access carried by the identifier indicates the matching applications that can be run after accessing the wireless access point, which reflects the network quality of different wireless access points, so that when the user receives the wireless access point After clicking the mark, you can selectively access it as needed, and then run the corresponding application, which can ensure the efficiency and accuracy of data transmission and improve the user experience.

(3) The AP carries the Service Set Identifier (SSID) name corresponding to the wireless service it provides in the broadcast beacon frame message or the probe response (ProbeResponse) message in response to the wireless terminal. The display sequence identifier and the description information corresponding to the SSID name are used to facilitate the relevant wireless terminal to perform all SSID names based on the display sequence identifier corresponding to the SSID name carried in all received Beacon messages and/or Probe Response messages. Sort and display the sorted SSID names and their corresponding description information, which ultimately facilitates relevant users to quickly select the appropriate SSID and access it, thus improving the WLAN network access experience.

However, the above methods all have certain shortcomings:

Method (1) may cause the electronic device gateway device to receive one or more first network capability information of the wireless local area network WLAN network, where the first network capability information includes network standard information of the first gateway device and/or one of the first gateway device or multiple network slicing capability information, allowing users to more flexibly select the required WLAN network based on whether the WLAN network provides 5G Internet access and/or based on which 5G network capabilities the WLAN network provides, but this solution is targeted at 5G WLAN network, it does not apply to other types of WLAN networks such as WiFi.

Method (2) sends network identifiers to access terminals to reflect the network quality of different wireless access points, thereby allowing users to selectively access according to needs, improving the efficiency and accuracy of data transmission, and improving user experience. Although this solution considers differentiated application requirements, it does not consider the access application of high-density and high-bandwidth wireless LAN, nor does it involve the 802.11ax protocol.

Method (3) sends the SSID name to the wireless terminal for the wireless terminal to select the access point. The solution sorts the determined SSID names by identifying the display order corresponding to the determined SSID name, and then selects the appropriate access point. entry point. Although this solution allows wireless terminals to select appropriate access APs, the selection scheme in this solution relies on the display order provided by the network provider and cannot dynamically select APs based on WLAN network conditions. Load imbalance will occur in dense WLANs. And other issues.

Based on the analysis of the above methods, this application proposes an access optimization method for high-density and high-bandwidth 802.11ax wireless LAN. This method makes use of new technologies introduced by 802.11ax protocols such as Trigger Frame and OFDMA. It collects WLAN network parameters and generates global access policies to achieve flexible configuration of access resources, thereby achieving WLAN load balancing and competition avoidance. .

In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application. , not all examples. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

Figure 1 is one of the flow diagrams of the 802.11ax wireless LAN access method provided by the embodiment of the present application. Referring to Figure 1, an embodiment of the present application provides an 802.11ax wireless LAN access method. The method is applied to terminals, such as mobile phones, computers, and televisions, and may include:

Step 110: Determine the allocation method of resource units;

Step 120: Send uplink parameter information to the network device based on the resource unit allocation method; the uplink parameter information is used to control wireless LAN access.

As the access point of WLAN, the 802.11ax access point (AP) can provide uplink and downlink data transmission resources. The 802.11ax wireless terminal (Station, STA) needs to access the wireless LAN and request network resources for data transmission. As a central controller, the access controller (AC) can control terminal access and resource allocation in WLAN. Before the wireless terminal access action is initiated, the network device AC can send a parameter collection instruction to the network device AP, requiring the collection of parameter information such as the wireless terminal's access service type, access resource requirements, AP load conditions, etc. This information is used by the AC Access policy calculation. After receiving the AC request, the AP performs parameter collection actions.

In step 110, a terminal, such as a wireless terminal, may obtain relevant information broadcast by a network device AP, and determine an allocation method of resource units (RUs) based on the information broadcast by the AP. The allocation methods of resource units can include designated allocation, random allocation, competitive allocation, etc.

In step 120, the terminal may send uplink parameter information to the network device based on the resource unit allocation method determined in step 110. The uplink parameter information can be used to generate a wireless LAN access policy, thereby realizing access control of the wireless LAN.

The 802.11ax wireless LAN access method provided by the embodiments of this application sends uplink parameter information by determining the resource unit allocation method. Wireless LAN access control can be performed based on the uplink parameter information, thereby reducing the need for collecting parameters required for wireless LAN access. Random competition in the process reduces parameter collection time, improves parameter collection accuracy, and enables low-latency wireless LAN access.

In one embodiment, uplink parameter information is sent to the network device based on resource unit allocation, including:

When the terminal is in an active state, the resource unit allocation method is designated allocation, and the terminal sends uplink parameter information to the network device through the designated resource unit.

When the terminal is in an active state, the terminal has a greater possibility of access, and its resource unit allocation method can be designated allocation. Specified allocation allows the terminal to send uplink parameter information to the network device through designated resource units without the need to compete to obtain channel resources.

The 802.11ax wireless LAN access method provided by the embodiments of this application transmits terminal uplink parameter information in a designated allocation manner, and can collect parameter information of active terminals with greater access possibility, reducing the risk of channel collisions. This results in a waste of resources and reduces the time required for parameter collection.

In one embodiment, uplink parameter information is sent to the network device based on resource unit allocation, including:

When the terminal is in an inactive state, the resource unit allocation method is uplink orthogonal frequency division multiple access random access, and the terminal sends uplink parameter information to the network device for the resource units obtained through competition.

For a terminal that is in an inactive state but currently has an access request, its resource unit allocation method may be Uplink OFDMA Random Access (UORA). An inactive terminal does not have a designated RU. The terminal can use UORA to compete for RUs, and send uplink parameter information to the network device through the RUs obtained through competition.

The 802.11ax wireless LAN access method provided by the embodiments of this application transmits terminal uplink parameter information through competitive allocation, and can collect parameter information of inactive terminals. At this time, the scale of competition is small, and it can Reduce parameter collection time and achieve fast parameter upload.

In one embodiment, the uplink parameter information includes cache status report information and network location information;

Send uplink parameter information to network devices, including:

Place the cache status report information in the frame header of the cache status report response frame, and place the network location information in the frame body of the cache status report response frame;

Send uplink parameter information to the network device through the cache status report response frame.

The uplink parameter information may include the STA's cache status report information and the STA's network location information. The cache status report information is located in the BSR response frame. The network location information (Location information) refers to which APs the STA is within the signal range and is used to calculate the STA's Access target.

The STA's network location information can be obtained through the AP broadcast beacon frame (Beacon Frame). The beacon frame contains the AP's service set identifier SSID and basic service set identifier (Basic Service Set Identifier, BSSID). This information allows STAs to identify nearby networks and determine whether to connect.

After receiving the Buffer State Report Request (BSRP) trigger frame broadcast by the AP, the terminal can reply to the Buffer Status Report (Buffer Status Report, BSR) response frame (Response Frame) through OFDMA. This frame belongs to the service Quality (Quality of Service, QoS) data frame (DataFrame) or QoS blank frame (Null Frame), in which the cache status report information is located in the QoS control field (Control field) or BSR control field (Control field) in the response frame header (FrameHeader) part subfield).

In this application, the reporting process of terminal network location information is combined with the reporting process of cache status report information. Specifically, the STA's BSR information is still placed in the Frame Header part of the BSR response frame. The Beacon frame information received by the STA from different APs is placed in the Frame Body part of the BSR response frame. The terminal can report the cache status through The response frame can send uplink parameter information to the network device AP, and the two types of STA parameter information can reach the AP through a single uplink information transmission.

The AP will summarize the uplink parameter information received from the STA, and upload its own load information and the STA's parameter information to the network device AC.

The 802.11ax wireless LAN access method provided by the embodiment of this application can save time consumption in the parameter acquisition phase by combining the cache status report information and the reporting process of network location information. In addition, the network can also be realized by using trigger frames, OFDMA and other technologies. High-precision collection of parameters can ultimately achieve low-latency wireless LAN access.

In one embodiment, determining the allocation method of resource units includes:

Obtain the uplink parameter request message sent by the network device;

The resource unit allocation method is determined based on the target field in the uplink parameter request message; the resource unit allocation method is determined based on the active status of the terminal.

The AP broadcasts a BSRP trigger frame to request the STA to send uplink parameter information and enable uplink OFDMA. The terminal STA obtains the uplink parameter request message sent by the network device AP, that is, after the terminal receives the BSRP trigger frame, it can specify the RU allocation method during OFDMA transmission according to the target field AID12 field in the BSRP trigger frame.

Specifically, when the terminal is in an active state, the AP can perform several rounds of parameter collection in the specified RU allocation method. The RU is assigned to the target STA through the AID12 field of the trigger frame. At this time, the value of the AID12 field represents the AID of the STA, and the value range is 1 to 2007. When the terminal is in an inactive state, several rounds of UORA-based parameter information uploading can be performed. , at this time, the value of the AID12 field can be 0 or 2045, indicating that the RU is not designated by the AP, and the STA can use UORA to compete to obtain the RU for parameter upload.

The 802.11ax wireless LAN access method provided by the embodiments of this application determines the value of the target field through the active state of the terminal, and determines the allocation method of resource units based on the value of the target field, which can speed up parameter collection and achieve low-latency wireless LAN access.

The 802.11ax wireless LAN access method provided by this application is described below from the network device side. The 802.11ax wireless LAN access method on the network device side described below and the 802.11ax wireless LAN access method on the terminal side described above are mutually compatible. Corresponding reference.

Figure 2 is the second schematic flow chart of the 802.11ax wireless LAN access method provided by the embodiment of the present application. Referring to Figure 2, an embodiment of the present application provides an 802.11ax wireless LAN access method. The method is applied to network equipment and may include:

Step 210: Receive the uplink parameter information sent by the terminal; the uplink parameter information is sent based on the resource unit allocation method;

Step 220: Control wireless LAN access based on the uplink parameter information.

In one embodiment, the 802.11ax wireless LAN access method further includes:

Determine the allocation method of resource units based on the active status of the terminal;

Send an uplink parameter request message to the terminal; the uplink parameter request message is used to indicate the allocation method of the resource unit.

In one embodiment, determining the allocation method of resource units based on the active status of the terminal includes:

When the terminal is in an active state, determine that the resource unit allocation method is designated allocation; or,

When the terminal is in an inactive state, it is determined that the resource unit allocation method is uplink orthogonal frequency division multiple access random access.

In one embodiment, the network performs wireless LAN access control based on uplink parameter information, including:

Determine target parameters based on uplink parameter information;

Input the target parameters into the target model to obtain the wireless LAN access policy output by the target model;

Perform wireless LAN access control based on wireless LAN access policy;

Among them, the target model is determined based on the priority experience playback algorithm and Huber Loss function that adjusts the Time Difference Error (TD-error) loss function.

After the network device AC obtains the load information of the AP and the uplink parameter information of the STA, it can first process them to obtain the target parameters, and then use these target parameters to calculate the high-density and high-bandwidth 802.11ax WLAN terminal access policy.

Note that the number of STAs with uplink and downlink data transmission requirements within the WLAN range is n, and the number of APs is m. The AC can first process network parameters such as AP load information and STA uplink parameter information, mainly processing them into three types of information:

(1)Network location information

The AC summarizes the network location information uploaded by the STA to obtain the relative location relationship between the AP and the STA in the WLAN. AC can express this positional relationship in the form of a set. The elements in APrange _j represent STAs within the signal range of AP _j .

(2) Access resource demand information

After the AC obtains the STA's cache status report information through the BSR response frame, it uses the STA's cache status report information to calculate the uplink and downlink transmission rate requirements for the terminal access service. The calculation formula for the theoretical transmission rate of 802.11ax is as follows:

Speed＝ms _i *mb _i *N _subcarrier *N _stream /(Symbol+GI)

Among them, Speed is the theoretical transmission rate of 802.11ax; ms _i is the symbol bit length (symbol bit length); mb _i is the code rate (bit rate); the symbol bit length and code rate are determined by the Modulation and Coding Scheme (MCS). ) is determined; N _subcarrier is the number of subcarriers; N _stream is the number of MIMO spatial streams, allocated by the AP; Symbol is a fixed value, with a value of 12.8us; GI is a fixed value of the inter-frame gap, with a value of 0.8us.

The subcarrier requirement N _subcarrier corresponding to the 802.11ax OFDMA transmission mechanism is:

Among them, bs _i is the buffer size (Buffer Size) of STA _I ; ΔT is the transmission opportunity (TransmissionOpportunity, TXOP) duration.

It is known that the buffer size (Buffer Size) of STA _I is bs _I , MCS is mcs _I , and the TXOP duration is ΔT. Assuming that all STA buffers will be transmitted within ΔT, the minimum transmission rate required by STA _i is bs _i /ΔT .

The value of N _subcarrier can be 26, 52, 106, 242, 484, 996, from which the RU specification corresponding to the STA transmission rate can be obtained. According to the division method of 802.11ax RU, the need _i corresponding to the 26-tone RU is Then 52-tone RU, 106-tone RU, and 242-tone RU correspond respectively/> The maximum spectrum resource provided by 20MHz is/> The maximum spectrum resource provided by 40MHz is/> The spectrum resource requirement of STA _i is need _i , and the spectrum resource requirement of AP _j is supply _j .

(3)Terminal access service type

The access type of the service (Access Category) is used to manage the different QoS requirements of the terminal access service. This application refers to the 802.11e standard and defines four access types: Best Effort/Background/Video/Voice, which are distinguished by the ACI field and correspond to different priorities. The ACI value corresponding to the access type of the terminal access service is identified by the ACI High field in the BSR response frame. It is uploaded to the AC through the BSR response frame during the parameter collection phase. The access service type of STA _i is recorded as ACI _i .

After the above operations, the AC can determine the target parameters based on the network parameters. The target parameters include: terminal network location information APrange _j , available spectrum resources supply _j for AP _j , spectrum resources need _i required for STA _i access, and access services of STA _i . _TypeACIi .

The AC can input the target parameters into the target model, obtain the wireless LAN access policy output by the target model, and perform wireless LAN access control based on the wireless LAN access policy.

In high-density and high-bandwidth 802.11ax WLAN, access resources are limited. Therefore, the AC can define the access values of different STAs to achieve reasonable allocation of access resources and meet the differentiated QoS requirements of terminals. AC defines the calculation method of access value of different STA _i as follows:

Among them, v _i is the access value of STA _i ; α and β are weighted coefficient variables, which are used to weigh the impact of cache size and waiting time on the access value, and can be flexibly changed according to different service scenarios; bs _min is the terminal The minimum value of the cache size; bs _max is the maximum value of the terminal cache size; wt _i is the waiting time of the terminal STA; wt _min is the minimum value of the terminal waiting time; wt _max is the maximum value of the terminal waiting time; ACI _i is the STA service The priority corresponding to the type ACI.

In order to remove the influence of dimension, when calculating v _i , Min-Max normalization can be performed on bs _i and wt _i .

At this time, AC transforms the access optimization problem into the access value maximization problem under limited resource constraints. The resource provider is the AP in the WLAN, the available resources for AP _j are supply _j , the resources required for STA _i to access are need _i , and the value is _vi .

This optimization problem can be solved by building a DQN model. The state space (State), action space (Action) and reward reward function (Reward) of the DQN model are defined as follows:

State space (State): The resource allocation status of m APs, which is the occupation status of AP access resource supply _j corresponding to the current time t.

Action space (Action): The set of all possible actions taken by the agent based on the current state space. The action execution process is: select a STA that is not connected to the WLAN, then select a target AP that the STA can access, and try to select the STA to access the target AP.

Reward function (Reward): Select STA _i to access AP _j . If the resource constraints are not violated, the available supply _j is greater than neet _i . If the action is executed successfully, the reward r obtained is the value v _i of STA _i . Otherwise, the reward r is The specific formula is as follows:

r _t =R(s _t ,a _t ,s _t+1 )

Among them, r _t is the reward at time t; R is the value function; s _t is the current network state; a _t is the current execution action; s _t+1 is the next transition state.

The target model can be obtained by optimizing the DQN model based on the priority experience replay algorithm and Huber loss function of adjusting the time difference error loss function.

After the DQN model is built, the Improved-DQN algorithm can be used to train the model. Compared with traditional DQN, Improved-DQN is mainly optimized in terms of experience playback mechanism and loss function calculation, which can improve the DQN model to solve WLAN access optimization problems. The effect and solving speed of

The specific steps for building the target model are as follows:

(1) Initialize two neural networks, namely Q-Network(Q) and Target Q-Network(Q′). The structures of the two networks are the same, but the parameters are different, namely θ and θ′ respectively. Before the algorithm is executed, the greedy algorithm ε-greedy strategy is first used to generate samples. The generated (s _t , a _t , r _t , s _t+1 ) quadruple indicates that HDHB WLAN performs access selection actions in network state s _t The reward r _t received by a _t , and the next transition state s _t+1 . The four-tuple (s _t , a _t , r _t , s _t+1 ) generated in the state transfer project is stored in the experience replay pool as the initial sample, and used as the input of the neural network when the algorithm is executed.

(2) Initialize the experience pool Experience Replay, which is used to store the Agent’s experience in the environment. Improved-DQN optimizes the experience replay mechanism and adopts a priority experience replay algorithm based on adjusting the time difference error loss function. Specifically, during the sampling process, samples whose time difference error δ is less than the threshold eta are uniformly sampled. When the time difference error is greater than the threshold eta, the square loss function is used to calculate the loss function. The sampling probability of the sample is:

Among them, P(i) is the probability that sample numbered i in the experience replay pool is sampled; δ _i represents the time difference error of sample i; σ is used to balance the proportion of importance sampling and random sampling, and is equivalent when σ = 0 Because random sampling is used; η is the threshold, which can be customized; max (|δ _i | ^σ , η) represents the sampling weight of the sample numbered i in the experience replay pool; J represents the number of samples in the experience replay pool.

(3) At each time step t, the Agent selects action a _t according to the current network state s _t according to the ε-greedy strategy. After executing action a _t , the Agent observes the new state s _t+1 and reward r _t returned by the environment.

The ε-greedy strategy randomly explores unknown actions and states according to the probability of ε, and selects the action with the highest reward to execute at each time step with the probability of 1-ε:

Among them, a ^max (s; θ) is the execution action with the highest reward when the network state is s and the Q-Network parameter is θ; Q (s, a; θ) is the Q- corresponding to the network status s and execution action a. Network.

(4) Store the experience tuple (s _t , a _t , r _t , s _t+1 ) into the experience pool Experience Replay.

(5) Randomly select a certain number of experience tuples from the experience pool for training Q-Network. For each experience tuple, calculate the maximum action in the current state and the Q-value y _t of the maximum action:

Among them, y _t is the Q value of the maximum action in the current state; Q (s, a; θ) means that the state is s, and the Q-Network corresponding to the execution action a; Q ^′ (s, a; θ ^′ ) means that the state is s , execute the Target-Q-Network corresponding to action a. The target Q value y _t in Improved-DQN is calculated jointly by Q-Network and Target-Q-Network to solve the problem of high Q value estimation.

(6) Update the parameters of Q-Network through the back propagation algorithm to reduce the error between the predicted Q value and the actual reward in the current state. During each iteration, by minimizing the loss function, the network parameters θ can be updated, thereby updating the decision-making action. The updated Q-Network will be used to select the next action. Before calculating the loss function, first calculate the current time difference error δ _t , that is, the difference between Q-Network and Target-Q-Network:

δ _t =y _t -Q(s,a;θ)

This application replaces the mean square error loss function (Mean Square Error, MSE) in the traditional DQN algorithm with Huber loss. The adjusted loss function of the DQN neural network is:

Among them, L(θ) is the loss function of the adjusted DQN neural network; eta is a parameter included in the Huber loss function, indicating the threshold.

When TD-error is less than the threshold, it is a normal value and the gradient gradually decreases. At this time, the loss function is similar to the mean square error (MSE) loss function state, which can ensure that the model obtains the global optimal value more accurately; when When it is greater than the threshold, the gradient is always approximately eta. At this time, the error function is similar to the Mean Absolute Error (MAE) loss function, which can ensure that the model updates parameters quickly and still has good anti-interference ability against outliers. .

(7) Copy the parameters of Q-Network to Target Q-Network at certain time steps, so that θ ^′ = θ. Parameter updating in this way can improve the stability of the algorithm and make the algorithm easier to converge.

(8) Repeat steps 3-7 until convergence or the specified number of training times is reached.

After the training is completed, the trained DQN network is the target model, which can generate high-density and high-bandwidth 802.11ax WLAN global access policies. The target parameters are input into the trained Improved-DQN model, and the model outputs the access policy.

The 802.11ax wireless LAN access method provided by the embodiment of this application can generate an optimized network access policy by inputting the target parameters into the target model adjusted based on the DQN model to perform wireless LAN access control, reducing the need for high-density and high-bandwidth 802.11 ax WLAN solves the problem of unbalanced WLAN traffic load due to the large traffic pressure caused by network access. In addition, the optimized network access strategy supports the orderly access of high-density terminals and avoids the access of too many terminals. A single AP reduces transmission delays caused by channel competition during transmission and improves WLAN global throughput.

In one embodiment, the 802.11ax wireless LAN access method further includes:

Using the target parameter as a sample and the wireless LAN access policy corresponding to the target parameter as a label, train the initial model to obtain the target model.

The AC can obtain the target parameters obtained by processing the load information of the AP and the uplink parameter information of the STA, then use the target parameters as samples, use the wireless LAN access policy corresponding to the target parameters as labels, and train the initial model to obtain the target model. The training of the model can be limited according to actual needs, such as reaching a certain number of times or reaching a certain accuracy. This application does not impose specific restrictions on this. The AC performs wireless LAN access control based on the wireless LAN access policy output by the target model.

The 802.11ax wireless LAN access method provided by the embodiments of this application obtains a prediction model by training the initial model, and can improve the accuracy of the model through continuous iteration, thereby ensuring the optimization of the wireless LAN access strategy, and thus ensuring the wireless LAN access control.

Based on the above embodiments, this application can simulate the proposed solution through Python. The simulation environment of this application is an indoor LAN scenario, and all devices support the IEEE 802.11ax network protocol. All downlink channels from base stations to users and interference channels to other users are modeled as independent and identically distributed Rayleigh fading models, and the channel gains are normalized. The Improved-DQN model consists of a fully connected neural network containing 1 hidden layer. The hidden layer has 32 neurons, and the activation function of each neuron is ReLU (Rectified Linear Unit). The simulation parameters are shown in the table below:

parameter value frequency band 5GHz spectrum bandwidth 40MHz Guard intervalGuard interval 3.2μs Modulation and Coding StrategyMCS 9 activation function ReLU learning rate 0.0001 Experience pool size 2000

In order to better evaluate the performance of this application algorithm, we compare this solution with the other three access methods:

1) Access algorithm based on RSSI signal strength.

2) Access policy generation algorithm based on greedy algorithm.

3) DQN-based access policy generation algorithm.

Among them, 2) and 3) use the same configured AC as the Improved-DQN-based access policy generation algorithm for access policy calculation, and 1) the access algorithm based on RSSI signal strength does not use AC control.

In the simulation, we compared this application with three algorithms by changing parameters such as the number of terminals, node density, and cache space size, and evaluated the algorithm performance from the perspective of average delay and hit rate.

When the number of APs remains unchanged and the terminal density is low, the difference in throughput between the four access methods is small; when the terminal density is high, Improved-DQN is better than the other three algorithms in throughput, and as the terminal density changes Large, the throughput gap becomes larger. When the terminal density is high, the average throughput of the RSSI-based access algorithm shows a downward trend, which is caused by the intensification of random channel competition.

When the terminal density is low, the RSSI-based access method has the shortest access delay. This is because the RSSI method access does not require parameter collection and calculation time. As the terminal density increases, the RSSI-based access method has the shortest access delay. Rapidly increasing, and the growth rate is greater than the other three access methods. In scenarios with dense terminals, the average access delay calculated by Greedy is shorter. This is due to the lower complexity of the algorithm and shorter calculation time. Improved-DQN is better than DQN in terms of access delay.

The 802.11ax wireless LAN access device provided by this application is described below. The 802.11ax wireless LAN access device described below and the 802.11ax wireless LAN access method described above can be mutually referenced.

Figure 3 is one of the structural schematic diagrams of an 802.11ax wireless LAN access device provided by an embodiment of the present application. Referring to Figure 3, the 802.11ax wireless LAN access device provided by the embodiment of the present application may include:

The determination module 310 is used to determine the allocation method of resource units;

The sending module 320 is configured to send uplink parameter information to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

The 802.11ax wireless LAN access device provided by the embodiment of the present application sends uplink parameter information by determining the resource unit allocation method, and can perform wireless LAN access control based on the uplink parameter information, thereby reducing the need for collecting parameters required for wireless LAN access. Random competition in the process reduces parameter collection time, improves parameter collection accuracy, and enables low-latency wireless LAN access.

Figure 4 is a second structural schematic diagram of an 802.11ax wireless LAN access device provided by an embodiment of the present application. Referring to Figure 4, the 802.11ax wireless LAN access device provided by the embodiment of the present application may include:

The receiving module 410 is configured to receive uplink parameter information sent by the terminal; the uplink parameter information is sent based on the allocation method of resource units;

The control module 420 is configured to control wireless local area network access based on the uplink parameter information.

The 802.11ax wireless LAN access device provided by the embodiment of the present application sends uplink parameter information by determining the resource unit allocation method, and can perform wireless LAN access control based on the uplink parameter information, thereby reducing the need for collecting parameters required for wireless LAN access. Random competition in the process reduces parameter collection time, improves parameter collection accuracy, and enables low-latency wireless LAN access.

Figure 5 illustrates a schematic diagram of the physical structure of an electronic device. As shown in Figure 5, the electronic device may include: a processor (processor) 510, a communications interface (Communications Interface) 520, a memory (memory) 530 and a communication bus 540. Among them, the processor 510, the communication interface 520, and the memory 530 complete communication with each other through the communication bus 540. The processor 510 can call logical instructions in the memory 530 to execute the 802.11ax wireless LAN access method, for example, including:

Determine how resource units are allocated;

Uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

In addition, the above-mentioned logical instructions in the memory 530 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code. .

On the other hand, the present application also provides a non-transitory computer-readable storage medium on which a computer program is stored. The computer program is implemented when executed by the processor to execute the 802.11ax wireless LAN access method provided by the above methods. Steps, for example include:

Determine how resource units are allocated;

Uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

In another aspect, the present application also provides a computer program product. The computer program product includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can The steps to perform the 802.11ax wireless LAN access method provided by each of the above methods include, for example:

Determine how resource units are allocated;

Uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control.

The device embodiments described above are only illustrative. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in One location, or it can be distributed across multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Persons of ordinary skill in the art can understand and implement the method without any creative effort.

Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the part of the above technical solution that essentially contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., including a number of instructions to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments.

In addition, it should be noted that the terms "first", "second", etc. in the embodiments of this application are used to distinguish similar objects and are not used to describe a specific order or sequence. It is to be understood that the terms so used are interchangeable under appropriate circumstances so that the embodiments of the present application can be practiced in sequences other than those illustrated or described herein, and "first" and "second" are intended to distinguish It is usually one type, and the number of objects is not limited. For example, the first object can be one or multiple.

In the embodiment of this application, the term "and/or" describes the association of associated objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone. these three situations. The character "/" generally indicates that the related objects are in an "or" relationship.

“Determining B based on A” in the embodiment of this application means that the factor A should be considered when determining B. It is not limited to "B can be determined based on A alone", but also includes: "B is determined based on A and C", "B is determined based on A, C and E", "C is determined based on A, and B is further determined based on C" wait. In addition, it can also include taking A as a condition for determining B, for example, "When A meets the first condition, use the first method to determine B"; another example, "When A meets the second condition, determine B", etc.; another example , "When A meets the third condition, determine B based on the first parameter" and so on. Of course, it can also be a condition that uses A as a factor to determine B, for example, "when A meets the first condition, use the first method to determine C, and further determine B based on C" and so on.

In the embodiments of this application, the term "plurality" refers to two or more than two, and other quantifiers are similar to it.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application, but not to limit it; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent substitutions are made to some of the technical features; however, these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions in the embodiments of the present application.

Claims (10)

1. An 802.11ax wireless LAN access method, characterized in that it is applied to a terminal and includes: Determine how resource units are allocated; Uplink parameter information is sent to the network device based on the allocation method of the resource unit; the uplink parameter information is used for wireless local area network access control. 2. The 802.11ax wireless LAN access method according to claim 1, characterized in that sending uplink parameter information to the network device based on the allocation method of the resource unit includes: When the terminal is in an active state, the resource unit is allocated in a designated allocation manner, and the terminal sends uplink parameter information to the network device through the designated resource unit. 3. The 802.11ax wireless LAN access method according to claim 1, characterized in that sending uplink parameter information to the network device based on the allocation method of the resource unit includes: When the terminal is in an inactive state, the resource unit is allocated in an uplink orthogonal frequency division multiple access random access manner, and the terminal sends uplink parameter information to the network device through resource units obtained through competition. 4. The 802.11ax wireless LAN access method according to any one of claims 1 to 3, wherein the uplink parameter information includes cache status report information and network location information; Send uplink parameter information to network devices, including: Place the cache status report information in the frame header of the cache status report response frame, and place the network location information in the frame body of the cache status report response frame; Send uplink parameter information to the network device through the cache status report response frame. 5. The 802.11ax wireless LAN access method according to any one of claims 1 to 3, characterized in that determining the allocation method of resource units includes: Obtain the uplink parameter request message sent by the network device; The resource unit allocation method is determined based on the target field in the uplink parameter request message; the resource unit allocation method is determined based on the active state of the terminal. 6. An 802.11ax wireless LAN access method, characterized in that it is applied to network equipment, including: Receive uplink parameter information sent by the terminal; the uplink parameter information is sent based on the allocation method of resource units; Control wireless local area network access based on the uplink parameter information. 7. The 802.11ax wireless LAN access method according to claim 6, characterized in that the method further includes: Determine the allocation method of resource units based on the active status of the terminal; Send an uplink parameter request message to the terminal; the uplink parameter request message is used to indicate an allocation mode of resource units. 8. The 802.11ax wireless LAN access method according to claim 7, characterized in that determining the allocation method of resource units based on the active state of the terminal includes: When the terminal is in an active state, determine that the allocation method of the resource unit is designated allocation; or, When the terminal is in an inactive state, it is determined that the allocation mode of the resource unit is uplink orthogonal frequency division multiple access random access. 9. The 802.11ax wireless LAN access method according to claim 6, wherein the wireless LAN access control based on the uplink parameter information includes: Determine target parameters based on the uplink parameter information; Input the target parameters into the target model to obtain the wireless LAN access policy output by the target model; Perform wireless LAN access control based on the wireless LAN access policy; Wherein, the target model is determined based on the priority experience replay algorithm and Huber loss function that adjusts the time difference error loss function. 10. The 802.11ax wireless LAN access method according to claim 9, characterized in that the method further includes: The target parameter is used as a sample, the wireless LAN access policy corresponding to the target parameter is used as a label, and the initial model is trained to obtain the target model.