CN115188225A - Method, system and computer readable medium for air traffic control - Google Patents

Abstract

A method, system, and computer-readable medium for air traffic control are provided. The method comprises the following steps: collecting voice data in a cockpit of an airplane; identifying an air traffic control command in the voice data, the air traffic control command comprising one or more of an air traffic request issued from a user within the cockpit to a ground control center and an air traffic instruction issued from the ground control center to the user; receiving a confirmation input of the air traffic control command by the user; transmitting the empty pipe request to the ground control center in response to the air traffic control command being the empty pipe request; and executing the air traffic control command in response to the air traffic control command being the air traffic control command. Numerous other aspects are also provided.

Description

A method, system and computer readable medium for air traffic control

technical field

The present application relates to aircraft air traffic control systems, and more particularly to methods, systems and computer readable media for air traffic control.

Background technique

Air traffic control means that the ground controller manages and controls the activities of the aircraft in the air according to the prescribed flight plan and the real-time flight status of the aircraft in the air, so as to effectively utilize the airspace and ensure the safe and efficient flight of the aircraft. The main air traffic control method in my country is to send voice control instructions to the pilot through the ground controller, and the pilot repeats the relevant instructions to complete the confirmation of the instruction.

The traditional control method has the interference of many wireless channels, large background noise, personnel cognitive ability and accent deviation, etc., which cause errors in voice calls and have a certain impact on flight safety. After the crew gets the voice command, they still need to operate manually, which brings a certain burden to the pilot, especially in the critical flight stage, which will interfere with the pilot's safe driving.

Therefore, the present application proposes a method, system and computer-readable storage medium for air traffic control based on two-way confirmation based on speech recognition, which can transmit, receive and execute textualized voice request instructions more efficiently, quickly and accurately.

Invention content:

A brief summary of one or more aspects is presented below to provide a basic understanding of the aspects. This summary is not an exhaustive overview of all contemplated aspects and is neither intended to identify key or critical elements of all aspects nor attempt to delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.

In order to solve the above problems, the present aspect proposes a method, system and computer-readable storage medium for air traffic control based on two-way confirmation based on speech recognition, which can more efficiently, quickly and accurately transmit, receive and execute textual voice request instructions.

In one aspect, a method of air traffic control is provided, the method comprising: collecting voice data in a cockpit of an aircraft; recognizing air traffic control commands in the voice data, the air traffic control commands comprising: one or more of an air traffic control request from the user in the cockpit to the ground control center and an air traffic control instruction from the ground control center to the user; receiving the user's response to the air traffic control command acknowledging input; transmitting the air traffic control request to the ground control center in response to the air traffic control order being the air traffic control request; and executing the air traffic control command in response to the air traffic control command being the air traffic control command the ATC command.

Preferably, the method further comprises: displaying the air traffic control order to receive confirmation input of the air traffic control order by the user.

Preferably, executing the ATC instruction further comprises: transmitting the ATC instruction to an air control system of the aircraft for the ATC system to execute the ATC instruction.

Preferably, executing the air traffic control order further comprises: sending an instruction to the ground control center to confirm the air traffic control order twice; and in response to receiving a second confirmation of the air traffic control order from the ground control center The ATC command is executed after confirmation.

Preferably, the method further comprises, based on not receiving confirmation input from the user for the air traffic control order: generating a request for the air traffic control order in response to the air traffic control order being the air traffic control request. a request by a user to repeat the speech associated with the air traffic control request; and in response to the air traffic control command being the air traffic control command, sending to the ground control center a request to retransmit the air traffic control command associated with the air traffic control command signal request.

Preferably, the method further comprises: transmitting the air traffic control request to the ground control center along with the user's voice data associated with the air traffic control request with the foreign call switch closed; and When the foreign call switch is turned off, the user's voice data associated with the air traffic control request is transmitted to the ground control center without transmitting the air traffic control request.

Preferably, collecting the voice data in the cockpit includes: collecting the user's voice data; and collecting the voice data in the voice signal received from the ground control center.

Preferably, the ATC request includes: request for departure clearance, request for takeoff runway, request for taxi, request for entry and exit, request for take-off clearance, request for frequency handover, request for transponder identification, or a combination thereof.

Preferably, the air traffic control instruction includes: submitting a flight plan, departure clearance, takeoff clearance, stand indication, runway indication, frequency indication, or a combination thereof.

Preferably, identifying the air traffic control command in the voice data includes: identifying the voice data based on parameter information of the aircraft, the parameter information including: the aircraft type, flight number, secondary Code, take-off and landing airport, landing airport, departure time, flight status information, flight altitude, flight latitude and longitude, release phase, taxi phase, or a combination thereof.

In another aspect, a system for air traffic control based on voice recognition is provided, the system comprising: a voice data acquisition module for collecting voice data in the cockpit of an aircraft; a voice recognition module for identifying Air traffic control commands in the voice data, the air traffic control commands including air traffic control requests from the user in the cockpit to the ground control center and air traffic control from the ground control center to the user one or more of the instructions; a user interface module for receiving confirmation input of the air traffic control order by the user; a processing module for: in response to the air traffic control order being the empty causing the transceiver module of the system to transmit the air traffic control request to the ground control center; and executing the air traffic control command in response to the air traffic control command being the air traffic control command.

Preferably, the user interface is further configured to display the air traffic control order to receive confirmation input of the air traffic control order by the user.

Preferably, the processing module is further configured to: in the case of receiving the confirmation input of the air traffic control order from the user, send an instruction to the ground control center about the second confirmation of the air traffic control order , and execute the air traffic control command in response to receiving a second confirmation of the air traffic control command from the ground control center via the transceiver module; generating a request for the user to repeat the speech associated with the air traffic control request in response to the air traffic control command being the air traffic control request with the confirmation input, and in response to the air traffic control request The command is the air traffic control command to send a request to the ground control center via the transceiver module to retransmit the signal associated with the air traffic control command.

Preferably, the air traffic control request is transmitted to the ground control center along with the user's voice data associated with the air traffic control request when the foreign call switch is closed; and when the foreign call switch is open In this case, the user's voice data associated with the air traffic control request is transmitted to the ground control center without transmitting the air traffic control request.

In yet another aspect, there is provided a non-transitory computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform any of the above methods.

This Summary is provided to introduce some concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Other aspects, features, and/or advantages of various embodiments will be set forth in part in the description that follows, and in part will be apparent from the description, or may be learned by practice of the present disclosure.

Description of drawings

In order that the manner in which the above-described features of the present application are used may be understood in detail, what has been briefly summarized above may be described in more detail with reference to various embodiments, some aspects of which are illustrated in the accompanying drawings. It should be noted, however, that the appended drawings illustrate only certain typical aspects of the application and are therefore not to be considered limiting of its scope, for the description may admit to other equally effective aspects. In the drawings, like reference numerals are designated likewise throughout. It is to be noted that the drawings described are only schematic and non-limiting. In the drawings, the dimensions of some of the features may be exaggerated and not drawn to scale for illustrative purposes.

FIG. 1 illustrates an example system for downlinking pilot speech to a ground air traffic control system in accordance with an embodiment of the present application.

2 illustrates an example system for uplinking air traffic controller speech to a flight management system in accordance with an embodiment of the present application.

3 illustrates an example block diagram of a method for air traffic control in accordance with an embodiment of the present application.

4 illustrates an example block diagram of a system for air traffic control in accordance with an embodiment of the present application.

5 illustrates a block diagram of an apparatus for air traffic control according to an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application will be further described in detail below with reference to specific embodiments and accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the described exemplary embodiments. However, it will be apparent to those skilled in the art that the described embodiments may be practiced without some or all of these specific details. In other example embodiments, well-known structures or process steps have not been described in detail to avoid unnecessarily obscuring the concepts of the present disclosure.

In this specification, unless otherwise stated, the term "A or B" used throughout this specification refers to "A and B" and "A or B" rather than that A and B are exclusive.

Air traffic control means that the ground controller manages and controls the activities of the aircraft in the air according to the prescribed flight plan and the real-time flight status of the aircraft in the air, so as to effectively utilize the airspace and ensure the safe and efficient flight of the aircraft. The main air traffic control method in my country is to send voice control instructions to the pilot through the ground controller, and the pilot repeats the relevant instructions to complete the confirmation of the instruction.

The traditional control method has the interference of many wireless channels, large background noise, personnel cognitive ability and accent deviation, etc., which cause errors in voice calls and have a certain impact on flight safety. After the crew gets the voice command, they still need to operate manually, which brings a certain burden to the pilot, especially in the critical flight stage, which will interfere with the pilot's safe driving.

Therefore, the present application proposes a two-way confirmation system based on speech recognition and a control method thereof, which can convert the air traffic control voice on the ground into air traffic control instructions, which are then loaded into the flight control system after being confirmed by the pilot; The voice request is converted into text, and after confirmation by the pilot, it goes down to the ground control center through the data link. The system and the control method of the present application can send, receive and execute textually voice request instructions more efficiently, quickly and accurately.

1 illustrates an example system 100 for downlinking pilot speech to a ground air traffic control system in accordance with an embodiment of the present application.

In the embodiment of the present application, the voice signal about the air traffic control request sent by the pilot can be directly and explicitly sent to the ground control center in a textual manner through the example system 100 .

As shown in FIG. 1, the voice data of the voice signal may first be collected through a pilot microphone and/or other equipment. In the embodiment of the present application, the air traffic control command in the voice data of the collected voice signal includes the air traffic control request sent from the user in the cockpit to the ground control center and the air control command sent from the ground control center to the user one or more of. For example, the voice signal collected by the pilot's microphone may include the air traffic control request sent by the pilot to the ground control center, or may be the response to the air traffic control instruction sent by the ground control center. For example, a standard database of ATC requests may be established, including: request for departure clearance, request for takeoff runway, request for taxi, request for entry and exit, request for take-off clearance, request for frequency handover, request for transponder identification, or a combination thereof.

In the embodiment of the present application, the pilot's voice signal can be converted into text data by the voice recognition module in the audio control panel (ACP), and further recognized as the air traffic control request in the above-mentioned standard database. The ATC request may then be displayed on the control display unit (CDU) for pilot input confirmation. In embodiments of the present application, the pilot may enter an acknowledgement or denial operation by pressing a button on the CDU or through the CDU. For example, the pilot's voice signal can be "Baiyun release, Air China 9170, the ground is ready". After text recognition, the text result "BAIYUN DELIVERY, CA9170, I AM READY" about the ATC request can be displayed on the CDU. If the text result is correct, the pilot can enter a confirmation action through the CDU; conversely, if the text result is incorrect or inaccurate, the pilot can enter a deny action through the CDU and repeat the speech about the ATC request. Additionally or alternatively, the aircraft's ATC system may generate a response to the pilot's retelling with The air traffic control requests the associated voice request, and the repeat request may be broadcast, eg, through a loudspeaker. It should be understood that the displayed text result/air traffic control request may also be an abbreviation for the air traffic control request that the pilot can understand or other content that can characterize the air traffic control request.

In the embodiment of the present application, the identification of the air traffic control request in the voice data may be based on the parameter information of the aircraft, and the parameter information includes: the aircraft type, flight number, secondary code, departure airport, landing airport, departure time, Flight status information, flight altitude, flight latitude and longitude, clearance phase, taxi phase or a combination thereof. For example, if the aircraft is known to be Air China 9170, the flight number of the aircraft can be identified as Air China 9170 regardless of whether the pilot speaks Chinese voice, English voice, or other voices (eg, dialect).

In the embodiments of the present application, a civil aviation-specific voice library may be established based on the unique pronunciation habits of domestic pilots, especially the pronunciation of numbers, airline codes, and the like. For example, the airline code of Air China 9170 in the above embodiment can be directly identified as CA. As for the flight number 9170, when the pilot sends the voice of Jiuyiguaidong, it can also be recognized as 9170 based on the unique voice database of civil aviation. In this way, when the pilot speaks "Air China 9170", it can be directly identified as CA9170 for display.

In the embodiment of the present application, a voice library can be established according to the standard voice of land-air communication, for example, a specific voice library can be established according to the parameters of the flight stage (for example, the release stage, the taxi stage), so as to identify the frequent occurrence of pilots and controllers in each stage. ATC request that requires confirmation. Preferably, these parameters can be matched to the flight plan for direct loading. For example, when it is known as the release stage and the departure airport is known to be Beijing, the pilot's voice signal "Air China 9170, requesting release to Beijing" can be recognized as "BAIYUN DELIVERY, CA 9170, CLEARED TO BEIJING", even if The pilot did not mention that the name of the departure airport was Baiyun Airport. It should be understood that the above-mentioned examples are stated only to illustrate rather than limit the present application.

In the embodiment of the present application, after the pilot confirms the voice requested by the air traffic control, the recognized text data can be down-transmitted to the ground through a data link (such as a VHF channel or a satellite channel) via a radio interface unit (RIU). control center. Additionally or alternatively, the recognized text data may be transmitted downstream to the ground control center along with the speech signal via a data link (eg, a VHF channel or a satellite channel).

In the embodiment of the present application, a voice recognition module may be added to the original audio control panel of the aircraft to complete the recognition of the voice signal, or a separate voice recognition device may be used. For example, a 1-bit PTT (Push-to-Talk, that is, push-to-talk) foreign call switch can be added, so that when the pilot needs to send a foreign call, he can choose to send it directly by voice, or send an air traffic control request through the recognized text data. Additionally or alternatively, it is also possible to select direct voice transmission through the foreign call switch, or to send the air traffic control request through the recognized text data together with the voice signal. For example, text data of the air traffic control request may be transmitted to the ground control center along with the user's voice data associated with the air traffic control request when the foreign call switch is closed; and to the ground control when the foreign call switch is open The center transmits the user's voice data associated with the ATC request without transmitting the ATC request. Additionally or alternatively, where the speech signal is transmitted over the ACP to the radio interface unit (RIU), designated bits in the text data may be set to "true" (eg, a value of 1), thereby identifying that the text data is from a driver. The air traffic control request sent by the user in the cabin to the ground control center. It should be understood that the text data may be identified as an air traffic control request sent from the user in the cockpit to the ground control center in a different manner from the above, and the specific details thereof will not be repeated here.

FIG. 2 illustrates an example system 200 for uplinking air traffic controller speech to a flight management system in accordance with an embodiment of the present application.

In the embodiment of the present application, the example system 200 can directly transmit the voice signal related to the air traffic control command from the ground control center to the aircraft, perform voice recognition to recognize it as a standard air traffic control command, and then load it into the flight control system .

As shown in Figure 2, the voice signal from the ground control center can be uplinked to the aircraft through a communication link (such as a VHF channel or satellite channel), and the voice signal is processed by a radio interface unit (RIU) and distributed to the audio control panel. These processes may be preprocessing such as noise reduction and equalization, which will not be repeated here.

In the embodiment of the present application, the voice signal of the ground control center can be played through the speaker in the cockpit or the pilot's earphone, and at the same time, it is converted into text data by the voice recognition module in the audio control board ACP, and further recognized as empty data in the standard database. Tube instructions. As described with reference to FIG. 1, a standard database of ATC instructions may be established, including: submission of flight plans, departure clearances, takeoff clearances, stand indications, runway indications, frequency indications, or combinations thereof.

In the embodiment of the present application, preferably, the air traffic control instruction can be displayed on the control display unit (CDU) for the pilot to input and confirm. In embodiments of the present application, the pilot may enter an acknowledgement or denial operation by pressing a button on the CDU or through the CDU. For example, for the air traffic control request "BAIYUN DELIVERY, CA9170, I AMREADY" by the pilot in Fig. 1, the voice signal of the ground control center can be "Air China 9170, contact the ground 121.85". After text recognition, the text result "CA9170, CONTACT GROUND 121.85" about the ATC instruction can be displayed on the CDU. In the embodiment of the present application, the pilot can compare the text result of the air traffic control instruction with the voice signal of the earphone or the broadcast ground control center. If the text result is correct, the pilot can input the confirmation operation through the CDU. Further, after receiving the confirmation input of the air traffic control command from the pilot, the air traffic control command can be transmitted to the air traffic control system of the aircraft so that the air traffic control system can directly execute the air traffic control command. Additionally or alternatively, after the pilot compares and confirms the textual results of the identified ATC order, the pilot may repeat the ATC order and send an indication to the ground control center that the ATC order is to be reconfirmed. Preferably, the air traffic control instruction recited by the pilot can be sent directly by voice, or the voice can be sent together with the text result of the recognized air traffic control instruction. Preferably, the air traffic control command is transmitted to the air traffic control system of the aircraft to execute the air traffic control command upon receipt of a second confirmation of the air traffic control command from the ground control center. If the textual result is incorrect or inaccurate, the pilot can enter a denial action through the CDU and send a request to the ground control center to retransmit the voice signal associated with the air traffic control order. Additionally or alternatively, the aircraft's air traffic control system may generate a response to retransmission of the speech associated with the ATC command without receiving confirmation input from the pilot for the ATC command for a threshold time (eg, 5 s). A request for a signal and sending the request to the ground control center, or sending a request to the ground control center to repeat the speech associated with the ATC order. It should be understood that the displayed text result/air traffic control instruction may also be an abbreviation of the air traffic control instruction that the pilot can understand or other content that can characterize the air traffic control request.

In the embodiment of the present application, the recognition of the air traffic control instruction in the voice data may be based on the parameter information of the aircraft, and the parameter information includes: the aircraft type, flight number, secondary code, departure airport, landing airport, departure time, Flight status information, flight altitude, or a combination thereof. For example, if the aircraft is known to be Air China 9170, the flight number of the aircraft can be identified as Air China 9170 regardless of whether the pilot speaks Chinese voice, English voice, or other voices (eg, dialect). In the embodiments of the present application, a civil aviation-specific voice library may be established based on the unique pronunciation habits of domestic pilots, especially the pronunciation of numbers, airline codes, and the like. For example, the airline code of Air China 9170 in the above embodiment can be directly identified as CA. As for the flight number 9170, when the pilot sends the voice of Jiuyiguaidong, it can also be recognized as 9170 based on the unique voice database of civil aviation. In this way, when the pilot speaks "Air China 9170", it can be directly identified as CA9170 for display. In the embodiment of the present application, a voice library can be established according to the standard voice of land-air communication, for example, a specific voice library can be established according to the parameters of the flight stage (for example, the release stage, the taxi stage), so as to identify the frequent occurrence of pilots and controllers in each stage. ATC orders that require confirmation. Preferably, these parameters can be matched to the flight plan so as to be loaded directly into the flight tube system. For example, when it is known as the release stage and the landing airport is known to be Beijing, the voice signal "Air China 9170, permission to release" from the controller of the ground control center can be identified as "CA9170, CLEARED TO BEIJING", even if the control The officer did not mention the name of the landing airport. It should be understood that the above-mentioned examples are stated only to illustrate rather than limit the present application.

In an embodiment of the present application, in the case where the speech signal is processed by the radio interface unit (RIU) and then distributed to the audio control board, specified bits in the text data may be set to "false" (eg, value 0), thereby Identifies that the text data is an air traffic control instruction issued to the user from the ground control center. Accordingly, whether the air traffic control command is an ATC request or an ATC instruction can be determined based on the designated bit

It should be understood that the text data may be identified as an air traffic control instruction sent from the ground control center to the user in a different manner from the above, and the specific details thereof will not be repeated here.

In the embodiment of the present application, as described in conjunction with FIG. 1 and FIG. 2 , the voice signal of the user in the cabin, the voice signal received from the ground control center played through the speaker, or directly collected from the ground control center can also be collected at the same time. Received speech signals (eg, received via the RIU). Correspondingly, after the collected voice signal is converted into text data through voice recognition, the air traffic control command corresponding to the voice signal and/or the text data can be searched in the air traffic control command library or the air traffic control command look-up table, determining whether it is an ATC request or an ATC instruction, and transmitting the ATC request to the ground control center in response to the ATC order being an ATC request; and executing the ATC request in response to the ATC order being an ATC instruction Tube instructions.

3 illustrates an example block diagram of a method 300 for air traffic control in accordance with an embodiment of the present application.

Method 300 may include, at operation 310, collecting speech data in a cockpit of an aircraft. This operation may be similar to the acquisition of voice data of the user in the cabin, the acquisition of voice data from the voice signal received from the ground control center played via the speakers, and/or the voice data from the ground control center, as described by reference to FIGS. 1 and 2 . The voice data in the voice signal received by the center. Preferably, operation 310 may be embodied by the speech data collection module 405, as described in more detail below with reference to FIG. 4 .

Method 300 may include, at operation 320, identifying air traffic control commands in the voice data, the air traffic control commands including air traffic control requests from a user in the cockpit to a ground control center and from the ground one or more of the air traffic control instructions issued by the control center to the user. The operation may be similar to that described by referring to Figures 1 and 2, the collected speech signal may be converted into text data by a speech recognition module in the Audio Control Panel (ACP), and further based on a standard speech database ATC orders are identified as ATC requests or ATC orders. Preferably, the standard database for ATC requests may include: request for departure clearance, request for takeoff runway, request for taxi, request for entry and exit, request for take-off clearance, request for frequency handover, request for transponder identification, or combinations thereof. Preferably, the standard database on ATC instructions may include: submission of flight plans, departure clearances, takeoff clearances, stand indications, runway indications, frequency indications, or a combination thereof. Preferably, the collected speech can be identified based on parameter information of the aircraft, the parameter information including: aircraft type, flight number, secondary code, departure airport, landing airport, departure time, flight status information, flight altitude, Longitude and latitude of flight, clearance phase, taxi phase, or a combination thereof. Preferably, operation 320 may be embodied by the speech recognition module 410 , as described in more detail below with reference to FIG. 4 .

Method 300 may include, at operation 330, receiving confirmation input from the user for the air traffic control order. This operation may be similar to that described by referring to FIGS. 1 and 2, and the air traffic control commands may be displayed on a control display unit (CDU) for confirmation by the pilot input. Preferably, the pilot can compare the previously narrated voice heard from the broadcast/earphone with the air traffic control command text result displayed on the CDU, and if the text result is correct, the pilot can input the confirmation operation through the CDU; Conversely, if the textual result is incorrect or inaccurate, the pilot may enter a deny action through the CDU. Preferably, operation 330 may be embodied by user interface module 415 , as described in more detail below with reference to FIG. 4 .

The method 300 may include, at operation 340, transmitting the air traffic control request to the ground control center in response to the air traffic control order being the air traffic control request; and in response to the air traffic control order being the air traffic control request The air-traffic command is executed according to the air-traffic command. This operation may be similar to that, as described by referring to Figures 1 and 2, where the identified ATC command is an ATC command, an ATC command may be transmitted to the aircraft's air traffic control system for said air traffic control command The pipe system executes the empty pipe command. Preferably, upon receipt of a confirmation input from the user for an air traffic control order, the user may repeat the air traffic control order and send an indication to the ground control center that the air traffic control order is to be reconfirmed, and upon receipt of the second order The ATC command is executed only after confirmation. Preferably, the user's confirmation input to the ATC command is not received (eg, the pilot may enter a deny operation through the CDU or the pilot's confirmation input to the ATC request is not received for a threshold time (eg, 5s)) In this case, the aircraft's ATC system may generate a request for the user (eg, the pilot) to repeat the speech associated with the ATC request, or a request for the ground control center to retransmit the ATC command or to repeat the ATC command, or both to the ground control center. Preferably, the foreign language switch can be used to select whether to transmit the ATC request to the ground control center together with the user's voice data associated with the ATC request or to transmit only the user's voice data associated with the ATC request without transmitting the ATC ask. Preferably, operation 340 may be embodied by processing module 420, as described in more detail below with reference to FIG. 4 .

4 illustrates an example block diagram of a system 400 for air traffic control in accordance with an embodiment of the present application.

As shown in FIG. 4 , the system 400 may include a voice data collection module 405 for collecting voice data in the cockpit of the aircraft. The operations implemented by the voice data acquisition module 405 may be similar to as described by referring to FIG. 1 and FIG. 2 , collecting voice data of users in the cabin, collecting voice data of voice signals received from the ground control center played via speakers, and/or voice data in voice signals received from ground control centres.

As shown in FIG. 4 , system 400 may include a speech recognition module 410 for recognizing air traffic control commands in the speech data, including air traffic control commands issued from a user in the cockpit to a ground control center one or more of an air traffic control request from the ground control center and an air traffic control instruction to the user from the ground control center. The operation implemented by the speech recognition module 410 may be similar to that described by referring to FIG. 1 and FIG. 2, and the collected speech signal may be converted into text data by the speech recognition module in the audio control panel (ACP), and further based on Standard speech database to identify ATC commands as ATC requests or ATC instructions. Preferably, the standard database for ATC requests may include: request for departure clearance, request for takeoff runway, request for taxi, request for entry and exit, request for take-off clearance, request for frequency handover, request for transponder identification, or combinations thereof. Preferably, the standard database on ATC instructions may include: submission of flight plans, departure clearances, takeoff clearances, stand indications, runway indications, frequency indications, or a combination thereof. Preferably, the collected speech can be identified based on parameter information of the aircraft, the parameter information including: aircraft type, flight number, secondary code, departure airport, landing airport, departure time, flight status information, flight altitude, Longitude and latitude of flight, clearance phase, taxi phase, or a combination thereof.

As shown in FIG. 4, the system 400 may include a user interface module 415 for receiving confirmation input of the air traffic control order from the user. The operation performed by the user interface module 415 may be similar to that as described by referring to FIGS. 1 and 2, and the air traffic control commands may be displayed on the user interface module 415, such as a control display unit (CDU), for pilots Enter to confirm. Preferably, the pilot can compare the previously narrated voice heard from the broadcast/earphone with the air traffic control command text result displayed on the CDU, and if the text result is correct, the pilot can input the confirmation operation through the CDU; Conversely, if the textual result is incorrect or inaccurate, the pilot may enter a deny action through the CDU.

As shown in FIG. 4 , the system 400 may include a processing module 420 for causing the transceiver module of the system to transmit the air traffic control request to the ground control center in response to the air traffic control command being the air traffic control request ; and executing the air traffic control command in response to the air traffic control command being the air traffic control command. The operations performed by the processing module 420 may be similar to, as described by referring to FIGS. 1 and 2 , where the identified ATC order is an ATC order, an ATC order may be transmitted to the aircraft’s air control system. for the ATC system to execute the ATC instruction. Preferably, upon receipt of a confirmation input from the user for an air traffic control order, the user may repeat the air traffic control order and send an indication to the ground control center that the air traffic control order is to be reconfirmed, and upon receipt of the second order The ATC command is executed only after confirmation. Preferably, the user's confirmation input to the ATC command is not received (eg, the pilot may enter a deny operation through the CDU or the pilot's confirmation input to the ATC request is not received for a threshold time (eg, 5s)) In this case, the aircraft's ATC system may generate a request for the user (eg, the pilot) to repeat the speech associated with the ATC request, or a request for the ground control center to retransmit the ATC command or to repeat the ATC command, or both to the ground control center. Preferably, the foreign language switch can be used to select whether to transmit the ATC request to the ground control center together with the user's voice data associated with the ATC request or to transmit only the user's voice data associated with the ATC request without transmitting the ATC ask.

For the specific details of the operations of the above-mentioned modules, reference may be made to the descriptions of the above methods. It should be appreciated that some of these optional operations may be performed by the modules described above, or by additional modules.

Figure 5 illustrates a block diagram of an apparatus 500 for air traffic control according to an embodiment of the present application.

The apparatus may include a processor 510 and a memory 515, the processor being configured to perform any of the methods described above, such as the methods shown in the various figures, and the like. The memory may store, for example, articles acquired, information associated with products or services, data that may be generated during processing, and necessary algorithms, among others.

The apparatus may include a network connection element 525, which may include, for example, a network connection device that connects to other devices through a wired or wireless connection. The wireless connection may be, for example, a WiFi connection, a Bluetooth connection, a 3G/4G/5G network connection, or the like. User input from other devices may also be received via the network connection element or data may be transmitted to other devices for display.

The device also optionally includes other peripheral elements 520, such as input devices (eg, keyboard, mouse), output devices (eg, display), and the like. For example, in a method based on user input, a user may perform an input operation via an input device. Corresponding information can also be output to the user via the output device.

Each of these modules may communicate directly or indirectly with each other, eg, via one or more buses (eg, bus 505).

Furthermore, embodiments of this specification also disclose a computer-readable storage medium comprising computer-executable instructions stored thereon that, when executed by a processor, cause the processor to perform the operations described herein. the method of each embodiment.

In addition, embodiments of the present specification also disclose an apparatus comprising a processor and a memory storing computer-executable instructions that, when executed by the processor, cause the processor to perform the operations described herein the method of each embodiment.

In addition, the embodiments of the present specification also disclose a system for retrieval of similar cases, the system comprising means for implementing the methods of the embodiments described herein. In one aspect, the system includes: means for collecting voice data in a cockpit of an aircraft; means for recognizing air traffic control commands in the voice data, the air traffic control commands including data from the cockpit One or more of an air traffic control request issued by a user in the ground control center to the ground control center and an air traffic control instruction issued by the ground control center to the user; means for confirming the input; means for transmitting the air traffic control request to the ground control center in response to the air traffic control order being the air traffic control request; and for transmitting the air traffic control request to the ground control center in response to the air traffic control command being the air traffic control request A device for executing the ATC instruction according to the ATC instruction.

The above describes the method, system and computer-readable storage medium for realizing air traffic control based on two-way confirmation based on speech recognition according to the present application. Compared with the prior art, the method of the present application has at least the following advantages:

(1) The voice request command sent by the pilot is directly and clearly sent to the ground control center in the form of text, and the ground control center can directly upload the voice command to the aircraft, and the voice recognition is a standard air traffic control command, which is directly loaded into the Flight control system, so as to send, receive and execute textual voice request commands more efficiently, quickly and accurately;

(2) Effectively reduce the burden of pilots, reduce unsafe incidents caused by factors such as accents, enhance the efficiency of air traffic control, reduce data link costs, and bring benefits to airlines.

Throughout this specification reference has been made to "an embodiment", meaning that a particular described feature, structure or characteristic is included in at least one embodiment. Thus, use of these phrases may refer to more than one embodiment. Furthermore, the described features, structures or characteristics may be combined in any suitable manner in one or more embodiments.

The various steps and modules of the above-described methods and apparatuses can be implemented in hardware, software, or a combination thereof. If implemented in hardware, the various illustrative steps, modules, and circuits described in connection with this specification may be used with general purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic components, hardware components, or any combination thereof. A general-purpose processor may be a processor, a microprocessor, a controller, a microcontroller, a state machine, or the like. If implemented in software, the various illustrative steps, modules described in connection with this specification may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Software modules implementing various operations of this specification may reside in storage media such as RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, removable disk, CD-ROM, cloud storage, and the like. A storage medium may be coupled to the processor, such that the processor can read and write information from/to the storage medium, and execute corresponding program modules to implement the various steps of the present specification. Furthermore, software-based embodiments may be uploaded, downloaded, or accessed remotely through appropriate communication means. Such suitable means of communication include, for example, the Internet, the World Wide Web, an Intranet, software applications, electrical cables (including fiber optic cables), magnetic communications, electromagnetic communications (including RF microwave and infrared communications), electronic communications, or other such means of communication.

It will be appreciated that a method according to one or more embodiments of this specification may be implemented in software, firmware or a combination thereof. It should be understood that each embodiment in this specification is described in a progressive manner, and the same or similar parts of the various embodiments may refer to each other, and each embodiment focuses on the differences from other embodiments. . In particular, for the apparatus and system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant parts.

It should be understood that the foregoing describes specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

It will be understood that the description of an element herein in the singular or the representation of only one in a drawing does not imply that the number of the element is limited to one. Furthermore, modules or elements described or illustrated herein as separate may be combined into a single module or element, and modules or elements described or illustrated herein as a single module or element may be split into multiple modules or elements.

It should also be understood that the terms and expressions used herein are for descriptive purposes only, and one or more embodiments of the present specification should not be limited to these terms and expressions. The use of these terms and expressions is not intended to exclude any equivalent features of the illustrations and descriptions (or parts thereof), and it should be recognized that various modifications that may exist should also be included within the scope of the claims. Other modifications, changes and substitutions may also exist. Accordingly, the claims should be deemed to cover all such equivalents.

Also, it should be pointed out that although the description has been made with reference to the current specific embodiments, those of ordinary skill in the art should realize that the above embodiments are only used to illustrate one or more embodiments of the present specification, Various equivalent changes or substitutions can be made without departing from the spirit of the embodiments of the present specification. Therefore, as long as the changes and modifications of the above-mentioned embodiments are within the scope of the essential spirit of the present specification, they will fall within the scope of the present specification. within the scope of the claims.

Claims (15)

1. A method of air traffic control, the method comprising: Collect voice data in the cockpit of the aircraft; Identify air traffic control commands in the voice data, the air traffic control commands including air traffic control requests from the user in the cockpit to the ground control center and air traffic control commands from the ground control center to the user. manage one or more of the Directives; receiving confirmation input from the user for the air traffic control order; transmitting the air traffic control request to the ground control center in response to the air traffic control order being the air traffic control request; and The air traffic control command is executed in response to the air traffic control command being the air traffic control command. 2. The method of claim 1, further comprising: The air traffic control order is displayed to receive confirmation input of the air traffic control order by the user. 3. The method of claim 1, wherein executing the air traffic control instruction further comprises: The air traffic control command is transmitted to an air traffic control system of the aircraft for the air traffic control system to execute the air traffic control command. 4. The method of claim 1, wherein executing the air traffic control instruction further comprises: sending an instruction to said ground control center that said ATC order is to be reconfirmed; and The air traffic control order is executed in response to receiving a secondary confirmation of the air traffic control order from the ground control center. 5. The method of claim 1, further comprising performing the following operations based on not receiving confirmation input from the user for the air traffic control order: generating a request for the user to repeat the speech associated with the air traffic control request in response to the air traffic control command being the air traffic control request; and A request to retransmit a signal associated with the air traffic control order is sent to the ground control center in response to the air traffic control order being the air traffic control order. 6. The method of claim 1, wherein the method further comprises: transmitting the air traffic control request to the ground control center with the user's voice data associated with the air traffic control request with the foreign call switch closed; and In the case that the foreign call switch is turned off, the user's voice data associated with the air traffic control request is transmitted to the ground control center without transmitting the air traffic control request. 7. The method of claim 1, wherein collecting the voice data in the cockpit comprises: collect the user's voice data; or Voice data in voice signals received from the ground control center is collected. 8. The method of claim 1, wherein the air traffic control request comprises: request for departure clearance, request for take-off runway, request for taxi, request for entry and exit, request for take-off clearance, request for frequency handover, request for transponder identification, or a combination thereof. 9. The method of claim 1, wherein the air traffic control instruction comprises: submitting a flight plan, departure clearance, takeoff clearance, stand indication, runway indication, frequency indication, or a combination thereof. 10. The method of claim 1, wherein identifying the air traffic control command in the voice data comprises: The voice data is identified based on the parameter information of the aircraft, the parameter information includes: the aircraft type, flight number, secondary code, take-off and landing airport, landing airport, departure time, flight status information, flight altitude , flight latitude and longitude, release phase, taxi phase, or a combination thereof. 11. A system for air traffic control based on speech recognition, the system comprising: A voice data acquisition module, which is used to collect voice data in the cockpit of the aircraft; a voice recognition module for recognizing air traffic control commands in the voice data, the air traffic control commands including air traffic control requests from a user in the cockpit to a ground control center and from the ground control center one or more of the air traffic control instructions issued to the user; a user interface module for receiving confirmation input of the air traffic control order by the user; Processing module, which is used to: causing a transceiver module of the system to transmit the air traffic control request to the ground control center in response to the air traffic control command being the air traffic control request; and The air traffic control command is executed in response to the air traffic control command being the air traffic control command. 12. The system of claim 10, wherein the user interface module is further configured to display the air traffic control order to receive confirmation input of the air traffic control order by the user. 13. The system of claim 1, wherein the processing module is further configured to: sending an indication to the ground control center that the air traffic control order is to be re-confirmed upon receipt of confirmation input of the air traffic control order by the user, and in response to receiving via the transceiving module The ground control center executes the ATC instruction after the second confirmation of the ATC instruction; or generating a response to the air traffic control order being the air traffic control request without receiving the confirmation input from the user for the air traffic control order A request for an associated voice, and in response to the ATC command being the ATC command, sending via the transceiver module to the ground control center a signal to retransmit a signal associated with the ATC command ask. 14. The system of claim 1, wherein: transmitting the air traffic control request to the ground control center with the user's voice data associated with the air traffic control request with the foreign call switch closed; and In the case that the foreign call switch is turned off, the user's voice data associated with the air traffic control request is transmitted to the ground control center without transmitting the air traffic control request. 15. A non-transitory computer-readable storage medium storing instructions that, when executed by a computer, cause the computer to perform the method of any of claims 1-10.

Images