Drone Manufacturer: DJI
Drone Model: Matrice 210
Country: United Kingdom of Great Britain and Northern Ireland
Type: Accident
Date: 2019-03-16
Applies: Daytime Flight Over People
Pilot Qualifications: Unknown Status
Pilot Flight Experience: 67 Hours
Link to External Information About This submission: https://www.gov.uk/aaib-reports/aaib-investigation-to-dji-matrice-210-uas-registration-n-a-16-march-2019
File Uploaded: dji_matrice_210_uas_registration_na_0120
Description
Synopsis
The DJI Matrice 210 small unmanned aircraft was being operated commercially to record video footage of an outdoor athletics event. The pilot started to position the aircraft back towards the landing site due to an increase in the rainfall. The pilot then saw the aircraft “wobble” slightly and as it neared the landing site it flipped over before descending rapidly to the ground from a height of about 3 m (10 ft). No one was injured. During the accident flight the aircraft had been operating at heights of up to about 30 m (100 ft) near to, and above people on the ground. This investigation reviewed other similar accidents and the risk of injury to people on the ground. Two Safety Recommendations are made to the UK CAA.
History of the flight
The DJI Matrice 210 small unmanned aircraft (SUA) was being operated on a commercial flight to record footage of an outdoor athletics event that was taking place in the grounds of Temple Newsam House, Leeds. The event was attended by several hundred competitors and spectators. There had been intermittent rain showers throughout the day and the wind was from the west at about 10 kt, with gusts of approximately 22 kt.
Prior to the event, attendees had been made aware of the planned operation of an unmanned aircraft system (UAS) by providing details of the intended operation in the ‘event application form’ and by briefings on the day. The pilot5 of the aircraft stated that he had liaised with the event safety officer and considered that attendees were:
‘under my control as they were part of the event, briefed about the operation, and able to be informed if an emergency situation occurred via the event staff over the tannoys’ [public address system].
A cordoned takeoff and landing site (TOLS) situated away from the public area was used. The aircraft was flown three times in the morning, during which it had rained lightly for about 20 minutes. The pilot advised that since purchasing the UAS from new in August 2018, the aircraft had been operated in light rain on several occasions without incident.
At 1303 hrs the aircraft took off from the TOLS and was positioned overhead the venue at a height of about 30 m (100 ft) agl, where filming took place (Figure 1). During the initial part of the flight it had been raining “lightly” but after about six minutes the rainfall started to increase. The pilot then decided to position the aircraft back towards the TOLS, which was about 400 m away, whilst also descending the aircraft.
Whilst en route to the TOLS, the aircraft passed overhead people at a height of about 10 m (~30 ft) agl (Figure 2 and Figure 3). At some point during this period the pilot saw the aircraft do “a little wobble” and became concerned that there was a problem and stopped filming. As the aircraft approached the TOLS at a height of about 3 m (10 ft) agl it suddenly “flipped itself upside down and drove itself into the ground”. No person was injured, but the aircraft was severely damaged. The recorded flight time was about eight minutes.
UAS information
The Matrice 210 is a quadcopter aircraft with a maximum takeoff mass of 6.14 kg (Figure 4). With its flight controller, the aircraft forms a UAS. During the accident flight the mass was 4.97 kg, which included an underslung camera mounted on a gimbal and two TB55 batteries. The Matrice 210 forms part of the manufacturer’s model range referred to as the Matrice 200 series.
Electronic Speed Controller
Each of the four propeller motors was controlled by an associated electronic speed controller (ESC) that was fitted in a chamber located below each motor (Figure 5). The ESC consisted of electronic components soldered to a circuit board that was connected to the motor and main body of the aircraft using a push-fit connector and soldered connections. Fitted to each ESC was a label (Figure 6) that changed colour if it was exposed to moisture or liquids. Moisture can result in erroneous operation or failure of electronic components and/or electrical connections.
To prevent moisture and dust6 ingress into the ESC chamber the UAS manufacturer advised that most of the chamber was sealed using adhesive and gaskets, but the attachment holes and seam between the antenna case and lower chamber were not sealed. The manufacturer advised that they were working on an improvement to seal this area but did not confirm if this had been introduced on new aircraft, or if it would be offered as a retrofit for aircraft already in-service.
Environmental protection
The UAS manufacturer stated that the Matrice 200 series had been tested to meet IP 43 standards, which included the following water and solid object ingress requirements:
vertically dripping water shall have no harmful effect.
vertically dripping water shall have no harmful effect when the enclosure is tilted at an angle up to 15° from its normal position.
water falling as a spray at any angle up to 60° from the vertical for a duration of 10 minutes shall have no harmful effect.
Solid objects with a diameter of 1 mm or more should not be able to enter the unit.
During IP43 accreditation testing, the propeller motors were operated but the propellers were not fitted. The manufacturer advised that the facility that carried out the testing could not accommodate the aircraft when these items were fitted. The manufacturer subsequently carried out its own in-house test with the propellers fitted whilst water was sprayed onto the aircraft. The manufacturer stated that no moisture was subsequently found within the unit.
Information on the operation of the Matrice 200 series aircraft in rain was available on the manufacturer’s website. In the FAQ (frequently asked questions) section it was stated that the ‘IP43 protection rating allows the Matrice 200 series to maintain stable flight in light rain weather conditions (less than 10 mm/h rainfall)’. The guidance also stated that in rain, the frame (motor) arms should not be folded and the aircraft should not be operated at pitch angles of more than 60°. Users were advised to use either a TB55 or TB50-M200 battery and not to use an external GPS module.
The manufacturer’s website also provided thirteen ‘documents and manuals’ relating to the operation of the Matrice 200 series aircraft. The ‘User Manual’ and ‘disclaimer and safety guidelines’10 manuals contained the following information:
‘Under stable laboratory conditions, the Matrice 200 series achieves IP43 rating by IEC60529 standards when equipped with TB50-M200 or TB55 intelligent Flight Batteries. However, this protection rating is not permanent and may reduce over time after long-term use.
DO NOT fly when the amount of rainfall exceeds 10 mm/h.’
Reference to the longevity of the IP43 protection was not included in the manufacturer’s information, and no guidance was provided as to how to ascertain if the IP43 protection had degraded, or what was considered to be ‘long-term use’ of the system, or how to determine if the level of rainfall exceeded the recommended operating limit of 10 mm/h.
In addition to the information provided by the manufacturer, one of its approved Enterprise dealer’s in the UK provided the following information on its website:
‘The Matrice 200 is the first DJI platform to feature IP43 Ingress protection. In practice – this means the Matrice 200 will be fully protected when flying in wet conditions, either through precipitation or moisture in the atmosphere.’ The UK Met Office use various gauges to measure rainfall and provided the following definitions (Table 1):
UAS examination
The pilot sent the aircraft to an Enterprise dealer in the UK for examination. It was found that the No 3 motor ESC moisture indicator had been activated and evidence of liquid residue was found on the ESC circuit board (Figure 7).
The No 3 motor arm had remained intact following the accident and the pilot stated that the arms had never been folded since the aircraft had been purchased from new in August 2018. The remaining ESC’s were inspected, but no evidence of moisture ingress was found.
The onboard recorded data contained fault messages that coincided with the loss of control of the aircraft. These messages referred to a No 3 motor ESC ‘link down’ and a fault with the No 4 motor ESC. The manufacturer reviewed this data and advised its Enterprise dealer that the accident had been caused by a fault with the No 4 ESC. The aircraft was subsequently sent to the manufacturer for further evaluation. At the time of report publication, no further information had been provided by the manufacturer on the cause of the No 4 ESC failure or if the moisture found on the No 3 ESC had caused this ESC to also fail.
UAS accidents
Matrice 200 series
The manufacturer provided information (Table 2) on the ‘probable cause’12 of 44 accidents involving the Matrice 200 series that had occurred internationally between October 2018 and March 2019. The manufacturer was asked to provide information on the number of Matrice 200 series aircraft sold in the UK and internationally, but this was not provided.
The manufacturer stated the following concerning ESC failures due to water ingress:
‘Physical component analysis showed that water ingress points are close to the center part of the ESC board, which is close to the antenna, and damaged parts of the ESC are mostly located on the back side of the PCB board (the side of the antenna). Therefore, there is the possibility that water seeped in from the closing part of the antenna case. Water ingress will cause the ESC and other components to short circuit, causing complete damage and signal lost [sic], or to send out abnormal signals causing abnormal motor behaviour [sic], which may lead to an incident.’
Non-ESC failures included malfunction of the propeller motors. The cause of these failures was considered by the manufacturer to have been caused by the motor either becoming ‘clogged’ by sand, dust or other small particles, or having been damaged prior to the accident, such as during a previous collision with a hard surface. The IP43 rating provided protection against entry of solid objects with a diameter of >1 mm but not smaller particles, such as dust or sand.
UAS accidents reported to the AAIB
Table 3 provides information on 59 UAS accidents13 reported to the AAIB between February 2015 and 31 July 2019. This information included 18 accidents involving the Matrice 200 series aircraft.
Table 4 provides a detailed breakdown of the 16 Matrice 200 series accidents that involved technical failures.
The majority of UAS accidents reported to the AAIB have involved quadcopters. In the event of a motor failure, the configuration of a quadcopter means it is unlikely to remain controllable. The evidence available to the AAIB shows that, in these cases, the UAS tumbles and falls rapidly to the ground. Where electrical power has been lost to all motors, the UAS will free fall to the ground.
UAS regulations
At the time of the accident the UK CAA defined three categories of UAS:
’20 kg or less – Small Unmanned Aircraft (SUA) – this class covered all types including traditional remotely controlled model aeroplanes, helicopters or gliders, as well as multirotor ‘drones’ and remotely controlled ‘toy’ aircraft. They were subject to some parts of UK aviation law, which is discussed in the following sections of this report.
>20 kg to 150 kg – Light Unmanned Aircraft (LUA) – this class covered larger and potentially more complex types of unmanned aircraft (UA) and large model aircraft. They were subject to all aspects of UK aviation law, but exemptions could be granted to some requirements.
Over 150 kg – aircraft operating within this class would normally be subject to the same level of regulatory approval requirement as would be used for traditional manned aircraft.’
The CAA stated that they had not carried out a risk assessment concerning the overflight of people by an SUA. The Air Navigation Order (ANO) required a pilot operating a SUA (commercially or for private use) that was equipped to undertake any form of surveillance or data acquisition to comply with the following requirements, unless in accordance with a permission issued by the CAA:
‘Must not operate an aircraft over or within 150 metres of any congested18 area;
Must not operate an aircraft over or within 150 metres of an organised open-air assembly of more than 1,000 persons;
Must not operate an aircraft within 50 metres of any vessel, vehicle, structure or person which is not under the control of the pilot of the aircraft;
Must not operate an aircraft within 30 metres of any person (except the pilot) during takeoff or landing unless a person is under the control of the pilot.’
The ANO also included several articles relevant to the safe operation of a UAS, which included:
Article 241 ‘a person must not recklessly or negligently cause or permit an aircraft to endanger any person or property’
Article 94 ‘(2) The remote pilot of a small unmanned aircraft may only fly the aircraft if reasonably satisfied that the flight can safely be made’ On 11 June 2019 regulations relating to the harmonized use of UAS within Europe were published. This contained the following regulations (the CAA has also issued CAP178919 that summarises these):
Commission Implementing Regulation (IR) (EU) 2019/947 on the procedures and rules for the operation of a UA.
Commission Delegated Regulation (DR) (EU) 2019/945 on a UA and on third country operators. The DR became applicable on 1 July 2019 and the IR becomes applicable on 1 July 2020. Operations of UAS will then be placed into one of three categories:
‘Open category (less than 25 kg) – operations that present a low (or no) risk to third parties. Operations are to be conducted in accordance with basic and pre-defined characteristics and are not subject to any further authorisation requirements. The open category is divided into operational ‘subcategories’ A1, A2 and A3. Within each subcategory are classes of UAS that include C0, C1, C2, C3 and C4 (Table 4).
Specific category – operations that present a greater risk than that of the open category, or where one or more elements of the operation fall outside the boundaries of the open category. Operations will require an operational authorisation from the national aviation authority (i.e. the CAA in the UK) based on a safety risk assessment.
Certified category – operations that present an equivalent risk to that of manned aviation and will be subject to the same regulatory regime (i.e. certification of the aircraft, certification of the operator, licensing of the pilot).’
The open category is expected to apply to hobbyist users and some commercial operators. In this category, only a UA with a mass of less than 250 grams and, for UA’s introduced after 1 July 2022, a maximum velocity of 19 m/s, is permitted to fly over ‘uninvolved people’ but it must never be flown over an assembly of people (crowd). A UA of 250 grams or more must not be flown over ‘uninvolved people’.
The Europen Union (EU) implementing regulations define uninvolved people as ‘persons who are not participating in the UA operation or who are not aware of the instructions and safety precautions given by the UA operator’. In order to be an involved person, they need to have been given explicit consent to be part of the UA operation and have received some form of safety precautions/instructions.
The definition provided in the EU Implementing regulations for an assembly of people (crowd) is ‘gatherings where persons are unable to move away due to the density of the people present’.
The CAA also provided the following clarifications to the AAIB:
Informing an assembly of people, such as at a concert, that a UA will be flying overhead is not sufficient and these people would be considered to be ‘uninvolved’.
In the A1 subcategory, a UA must never overfly an assembly of people (either involved or uninvolved).
The specific category will typically apply to commercial operations in the UK. This category introduces the concept of ‘standard scenarios’ of use, for which a risk assessment has already been made and mitigating safety actions provided relative to the task involved.
If a scenario matches the intended task, the operator will make a statement of declaration to the CAA that includes the need to comply with any mitigating safety actions. If the intended task is not covered by the scenarios, the operator is required to carry out a risk assessment and apply to the CAA for operational authorisation. The scenarios are expected to be published by the European Commission (EC) in early 2021. Discussions with the CAA indicate that one of several mitigating actions could include the fitment of an aircraft parachute recovery system.
The EU regulations also make provision for an optional light UAS operator certificate (LUC) scheme, which allows the CAA as a national aviation authority to issue privileges to UAS operators, including the possibility of authorising their own operations.
CAA guidance on UAS overflight of people, built-up areas and crowds
In October 2019, the CAA published The Drone and Model Aircraft Code20. This provided the following guidance on operating a UAS of 20 kg or less near to people:
‘Never fly closer to people than 50m. Even when your drone is more than 50m away from people, it’s safer to avoid flying or hovering directly over them. You’re responsible for flying safely whenever you fly.’
The code also included the following examples of built-up and busy areas, and where crowds of more than 1,000 people shall not be flown near to or over by a UAS of 20 kg or less.
‘cities and towns, villages, beaches and recreational parks that are part of a city, town or village, housing estates, schools and offices, retail, warehouse, industrial and business parks, theme parks, sports events, music festivals or concerts, marches or rallies or carnivals.’
UAS design, production and maintenance
A SUA (a mass of 20 kg or less) operating in the UK does not require airworthiness approval or require CAA oversight of its design, production or maintenance. However, manufacturers can declare that their UAS meets European Standards (EN). Relevant EN’s include 60950-1 and 62311:2008 that include risk of fire, electric shock or injury to the operator and exposure to electromagnetic fields. The manufacturer of the Matrice 200 series had declared that it was compliant with six EN’s, however EN’s do not assure product reliability or that a fault will not cause loss of control of the aircraft.
The rules introduced in DR 2019/945 and IR 2019/947 require that a UAS operating in the open category will be subject to a set of product standards similar to the ‘Conformité Européene (CE)’21 marking scheme. It will require that all UAS operating in this category must be marked with the appropriate UAS class number (C0, C1, C2, C3 or C4) by 01 July 2022. A UAS sold for use in the specific category will come under a different set of requirements that are still to be developed, but have been outlined as being:
set out in the operational authorisation issued to the operator;
set out in the standard scenario that the operator has declared will be used;
set out in the LUC.
The regulations also introduce transitional arrangements that enable a UAS that does not comply with the new requirements to continue to be operated, but under a more restrictive set of requirements concerning flight near to people.
Overflight of people and property by manned aircraft
Prior to 2010, Permit to Fly manned aircraft, under the conditions of their permit, were not allowed to fly over congested areas. This was understood to have been put in place as the airworthiness of aircraft in this category were not considered to have been to an equivalent standard as aircraft with a Certificate of Airworthiness. In 2007, The Popular Flying Association made a recommendation to the CAA asking for the restriction to be removed. The recommendation was supported by a safety case that showed Permit to Fly aircraft were not a higher risk than Certificate of Airworthiness aircraft.
In July 2010, CAA exemption (E3175) was issued to allow certain permit aircraft (microlight aeroplanes, amateur-built aeroplanes up to 1,500 kg, and factory-built aeroplanes up to 1,500 kg that were previously on a Certificate of Airworthiness) to overfly congested areas, subject to the normal rules of the air. These rules included retaining the capability of a single engine aircraft to glide clear and maintain minimum clearances with obstacles. The exemption did not apply when test flying or check-flying the aircraft. In February 2012, the exemption was superseded by Information Notice IN-2012/003 which made the arrangement permanent.
Risk of injury due to falling objects
The AAIB is not aware of any research relating to the potential for injury from a falling UAS. However, in the 1990’s a dropped object prevention scheme (DROPS) was introduced as part of a safety initiative by the UK Oil and Gas industry. The program has since expanded to include about 200 organisations, with the development of a DROPS analysis tool. This tool provides an indication as to the possible23 outcome of a blunt object in free fall striking a person wearing personal protective equipment (i.e hard hat, eye protection).
Analysis using the DROPS calculator24 indicated that a blunt object with a mass of 4.97 kg (the mass of the accident aircraft) falling from a height of more than about 3 m (~10 ft) agl could result in a fatal injury to someone wearing a hard hat. It also indicated that a 1 kg blunt object could cause a fatal injury from a height of 11 m.
The rules introduced by DR 2019/945 and IR 2019/947 for the open category state that aircraft able to impart 80 joules of kinetic energy shall not be operated intentionally over ‘uninvolved people’. The kinetic energy of the accident aircraft in free fall from about 3 m (10 ft) would be about 140 joules. A Matrice 200 series aircraft in free fall from a height of 50 m (164 ft) would take about three seconds before it reached the ground. At its maximum takeoff mass, which was 6.14 kg, the aircraft would have a kinetic energy of approximately 3,000 joules when it reached the ground. Reducing this height to 30 m (~100 ft), it would take about 2.5 seconds for the aircraft to reach the ground and impart about 1,800 joules.
Operation of UAS over persons
The ANO allows a UA with a mass of up to 20 kg to be flown over assemblies of up to 1,000 people as long as the aircraft maintains a height of at least 50 m. UA’s such as the DJI Matrice 200 series rely upon their propulsion system for lift. If propulsion is lost, aircraft of this type typically fall vertically to the ground. From a height of 50 m, the descent would take about three seconds, which would provide limited time for a pilot to warn people and for them to take avoiding action if possible. The risk of injury to a person on the ground if struck by a falling UA is high, with the DROPS analysis indicating that a UA with a mass of only a few kg falling from a height of just several metres could result in a serious or even fatal injury.
In accordance with the ANO, a person must not ‘permit an aircraft to endanger any person’ and may only fly the aircraft ‘if reasonably satisfied that the flight can safely be made’. It is therefore up to the operator or remote pilot to decide if flying a UA over people will endanger them. However, there is no guidance available from the CAA on how to make that assessment. This could include consideration of standards of safety, reliability, UA mass and type, the operational environment and whether any secondary safety systems are fitted.
IR (EU) 2019/947 is due to come into force in July 2020 and will require that a UA operating in the open category with a mass of more than 250 grams must not be flown over ‘uninvolved persons’. If operating a UA in the specific category, the operator will need to comply with mitigating safety actions to prevent injury to people. However, these actions are not due to be published by the EC until 2021 which leaves an unresolved hazard prior to publication. The following Safety Recommendation is therefore made:
Safety Recommendation 2020-002
It is recommended that the Civil Aviation Authority specify the conditions that must be met for an unmanned aircraft to be flown safely over people.
Reported Cause
Analysis
Failure of DJI Matrice 210 SUA at Temple Newsam
The manufacturer stated that the accident had been caused by the failure of the No 4 ESC, but no information was made available as to why this component had failed. When the No 4 ESC had failed, a No 3 ESC ‘link down’ message was also recorded. The manufacturer did not confirm what this message meant, or if this ESC had also failed.
Subsequent inspection of the aircraft found that moisture had entered the No 3 ESC chamber and residue was present on the ESC circuit board. No evidence of moisture was found on the other ESC’s. Since owning the aircraft from new, the pilot had followed the manufacturer’s guidelines to prevent moisture entering the aircraft and during the accident the No 3 motor arm had remained intact. It is therefore more likely that the moisture entered the No 3 ESC chamber during the last three minutes of the accident flight when the rainfall increased rather than during previous operation or following the accident.
The lower section of the ESC chambers adjacent to the antennas were not sealed and this could have provided an entry path for rainwater. The IP 43 accreditation testing was also not performed with the propellers installed and so it is possible that these tests did not fully reflect in-service operation in rain. It is also possible that rainwater entered the unit due to rainfall exceeding the manufacturer’s limitation of 10 mm/h or that the IP 43 protection had degraded over time.
Although it was not confirmed if moisture ingress caused this accident, information shows that other Matrice 200 series accidents have been caused by moisture entering the aircraft. The manufacturer’s analysis also showed that 27% of accidents were attributed to a loss of propeller motor propulsion that were for reasons other than a fault with the ESC. The manufacturer did not provide guidance on ascertaining if the rainfall exceeded limitations, or the duration that the IP 43 protection may remain in place. It is therefore possible that pilots of the Matrice 200 series could operate the aircraft in rain without knowing that it could result in the loss of control of the aircraft due to moisture ingress. The following Safety Recommendation is therefore made:
Safety Recommendation 2020-001
It is recommended that the Civil Aviation Authority notify users of the DJI Matrice 200 series of the possibility of moisture entering the aircraft when operating in rain and that this could result in a sudden loss of control of the aircraft.
Conclusion
The DJI Matrice 210 crashed whilst operating in rain. The manufacturer stated that the accident had been caused by a fault with the No 4 motor ESC. Moisture was also found on the No 3 motor ESC, but it was not established if this contributed to the accident. However, information showed that other Matrice 200 series accidents involving aircraft operating in rain had been caused by ESC failures due to moisture ingress. Other types of DJI Matrice 200 series failures included contamination of the motors by fine particles that the IP43 rating did not provide protection against.
Failures of the Matrice 200 series aircraft resulted in a loss of power and control, with the aircraft typically falling vertically to the ground. This poses a risk of injury to people on the ground which is not mitigated by the current UK regulations or the published guidance material. To address this, two Safety Recommendations have been made to the CAA.