'Firebase Device Test lab: Failed to create a test matrix

I want tot try out firebase device testing - but i get a really generic error message doing so:

Failed to create a test matrix.

Anyone knows how to get around this? Quota should not be the problem - the button I press says "Start 2 tests" I already removed some devices in case it is quota. Unfortunately googling for the error does not really lead to a result..

enter image description here



Solution 1:[1]

Ahmed here from the Firebase Test Lab team.

The issue happens when you exceed the quota for the day. There have been two issues on the Test Lab side contributing to the confusion here:

  1. The message shown is confusing and it's hard to understand what's going on
  2. To enforce this daily quota on usage, we require to have the API enabled on your project. We needed to have the API enabled on all Firebase projects. When we launched, we had the following in place (i) All new projects have the API enabled by default and (ii) All existing Firebase Test Lab users had the API backfilled. The issue happens when you have created a Firebase project in the past (before October 1st 2016) and never used Test Lab then went back to use it afterwards.

Issue (1) is still ongoing and we're currently working on making our error messages more informative. Stay tuned!

Issue (2) is now resolved completely. We've backfilled all the Firebase projects that were ever created with the Test Lab APIs.

You should now expect seeing this issue only in cases where you exceed the daily quota till we provide a better error message.

Thanks so much and apologies for the confusion!

Solution 2:[2]

Sorry for the confusion. We are improving this error message moving forward.

The problem is that you don't have the Google Cloud Testing API enabled for your project. Please can you do that?

Or just create a new project for which it will be automatically enabled.

Solution 3:[3]

Go here https://console.developers.google.com/apis/api/testing.googleapis.com/overview

select the project that you are using to run tests with Test Lab, and click "Enable".

Solution 4:[4]

I had exactly the same problem and I check all the suggested solutions, like give admin rights, enable the testing API and it didn't work.

Lastly, I tried creating the tests from Android Studio. From Android Studio, go to Tools menu, then Firebase. I just followed the assistant and voilĂ , tests are running now!.

Solution 5:[5]

If I upload an AAB file I will get this message but it works when using an APK.

Solution 6:[6]

I went to https://console.firebase.google.com/iam-admin/iam/iam-zero Selected my project and edited myself to be admin of everything (app engine,big query, cloud debugger)

Solution 7:[7]

It depends of the payment plan that you have chosen. I have chosen the payment plan as Spark and I am able to test for 1 TEST at a time with the Test matrix getting generated successfully.

Solution 8:[8]

I had the same problem and the reason for the error message was in my case that I took an apk from Firebase App Distribution.

When I created the apk in Intellij / Android Studio and uploaded this one it worked.

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1
Solution 2 Justin Broughton
Solution 3 Michael Lawrence
Solution 4
Solution 5 Jerry Sha
Solution 6 Viktor Peovski
Solution 7 Niveditha Kabbur
Solution 8 luckyhandler