google-cloud-bigtable system tests are failing with ResourceExhausted

[parthea]

See the failure below where google-cloud-bigtable system tests are hitting a quota limit.

google.api_core.exceptions.ResourceExhausted: 429 Quota exceeded for quota metric 'Instance and cluster metadata write requests' and limit 'Instance and cluster metadata write requests per day' of service 'bigtableadmin.googleapis.com'

Regrettably, the quota limit is a system limit. As per https://docs.cloud.google.com/bigtable/quotas, System limits are fixed values that can't be changed.

In PR #18148, we temporarily disabled system tests for google-cloud-bigtable. This bug tracks restoring the system tests. In the meantime, we still have emulator tests running.

[parthea]

Gemini suggested this improvement to reduce the chance of hitting the limit in the future

Shift Lifecycle from Instance to Table:
Keep one persistent instance and create/drop tables per test (table write operations have a separate 5,000 ops/day quota, and truncating data rows has no admin limit).