firebase-test - SKILL.md Agent Skill

name: firebase-test description: Run Firebase Test Lab Robo test for Pockr APK, download logcat results, and analyse findings. Use when user asks to run firebase test, check test results, download logcat, or analyse a test run. tools: Bash, Read, Grep

Firebase Test Skill — Pockr

Directory Layout

~/Desktop/MAIN/kalvin/testcase_and_creds/
  service-account-key.json       # GCP service account (never commit)
  test-results/
    logcat_v<N>.txt              # downloaded logcats, one per APK version
    2026-<date>_firebase*/       # raw GCS result folders (downloaded manually)
    v<N>/                        # older named result folders
    *.png                        # screenshots from Robo crawler

APK to test: build/pockr-release.apk (built by ./scripts/build_apk.sh release)

Step 1 — Build (if needed)

./scripts/build_apk.sh release
# Output: build/pockr-release.apk (~177 MB)

Step 2 — Run Firebase Test

./scripts/firebase_test.sh <your-gcp-project> Pixel2.arm 30

Credentials: ~/Desktop/MAIN/kalvin/testcase_and_creds/service-account-key.json
Device: Pixel2.arm — ARM64, Android 11 (API 30)
Timeout: 600s
Type: Robo (automated UI crawler)

The command prints a GCS bucket path and a Firebase Console URL when the test starts. Save the GCS run path — you need it for logcat download.

Step 3 — Download Logcat

After the test finishes, download the logcat using the GCS path printed during the run:

docker run --rm \
  --platform linux/amd64 \
  -v "$HOME/Desktop/MAIN/kalvin/testcase_and_creds/service-account-key.json:/creds.json:ro" \
  -v "$HOME/Desktop/MAIN/kalvin/testcase_and_creds/test-results:/out" \
  gcr.io/google.com/cloudsdktool/google-cloud-cli:stable \
  bash -c '
gcloud auth activate-service-account --key-file=/creds.json --quiet 2>/dev/null
gsutil cp "gs://<your-gcs-bucket>/<run-id>/Pixel2.arm-30-en-portrait/logcat" /out/logcat_v<N>.txt
echo "Done"
'

Replace <your-gcs-bucket>, <run-id>, and <N> with the actual values from the test output.

Save logcats as logcat_v<N>.txt where N is the APK version number.

Step 4 — Analyse Results

Filter logcat for Pockr app lines only:

grep -E "D VmManager|I VmManager|W VmManager|E VmManager|D VmService|I VmService|W VmService|E VmService|D VmApiClient|I VmApiClient|W VmApiClient|E VmApiClient" \
  ~/Desktop/MAIN/kalvin/testcase_and_creds/test-results/logcat_v<N>.txt

Key events to look for

Log line	Meaning
`VmManager: Starting VM...`	VM launch triggered by user/Robo
`VmManager: Assets not ready, extracting...`	Fresh install — first boot
`VmManager: Extracted vm/base.qcow2`	Asset extraction OK
`VmManager: QEMU command: ...`	QEMU launched (check args)
`VmManager: VM process launched`	QEMU running
`VmApiClient: Health check failed: timeout`	VM killed before API was ready (first boot slow)
`VmApiClient: Health check failed: Connection reset`	Alpine still booting — expected during startup
`VmApiClient: Container started: <name>`	Container successfully started — core flow working
`VmManager: VM stopped`	VM shut down cleanly
`VmManager: QEMU output reader closed`	Normal on stop

Common issues

Symptom	Cause	Fix
`Health check failed: timeout` on first boot	Alpine first-boot bootstrap takes ~2.5 min, health check kills at 35s	VM restarts and works on second attempt; increase health check timeout
`Health check failed: Connection reset`	Alpine still booting — not an error	Wait; API comes up within ~2.5 min
`Failed to connect to /127.0.0.1:7080`	VM not running	Normal after VM is stopped
No `Container started` line	Container pull/run never triggered	Check if Robo crawler reached Containers screen
`type 'double' is not a subtype of type 'int?'`	MethodChannel numeric cast	Cast via `(result['x'] as num?)?.toInt()`

Pass/Fail Criteria

Firebase outcome: Passed = no crash, Robo completed crawl
Functional: look for VmApiClient: Container started: — confirms VM + Docker + API all working end-to-end

Logcat Naming Convention

Always name saved logcats logcat_v<N>.txt matching the APK version number so they correlate with MEMORY.md pass/fail history.

Credential Security

service-account-key.json lives only at ~/Desktop/MAIN/kalvin/testcase_and_creds/ — never inside the repo
.gitignore covers service-account*.json and service_account*.json
Never git add anything from testcase_and_creds/