owenisas commited on
Commit
b493d6c
·
verified ·
1 Parent(s): 68da4a5

Clean up optimization status metadata

Browse files
Files changed (2) hide show
  1. README.md +3 -2
  2. app.py +0 -1
README.md CHANGED
@@ -62,8 +62,9 @@ ZeroGPU runtime.
62
  - Repeated runs with the same selected model reuse the loaded model inside the
63
  ZeroGPU worker when the worker stays warm. Run metadata includes `cache_hit`
64
  and `load_elapsed_s` so this is visible.
65
- - Successful gated-repo access checks are cached briefly per token digest and
66
- repo ID to avoid a Hugging Face `HEAD` request on every generation.
 
67
  - The `stable-audio-3-optimized` repo currently provides MLX, ONNX, and
68
  TensorRT assets. This Space keeps the portable PyTorch path because the
69
  TensorRT engines are prebuilt for `sm_90`, while the current ZeroGPU host is
 
62
  - Repeated runs with the same selected model reuse the loaded model inside the
63
  ZeroGPU worker when the worker stays warm. Run metadata includes `cache_hit`
64
  and `load_elapsed_s` so this is visible.
65
+ - Successful gated-repo access checks are cached briefly inside the worker per
66
+ token digest and repo ID to avoid a Hugging Face `HEAD` request on every
67
+ generation.
68
  - The `stable-audio-3-optimized` repo currently provides MLX, ONNX, and
69
  TensorRT assets. This Space keeps the portable PyTorch path because the
70
  TensorRT engines are prebuilt for `sm_90`, while the current ZeroGPU host is
app.py CHANGED
@@ -737,7 +737,6 @@ def runtime_status(
737
  "hf_api_token_present": bool(hf_api_token_value(hf_api_token)),
738
  "loaded_generation_model": MODEL_CACHE["key"],
739
  "loaded_autoencoder": AE_CACHE["key"],
740
- "access_cache_entries": len(ACCESS_CACHE),
741
  }
742
 
743
 
 
737
  "hf_api_token_present": bool(hf_api_token_value(hf_api_token)),
738
  "loaded_generation_model": MODEL_CACHE["key"],
739
  "loaded_autoencoder": AE_CACHE["key"],
 
740
  }
741
 
742