Local mirror of artifacts

Hi
Is there an api to maintain a local mirror for artifacts?

This way the artifact is downloaded only once (till it’s remote update :slight_smile:

For example:

artifact.download(mirror_dir=XXX)
or
run.use(artifact, mirror_dir=XXX)

Thanks

Hi Chen, can you elaborate more on your question? Is this mirror for wandb offline? What is the use case for this feature?

Hi there, I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

Hi Chen, I’m going to close this ticket, but please respond to this thread if you want me to open it up again.

Hi Leslie

Sorry, was OOO and missed your messages …

The scenario is as ffolows:

  • An atrtifact is generated and uploaded to wandb

  • Later, one wants to use this artifact

  • So he has to download it

– However if someone is using the same artifact 100 times on the same machine, it’ll be much more efficient to download it once to the machine.

  • So first download should be saved locally for example in mirror_dir .

  • Then, next 99 times the artifact will be taken from mirror_dir instead of re-downloading it 99 times,

Is the need more clear now?

Thanks

That helps a lot thank you! We actually have a ticket to create a local mirror and I’ll respond here whenever it is finished.