Local mirror of artifacts

[chen-brestel]

Hi
Is there an api to maintain a local mirror for artifacts?

This way the artifact is downloaded only once (till it’s remote update

For example:

artifact.download(mirror_dir=XXX)
or
run.use(artifact, mirror_dir=XXX)

Artifacts Walkthrough

Thanks

[lesliewandb]

Hi Chen, can you elaborate more on your question? Is this mirror for wandb offline? What is the use case for this feature?

[lesliewandb]

Hi there, I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

[lesliewandb]

Hi Chen, I’m going to close this ticket, but please respond to this thread if you want me to open it up again.

[chen-brestel]

Hi Leslie

Sorry, was OOO and missed your messages …

The scenario is as ffolows:

• An atrtifact is generated and uploaded to wandb

• Later, one wants to use this artifact

• So he has to download it

– However if someone is using the same artifact 100 times on the same machine, it’ll be much more efficient to download it once to the machine.

• So first download should be saved locally for example in mirror_dir .

• Then, next 99 times the artifact will be taken from mirror_dir instead of re-downloading it 99 times,

Is the need more clear now?

Thanks

[lesliewandb]

That helps a lot thank you! We actually have a ticket to create a local mirror and I’ll respond here whenever it is finished.