If I use W&B Artifacts with an S3 Reference, is there any easy way to get the underlying S3 URI?
artifact = run.use_artifact('my_artifact:latest') s3_path = artifact.<some_method>()
For context, I’m trying to train a HuggingFace model with Sagemaker. When I spin up the job, Sagemaker expects paths to local files or S3 URIs to the dataset. I’m trying to avoid downloading the data to my local machine, by getting the proper S3 URL via W&B Artifacts; since I’m already using Artifacts for data versioning.
Thank you in advance!