W&B Launch on Sagemaker using BYOI (Bring your own image)

W&B Help
, ,
1

I was able to get the Default W&B Launch to work using the following settings:

  • Queue config:
RoleArn: <arn:aws: ...>
ResourceConfig:
  InstanceType: ml.m4.xlarge
  InstanceCount: 1
  VolumeSizeInGB: 2
OutputDataConfig:
  S3OutputPath: <s3://...>
StoppingCondition:
  MaxRuntimeInSeconds: 3600
  • Job config:
create_job(
    path="https://github.com/celsofranssa/TeCBenchAPI.git",
    job_type="git",
    entity="entity",
    project="project",
    name="job",
    description="description",
    runtime="python3.8",
    entrypoint="main.py"
)
  • launch-config.yaml:
environment:
    type: aws
    region: us-east-2

registry:
    type: ecr
    repository: my-ecr-repository

However, the W&B agent could not create the docker image correctly.

Alternatively, we have the Bring your own image (BYOI) approach, in which I could not find any directions or examples to configure the W&B agent to use an image in ECR .

2

Hi @celsofranssa thanks for writing in! Could you please provide us with more information what was the issue with W&B agent. Regarding BYOI, have you checked the Configure the Launch agent section in our Docs? Would this help? Launch on SageMaker | Weights & Biases Documentation

3

Hi @celsofranssa just checking in here to see if you’ve tried following the section from the Docs page shared above? and if you could tell us more what errors you’ve encountered to help further? Thanks!

4

Actually, this documentation is not helping. Please, share the complete configuration to launch using my image on AWS ECR instead of letting the W&B Launch agent build one.

5

Hi @celsofranssa apologies for late reply here. I wanted to follow up and try to help you configure Launch on your end to use the image on AWS ECR. Would it be possible to share what steps you’ve followed so far, and why it won’t work for you to use your image? For sagemaker, as long as the image is something as ecr.io/ … and your SM instance can pull it, it should work.

6

Hi @celsofranssa just checking in here to see if you were able to use your image from ECR? Please let us know if your issue has been resolved or if we can be of further assistance. Thanks!

7

Hi @celsofranssa since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know and we will be happy to keep investigating!

8

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.