Launch Docker Container Fails Req Install

W&B Help
,
1

Hey all,

Really excited to use launch to re run jobs that i have using ‘ray’ to then compare with sweeps! Keen to be able to run this as a launch dockerfile but the requirements install fails on openai pkg. Im not sure why its pulling old cache packages when i have a hard defined version requirement in the requirements.txt from the succesful previous job im referencing for my launch? Any ideas?

openai==0.27.8

Log of failed build from job

#11 44.61   Preparing metadata (pyproject.toml): finished with status 'done'
#11 44.64   Downloading openai-0.15.0.tar.gz (40 kB)
#11 44.64      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.9/40.9 kB 22.2 MB/s eta 0:00:00
#11 44.66   Preparing metadata (setup.py): started
#11 44.79   Preparing metadata (setup.py): finished with status 'done'
#11 44.94   Downloading openai-0.14.0.tar.gz (40 kB)
#11 44.95      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.7/40.7 kB 14.8 MB/s eta 0:00:00
#11 44.96   Preparing metadata (setup.py): started
#11 45.10   Preparing metadata (setup.py): finished with status 'done'
#11 45.12   Downloading openai-0.13.0.tar.gz (37 kB)
#11 45.14   Preparing metadata (setup.py): started
#11 45.28   Preparing metadata (setup.py): finished with status 'done'
#11 45.30   Downloading openai-0.12.0.tar.gz (36 kB)
#11 45.32   Preparing metadata (setup.py): started
#11 45.46   Preparing metadata (setup.py): finished with status 'done'
#11 45.49   Downloading openai-0.11.6.tar.gz (33 kB)
#11 45.50   Preparing metadata (setup.py): started
#11 45.64   Preparing metadata (setup.py): finished with status 'done'
#11 45.66   Downloading openai-0.11.5.tar.gz (466 kB)
#11 45.67      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 466.8/466.8 kB 91.6 MB/s eta 0:00:00
#11 45.70   Preparing metadata (setup.py): started
#11 45.83   Preparing metadata (setup.py): finished with status 'done'
#11 45.86   Downloading openai-0.11.4.tar.gz (152 kB)
#11 45.86      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 152.7/152.7 kB 55.7 MB/s eta 0:00:00
#11 45.88   Preparing metadata (setup.py): started
#11 46.01   Preparing metadata (setup.py): finished with status 'done'
#11 46.04   Downloading openai-0.11.3.tar.gz (150 kB)
#11 46.05      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.0/151.0 kB 47.9 MB/s eta 0:00:00
#11 46.06   Preparing metadata (setup.py): started
#11 46.19   Preparing metadata (setup.py): finished with status 'done'
#11 46.22   Downloading openai-0.11.2.tar.gz (150 kB)
#11 46.23      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.0/151.0 kB 50.5 MB/s eta 0:00:00
#11 46.24   Preparing metadata (setup.py): started
#11 46.38   Preparing metadata (setup.py): finished with status 'done'
#11 46.40   Downloading openai-0.11.1.tar.gz (150 kB)
#11 46.41      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 150.6/150.6 kB 55.8 MB/s eta 0:00:00
#11 46.42   Preparing metadata (setup.py): started
#11 46.55   Preparing metadata (setup.py): finished with status 'done'
#11 46.58   Downloading openai-0.11.0.tar.gz (150 kB)
#11 46.58      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 150.6/150.6 kB 61.8 MB/s eta 0:00:00
#11 46.59   Preparing metadata (setup.py): started
#11 46.73   Preparing metadata (setup.py): finished with status 'done'
#11 46.76   Downloading openai-0.10.5.tar.gz (157 kB)
#11 46.77      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.3/157.3 kB 44.9 MB/s eta 0:00:00
#11 46.78   Preparing metadata (setup.py): started
#11 46.91   Preparing metadata (setup.py): finished with status 'done'
#11 46.94   Downloading openai-0.10.4.tar.gz (157 kB)
#11 46.94      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.3/157.3 kB 57.0 MB/s eta 0:00:00
#11 46.96   Preparing metadata (setup.py): started
#11 47.10   Preparing metadata (setup.py): finished with status 'done'
#11 47.12   Downloading openai-0.10.3.tar.gz (157 kB)
#11 47.13      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.0/157.0 kB 57.4 MB/s eta 0:00:00
#11 47.14   Preparing metadata (setup.py): started
#11 47.28   Preparing metadata (setup.py): finished with status 'done'
#11 47.31   Downloading openai-0.10.2.tar.gz (156 kB)
#11 47.31      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.7/156.7 kB 49.5 MB/s eta 0:00:00
#11 47.33   Preparing metadata (setup.py): started
#11 47.46   Preparing metadata (setup.py): finished with status 'done'
#11 47.49   Downloading openai-0.10.1.tar.gz (155 kB)
#11 47.49      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.0/156.0 kB 51.8 MB/s eta 0:00:00
#11 47.51   Preparing metadata (setup.py): started
#11 47.64   Preparing metadata (setup.py): finished with status 'done'
#11 47.67   Downloading openai-0.10.0.tar.gz (155 kB)
#11 47.68      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 kB 63.3 MB/s eta 0:00:00
#11 47.69   Preparing metadata (setup.py): started
#11 47.82   Preparing metadata (setup.py): finished with status 'done'
#11 47.85   Downloading openai-0.9.4.tar.gz (156 kB)
#11 47.86      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.1/156.1 kB 47.7 MB/s eta 0:00:00
#11 47.87   Preparing metadata (setup.py): started
#11 48.01   Preparing metadata (setup.py): finished with status 'done'
#11 48.03   Downloading openai-0.9.3.tar.gz (155 kB)
#11 48.04      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.0/156.0 kB 63.5 MB/s eta 0:00:00
#11 48.05   Preparing metadata (setup.py): started
#11 48.18   Preparing metadata (setup.py): finished with status 'done'
#11 48.22   Downloading openai-0.9.2.tar.gz (155 kB)
#11 48.22      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.9/155.9 kB 53.0 MB/s eta 0:00:00
#11 48.24   Preparing metadata (setup.py): started
#11 48.37   Preparing metadata (setup.py): finished with status 'done'
#11 48.40   Downloading openai-0.9.1.tar.gz (156 kB)
#11 48.41      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.0/156.0 kB 57.1 MB/s eta 0:00:00
#11 48.42   Preparing metadata (setup.py): started
#11 48.56   Preparing metadata (setup.py): finished with status 'done'
#11 48.58   Downloading openai-0.9.0.tar.gz (155 kB)
#11 48.59      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.9/155.9 kB 49.4 MB/s eta 0:00:00
#11 48.60   Preparing metadata (setup.py): started
#11 48.74   Preparing metadata (setup.py): finished with status 'done'
#11 48.77   Downloading openai-0.8.0.tar.gz (147 kB)
#11 48.78      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.6/147.6 kB 45.5 MB/s eta 0:00:00
#11 48.79   Preparing metadata (setup.py): started
#11 48.93   Preparing metadata (setup.py): finished with status 'done'
#11 48.95   Downloading openai-0.7.0.tar.gz (147 kB)
#11 48.96      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 147.4/147.4 kB 52.0 MB/s eta 0:00:00
#11 48.97   Preparing metadata (setup.py): started
#11 49.10   Preparing metadata (setup.py): finished with status 'done'
#11 49.13   Downloading openai-0.6.4.tar.gz (159 kB)
#11 49.13      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 159.6/159.6 kB 84.6 MB/s eta 0:00:00
#11 49.15   Preparing metadata (setup.py): started
#11 49.29   Preparing metadata (setup.py): finished with status 'done'
#11 49.32   Downloading openai-0.6.3.tar.gz (158 kB)
#11 49.32      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.1/158.1 kB 54.2 MB/s eta 0:00:00
#11 49.34   Preparing metadata (setup.py): started
#11 49.48   Preparing metadata (setup.py): finished with status 'done'
#11 49.50   Downloading openai-0.6.2.tar.gz (158 kB)
#11 49.51      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 159.0/159.0 kB 57.7 MB/s eta 0:00:00
#11 49.52   Preparing metadata (setup.py): started
#11 49.66   Preparing metadata (setup.py): finished with status 'done'
#11 49.69   Downloading openai-0.6.1.tar.gz (158 kB)
#11 49.70      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.9/158.9 kB 47.1 MB/s eta 0:00:00
#11 49.71   Preparing metadata (setup.py): started
#11 49.85   Preparing metadata (setup.py): finished with status 'done'
#11 49.88   Downloading openai-0.6.0.tar.gz (159 kB)
#11 49.88      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 159.3/159.3 kB 41.1 MB/s eta 0:00:00
#11 49.89   Preparing metadata (setup.py): started
#11 50.03   Preparing metadata (setup.py): finished with status 'done'
#11 50.06   Downloading openai-0.4.0.tar.gz (158 kB)
#11 50.06      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.4/158.4 kB 47.6 MB/s eta 0:00:00
#11 50.07   Preparing metadata (setup.py): started
#11 50.21   Preparing metadata (setup.py): finished with status 'done'
#11 50.39   Downloading openai-0.3.0.tar.gz (157 kB)
#11 50.40      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.9/157.9 kB 45.8 MB/s eta 0:00:00
#11 50.41   Preparing metadata (setup.py): started
#11 50.54   Preparing metadata (setup.py): finished with status 'done'
#11 50.57   Downloading openai-0.2.6.tar.gz (157 kB)
#11 50.57      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.6/157.6 kB 57.4 MB/s eta 0:00:00
#11 50.58   Preparing metadata (setup.py): started
#11 50.72   Preparing metadata (setup.py): finished with status 'done'
#11 50.75   Downloading openai-0.2.5.tar.gz (157 kB)
#11 50.75      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.5/157.5 kB 52.2 MB/s eta 0:00:00
#11 50.76   Preparing metadata (setup.py): started
#11 50.90   Preparing metadata (setup.py): finished with status 'done'
#11 50.92   Downloading openai-0.2.4.tar.gz (157 kB)
#11 50.93      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.1/157.1 kB 47.0 MB/s eta 0:00:00
#11 50.95   Preparing metadata (setup.py): started
#11 51.08   Preparing metadata (setup.py): finished with status 'done'
#11 51.11   Downloading openai-0.2.3.tar.gz (157 kB)
#11 51.11      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 157.1/157.1 kB 57.1 MB/s eta 0:00:00
#11 51.13   Preparing metadata (setup.py): started
#11 51.27   Preparing metadata (setup.py): finished with status 'done'
#11 51.29   Downloading openai-0.2.1.tar.gz (154 kB)
#11 51.30      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 154.8/154.8 kB 44.1 MB/s eta 0:00:00
#11 51.31   Preparing metadata (setup.py): started
#11 51.44   Preparing metadata (setup.py): finished with status 'done'
#11 51.47   Downloading openai-0.2.0.tar.gz (154 kB)
#11 51.48      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 154.8/154.8 kB 57.4 MB/s eta 0:00:00
#11 51.49   Preparing metadata (setup.py): started
#11 51.63   Preparing metadata (setup.py): finished with status 'done'
#11 51.65   Downloading openai-0.1.3.tar.gz (155 kB)
#11 51.66      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.6/155.6 kB 46.7 MB/s eta 0:00:00
#11 51.67   Preparing metadata (setup.py): started
#11 51.81   Preparing metadata (setup.py): finished with status 'done'
#11 51.83   Downloading openai-0.1.2.tar.gz (155 kB)
#11 51.84      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.6/155.6 kB 48.0 MB/s eta 0:00:00
#11 51.85   Preparing metadata (setup.py): started
#11 51.98   Preparing metadata (setup.py): finished with status 'done'
#11 52.01   Downloading openai-0.1.1.tar.gz (156 kB)
#11 52.01      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.1/156.1 kB 55.9 MB/s eta 0:00:00
#11 52.03   Preparing metadata (setup.py): started
#11 52.16   Preparing metadata (setup.py): finished with status 'done'
#11 52.19   Downloading openai-0.1.0.tar.gz (168 kB)
#11 52.19      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 168.5/168.5 kB 49.2 MB/s eta 0:00:00
#11 52.21   Preparing metadata (setup.py): started
#11 52.34   Preparing metadata (setup.py): finished with status 'done'
#11 52.37   Downloading openai-0.0.2.tar.gz (741 bytes)
#11 52.38   Preparing metadata (setup.py): started
#11 52.48   Preparing metadata (setup.py): finished with status 'error'
#11 52.49   error: subprocess-exited-with-error
#11 52.49
#11 52.49   × python setup.py egg_info did not run successfully.
#11 52.49   │ exit code: 1
#11 52.49   ╰─> [6 lines of output]
#11 52.49       Traceback (most recent call last):
#11 52.49         File "<string>", line 2, in <module>
#11 52.49         File "<pip-setuptools-caller>", line 34, in <module>
#11 52.49         File "/tmp/pip-install-hfon8yv0/openai_3af80dd17cf240dc9c1dbde1034eefba/setup.py", line 6, in <module>
#11 52.49           raise RuntimeError(
#11 52.49       RuntimeError: This package is a placeholder package on the public PyPI instance, and is not the correct version to install. If you are having trouble figuring out the correct package to install, please contact us.
#11 52.49       [end of output]
#11 52.49
#11 52.49   note: This error originates from a subprocess, and is likely not a problem with pip.
#11 52.49 error: metadata-generation-failed
#11 52.49
#11 52.49 × Encountered error while generating package metadata.
#11 52.49 ╰─> See above for output.
#11 52.49
#11 52.49 note: This is an issue with the package mentioned above, not pip.
#11 52.49 hint: See above for details.
#11 52.49
#11 52.49 [notice] A new release of pip is available: 23.0.1 -> 23.2
#11 52.49 [notice] To update, run: pip install --upgrade pip
#11 ERROR: process "/bin/sh -c pip install -r requirements.txt" did not complete successfully: exit code: 1
------
 > [build 4/4] RUN --mount=type=cache,mode=0777,target=/root/.cache/pip pip install -r requirements.txt:
52.49 error: metadata-generation-failed
52.49
52.49 × Encountered error while generating package metadata.
52.49 ╰─> See above for output.
52.49
52.49 note: This is an issue with the package mentioned above, not pip.
52.49 hint: See above for details.
52.49
52.49 [notice] A new release of pip is available: 23.0.1 -> 23.2
52.49 [notice] To update, run: pip install --upgrade pip
------
Dockerfile.wandb-autogenerated:12
--------------------
  10 |
  11 |     COPY src/requirements.txt ./
  12 | >>> RUN --mount=type=cache,mode=0777,target=/root/.cache/pip pip install -r requirements.txt```
2

Hey Eric, off the top of my head, I can’t figure out the source of this, but my initial thoughts are that there’s something within your environment that is overriding one of the packages in your requirements.txt file. What happens when you try to run this in a fresh environment?

Additionally, if you can send over the requirements.txt file, I’d love to take a look to help me dig into this further.

3

Hi Eric, since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!

4

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.