Enqueue sweep to launch queue

W&B Help
1

Hi Wandb,
I have an existing job in a wandb project which I want to create a sweep with and enqueue that sweep to an existing Launch queue.

This is my current script with my sweep config removed:

sweep_config = {
    'method': 'random',
    'metric':{
        'name':
        'goal': 
    },
    'program': 
    'run_cap': 
    'parameters':{
    }
}

#initilaize wandb sweep
sweep_id = wandb.sweep(sweep=sweep_config, project="my_project")

#push sweep to launch queue
sweep_job = launch_add(job="my_user/my_project/job_name:latest", sweep_id=sweep_id, queue_name="my_queue")

When running this script I’m not returned any errors in the terminal. However, from my launch queue page on the wandb site, I see the following Stack Trace error: raise LaunchError( wandb.sdk.launch.errors.LaunchError: Launch agent picked up sweep job, but sweep (sweep id removed) was in a terminal state (PENDING)

I’m not sure if I’m incorrectly using the launch_add command or if there’s an entirely better/different way to go about my goal.

Please let me know if there’s anything you need clarified. Thanks for the help!

2

Hi @19kdc3 Good day and thank you for reaching out to us. Happy to help you on this!

I am thinking if the sweep has been sent to the queue already which is why the the stack trace error states that it is already on PENDING state. Are you seeing this error for other sweep IDs as well?

I want to know if the sweeps are still in PENDING state as of now. Is it possible to check this and let me know? For the meantime, I am sharing some quick link here that provide some information for best practices when using Launch. I hope this could help.

3

Hi @paulo-sabile! Thanks for helping me with this.

I’m not sure what would be sending it to a queue already since my understanding is that the launch_add function does that. Yes, this error occurs for any sweep created with this script and I’ve run it multiple times.

I let the sweeps sit in the pending state after showing the error for ~30 mins and nothing changes. Correct me if I’m wrong, but I assumed that once I get the stack trace error the launch_add function is terminated.

Thanks for forwarding that link. I’ve read through it already and am following those practices.

4

Hi @19kdc3 Thanks for confirming this. Are you still able to reproduce this issue when running your script? If yes, could you please share us the debug-internal.log and debug.log for the affected run? These files are under your local folder wandb/run-<date>_<time>-<run-id>/logs in the same directory where you’re running your code. These files will help us with more details about this error.

Thanks,
Paulo

5

Hi @19kdc3 , since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!

6

Hi @paulo-sabile sorry for the delay. I’d like to re-open the conversation.

Yes, I can consistently reproduce the problem. Here are the files you asked for:

debug.log

2024-07-25 11:11:53,547 INFO    MainThread:37688 [wandb_setup.py:_flush():76] Current SDK version is 0.16.1
2024-07-25 11:11:53,547 INFO    MainThread:37688 [wandb_setup.py:_flush():76] Configure stats pid to 37688
2024-07-25 11:11:53,547 INFO    MainThread:37688 [wandb_setup.py:_flush():76] Loading settings from C:\Users\user\.config\wandb\settings
2024-07-25 11:11:53,547 INFO    MainThread:37688 [wandb_setup.py:_flush():76] Loading settings from C:\Users\user\Documents\test_launch\wandb\settings
2024-07-25 11:11:53,547 INFO    MainThread:37688 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
2024-07-25 11:11:53,547 INFO    MainThread:37688 [wandb_setup.py:_flush():76] Applying setup settings: {'_cli_only_mode': True}
2024-07-25 11:11:53,547 INFO    MainThread:37688 [wandb_init.py:_log_setup():524] Logging user logs to C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\logs\debug.log
2024-07-25 11:11:53,548 INFO    MainThread:37688 [wandb_init.py:_log_setup():525] Logging internal logs to C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\logs\debug-internal.log
2024-07-25 11:11:53,548 INFO    MainThread:37688 [wandb_init.py:init():564] calling init triggers
2024-07-25 11:11:53,548 INFO    MainThread:37688 [wandb_init.py:init():571] wandb.init called with sweep_config: {}
config: {}
2024-07-25 11:11:53,548 INFO    MainThread:37688 [wandb_init.py:init():614] starting backend
2024-07-25 11:11:53,548 INFO    MainThread:37688 [wandb_init.py:init():618] setting up manager
2024-07-25 11:11:53,632 INFO    MainThread:37688 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=spawn, using: spawn
2024-07-25 11:11:53,634 INFO    MainThread:37688 [wandb_init.py:init():624] backend started and connected
2024-07-25 11:11:53,808 INFO    MainThread:37688 [wandb_init.py:init():716] updated telemetry
2024-07-25 11:11:53,808 INFO    MainThread:37688 [wandb_init.py:init():749] communicating run to backend with 90.0 second timeout
2024-07-25 11:11:54,899 INFO    MainThread:37688 [wandb_run.py:_on_init():2254] communicating current version
2024-07-25 11:11:55,014 INFO    MainThread:37688 [wandb_run.py:_on_init():2263] got version response upgrade_message: "wandb version 0.17.5 is available!  To upgrade, please run:\n $ pip install wandb --upgrade"

2024-07-25 11:11:55,014 INFO    MainThread:37688 [wandb_init.py:init():800] starting run threads in backend
2024-07-25 11:11:57,186 INFO    MainThread:37688 [wandb_run.py:_console_start():2233] atexit reg
2024-07-25 11:11:57,186 INFO    MainThread:37688 [wandb_run.py:_redirect():2088] redirect: wrap_raw
2024-07-25 11:11:57,187 INFO    MainThread:37688 [wandb_run.py:_redirect():2153] Wrapping output streams.
2024-07-25 11:11:57,187 INFO    MainThread:37688 [wandb_run.py:_redirect():2178] Redirects installed.
2024-07-25 11:11:57,187 INFO    MainThread:37688 [wandb_init.py:init():841] run started, returning control to user process
2024-07-25 11:11:57,188 INFO    MainThread:37688 [agent.py:print_status():316] agent 4al61k84 polling on queues test_queue, running 0 out of a maximum of 1 jobs
2024-07-25 11:12:07,450 INFO    MainThread:37688 [agent.py:print_status():316] agent 4al61k84 polling on queues test_queue, running 0 out of a maximum of 1 jobs
2024-07-25 11:12:27,747 INFO    MainThread:37688 [agent.py:print_status():316] agent 4al61k84 polling on queues test_queue, running 0 out of a maximum of 1 jobs
2024-07-25 11:12:39,874 INFO    MainThread:37688 [agent.py:run_job():455] e[35mlaunch:e[0m Launch agent received job:
{'runQueueItemId': 'UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==',
 'runSpec': {'_wandb_job_collection_id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjE4MzM1NjYxNg==',
             'author': 'my_author',
             'docker': {},
             'entity': 'my_author',
             'git': {},
             'job': 'my_author/test_3/job_run:latest',
             'overrides': {},
             'project': 'test_3',
             'resource': 'local-container',
             'resource_args': {'local-container': {'gpus': 'all'}},
             'sweep_id': 'gyi233zv'}}

2024-07-25 11:12:39,939 INFO    MainThread:37688 [agent.py:run_job():460] Parsing launch spec
2024-07-25 11:12:40,130 INFO    MainThread:37688 [agent.py:print_status():316] agent 4al61k84 running 1 out of a maximum of 1 jobs: UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==
2024-07-25 11:13:00,425 INFO    MainThread:37688 [agent.py:print_status():316] agent 4al61k84 polling on queues test_queue, running 0 out of a maximum of 1 jobs
2024-07-25 11:13:20,696 INFO    MainThread:37688 [agent.py:print_status():316] agent 4al61k84 polling on queues test_queue, running 0 out of a maximum of 1 jobs
7

debug-internal.log (pt. 1)

2024-07-25 11:11:53,633 INFO    StreamThr :30948 [internal.py:wandb_internal():86] W&B internal server running at pid: 30948, started at: 2024-07-25 11:11:53.633273
2024-07-25 11:11:53,634 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status
2024-07-25 11:11:53,808 INFO    WriterThread:30948 [datastore.py:open_for_write():85] open: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\run-4al61k84.wandb
2024-07-25 11:11:53,809 DEBUG   SenderThread:30948 [sender.py:send():382] send: header
2024-07-25 11:11:53,809 DEBUG   SenderThread:30948 [sender.py:send():382] send: run
2024-07-25 11:11:54,761 INFO    SenderThread:30948 [dir_watcher.py:__init__():211] watching files in: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files
2024-07-25 11:11:54,761 INFO    SenderThread:30948 [sender.py:_start_run_threads():1136] run started: 4al61k84 with start time 1721920313.634634
2024-07-25 11:11:54,900 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: check_version
2024-07-25 11:11:54,900 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: check_version
2024-07-25 11:11:55,099 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: run_start
2024-07-25 11:11:55,125 DEBUG   HandlerThread:30948 [system_info.py:__init__():32] System info init
2024-07-25 11:11:55,125 DEBUG   HandlerThread:30948 [system_info.py:__init__():47] System info init done
2024-07-25 11:11:55,125 INFO    HandlerThread:30948 [system_monitor.py:start():194] Starting system monitor
2024-07-25 11:11:55,126 INFO    SystemMonitor:30948 [system_monitor.py:_start():158] Starting system asset monitoring threads
2024-07-25 11:11:55,126 INFO    HandlerThread:30948 [system_monitor.py:probe():214] Collecting system info
2024-07-25 11:11:55,131 INFO    SystemMonitor:30948 [interfaces.py:start():190] Started cpu monitoring
2024-07-25 11:11:55,131 INFO    SystemMonitor:30948 [interfaces.py:start():190] Started disk monitoring
2024-07-25 11:11:55,132 INFO    SystemMonitor:30948 [interfaces.py:start():190] Started gpu monitoring
2024-07-25 11:11:55,140 INFO    SystemMonitor:30948 [interfaces.py:start():190] Started memory monitoring
2024-07-25 11:11:55,152 INFO    SystemMonitor:30948 [interfaces.py:start():190] Started network monitoring
2024-07-25 11:11:55,156 DEBUG   HandlerThread:30948 [system_info.py:probe():196] Probing system
2024-07-25 11:11:55,156 DEBUG   HandlerThread:30948 [system_info.py:probe():244] Probing system done
2024-07-25 11:11:55,156 DEBUG   HandlerThread:30948 [system_monitor.py:probe():223] {'os': 'Windows-10-10.0.22631-SP0', 'python': '3.8.12', 'heartbeatAt': '2024-07-25T15:11:55.156418', 'startedAt': '2024-07-25T15:11:53.545060', 'docker': None, 'cuda': None, 'args': ('launch-agent', '-c', 'launch-config.yaml'), 'state': 'running', 'host': 'user-PC', 'username': 'user', 'executable': 'C:\\Users\\user\\miniconda3\\envs\\thesis\\python.exe', 'cpu_count': 16, 'cpu_count_logical': 24, 'cpu_freq': {'current': 3200.0, 'min': 0.0, 'max': 3200.0}, 'cpu_freq_per_core': [{'current': 3200.0, 'min': 0.0, 'max': 3200.0}], 'disk': {'/': {'total': 1862.1513633728027, 'used': 665.261646270752}}, 'gpu': 'NVIDIA GeForce RTX 2070 SUPER', 'gpu_count': 1, 'gpu_devices': [{'name': 'NVIDIA GeForce RTX 2070 SUPER', 'memory_total': 8589934592}], 'memory': {'total': 63.74732208251953}}
2024-07-25 11:11:55,157 INFO    HandlerThread:30948 [system_monitor.py:probe():224] Finished collecting system info
2024-07-25 11:11:55,157 INFO    HandlerThread:30948 [system_monitor.py:probe():227] Publishing system info
2024-07-25 11:11:55,157 DEBUG   HandlerThread:30948 [system_info.py:_save_pip():52] Saving list of pip packages installed into the current environment
2024-07-25 11:11:55,157 DEBUG   HandlerThread:30948 [system_info.py:_save_pip():68] Saving pip packages done
2024-07-25 11:11:55,157 DEBUG   HandlerThread:30948 [system_info.py:_save_conda():75] Saving list of conda packages installed into the current environment
2024-07-25 11:11:55,765 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\requirements.txt
2024-07-25 11:11:55,765 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\conda-environment.yaml
2024-07-25 11:11:57,160 DEBUG   HandlerThread:30948 [system_info.py:_save_conda():87] Saving conda packages done
2024-07-25 11:11:57,160 DEBUG   HandlerThread:30948 [system_info.py:_save_code():90] Saving code
2024-07-25 11:11:57,160 WARNING HandlerThread:30948 [system_info.py:_save_code():92] unable to save code -- program entry not found
2024-07-25 11:11:57,161 DEBUG   HandlerThread:30948 [gitlib.py:_init_repo():56] git repository is invalid
2024-07-25 11:11:57,161 INFO    HandlerThread:30948 [system_monitor.py:probe():229] Finished publishing system info
2024-07-25 11:11:57,185 DEBUG   SenderThread:30948 [sender.py:send():382] send: files
2024-07-25 11:11:57,185 INFO    SenderThread:30948 [sender.py:_save_file():1392] saving file wandb-metadata.json with policy now
2024-07-25 11:11:57,186 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:11:57,186 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:11:57,187 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:11:57,531 INFO    wandb-upload_0:30948 [upload_job.py:push():131] Uploaded file C:\Users\user\AppData\Local\Temp\tmp241eiw9fwandb\o5knkw4a-wandb-metadata.json
2024-07-25 11:11:57,607 DEBUG   SenderThread:30948 [sender.py:send():382] send: telemetry
2024-07-25 11:11:57,776 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\conda-environment.yaml
2024-07-25 11:11:57,776 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\wandb-metadata.json
2024-07-25 11:11:57,776 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:11:59,639 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:11:59,796 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:12:04,667 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:09,840 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:12:10,466 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:12,182 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:12:12,182 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:12:12,198 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:12:16,259 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:21,298 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:26,357 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:26,992 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\config.yaml
2024-07-25 11:12:27,180 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:12:27,180 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:12:27,210 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:12:30,036 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:12:31,785 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:36,817 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:40,265 DEBUG   SenderThread:30948 [sender.py:send():382] send: telemetry
2024-07-25 11:12:40,267 DEBUG   SenderThread:30948 [sender.py:send():382] send: files
2024-07-25 11:12:40,267 INFO    SenderThread:30948 [sender.py:_save_file():1392] saving file UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==\error\error.log with policy now
2024-07-25 11:12:40,513 INFO    wandb-upload_0:30948 [upload_job.py:push():131] Uploaded file C:\Users\user\AppData\Local\Temp\tmp241eiw9fwandb\pzj2bq1r-UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==/error/error.log
2024-07-25 11:12:41,142 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==\error\error.log
2024-07-25 11:12:41,143 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==
2024-07-25 11:12:41,143 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==\error
2024-07-25 11:12:42,142 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:12:42,191 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:12:42,193 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:12:42,223 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:12:42,352 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:47,405 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:52,443 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:55,163 DEBUG   SystemMonitor:30948 [system_monitor.py:_start():172] Starting system metrics aggregation loop
2024-07-25 11:12:55,169 DEBUG   SenderThread:30948 [sender.py:send():382] send: stats
2024-07-25 11:12:57,214 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:12:57,216 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:12:57,242 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:12:58,413 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:12:59,322 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\config.yaml
2024-07-25 11:13:02,351 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:13:04,457 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:09,495 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:12,218 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:13:12,219 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:13:12,251 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:13:15,400 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:20,425 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:22,643 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:13:25,181 DEBUG   SenderThread:30948 [sender.py:send():382] send: stats
2024-07-25 11:13:26,186 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:27,232 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:13:27,232 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:13:27,264 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:13:31,413 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:36,450 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:41,975 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:42,240 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:13:42,240 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:13:42,256 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:13:42,861 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:13:47,358 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:52,406 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:13:55,195 DEBUG   SenderThread:30948 [sender.py:send():382] send: stats
2024-07-25 11:13:57,264 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:13:57,264 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:13:57,265 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:13:57,409 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:03,089 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:14:03,308 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:08,363 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:12,266 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:14:12,266 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:14:12,266 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:14:14,341 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:19,389 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:23,311 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:14:24,592 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:25,201 DEBUG   SenderThread:30948 [sender.py:send():382] send: stats
2024-07-25 11:14:27,273 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:14:27,288 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:14:27,289 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:14:30,475 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:35,538 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:40,573 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:42,291 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:14:42,307 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:14:42,308 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:14:42,508 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:14:46,478 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:51,505 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:55,209 DEBUG   SenderThread:30948 [sender.py:send():382] send: stats
2024-07-25 11:14:57,221 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:14:57,299 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:14:57,315 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:14:57,315 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:15:02,721 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:15:03,200 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:15:08,252 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:15:12,315 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
8

debug-internal.log (pt. 2)

2024-07-25 11:15:12,330 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: stop_status
2024-07-25 11:15:12,331 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: stop_status
2024-07-25 11:15:13,470 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:15:18,531 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:15:22,572 DEBUG   SenderThread:30948 [sender.py:send():382] send: exit
2024-07-25 11:15:22,572 INFO    SenderThread:30948 [sender.py:send_exit():589] handling exit code: 1
2024-07-25 11:15:22,572 INFO    SenderThread:30948 [sender.py:send_exit():591] handling runtime: 207
2024-07-25 11:15:22,572 INFO    SenderThread:30948 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
2024-07-25 11:15:22,573 INFO    SenderThread:30948 [sender.py:send_exit():597] send defer
2024-07-25 11:15:22,573 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,573 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 0
2024-07-25 11:15:22,573 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,573 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 0
2024-07-25 11:15:22,573 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 1
2024-07-25 11:15:22,573 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,573 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 1
2024-07-25 11:15:22,574 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,574 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 1
2024-07-25 11:15:22,574 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 2
2024-07-25 11:15:22,574 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,574 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 2
2024-07-25 11:15:22,574 INFO    HandlerThread:30948 [system_monitor.py:finish():203] Stopping system monitor
2024-07-25 11:15:22,574 DEBUG   SystemMonitor:30948 [system_monitor.py:_start():179] Finished system metrics aggregation loop
2024-07-25 11:15:22,581 DEBUG   SystemMonitor:30948 [system_monitor.py:_start():183] Publishing last batch of metrics
2024-07-25 11:15:22,581 INFO    HandlerThread:30948 [interfaces.py:finish():202] Joined cpu monitor
2024-07-25 11:15:22,582 INFO    HandlerThread:30948 [interfaces.py:finish():202] Joined disk monitor
2024-07-25 11:15:22,631 INFO    HandlerThread:30948 [interfaces.py:finish():202] Joined gpu monitor
2024-07-25 11:15:22,631 INFO    HandlerThread:30948 [interfaces.py:finish():202] Joined memory monitor
2024-07-25 11:15:22,631 INFO    HandlerThread:30948 [interfaces.py:finish():202] Joined network monitor
2024-07-25 11:15:22,632 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,632 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 2
2024-07-25 11:15:22,632 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 3
2024-07-25 11:15:22,632 DEBUG   SenderThread:30948 [sender.py:send():382] send: stats
2024-07-25 11:15:22,632 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,632 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 3
2024-07-25 11:15:22,632 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,632 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 3
2024-07-25 11:15:22,632 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 4
2024-07-25 11:15:22,633 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,633 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 4
2024-07-25 11:15:22,633 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,633 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 4
2024-07-25 11:15:22,633 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 5
2024-07-25 11:15:22,633 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,633 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 5
2024-07-25 11:15:22,633 DEBUG   SenderThread:30948 [sender.py:send():382] send: summary
2024-07-25 11:15:22,633 INFO    SenderThread:30948 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end
2024-07-25 11:15:22,634 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,634 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 5
2024-07-25 11:15:22,634 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 6
2024-07-25 11:15:22,634 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,634 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 6
2024-07-25 11:15:22,634 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,634 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 6
2024-07-25 11:15:22,634 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 7
2024-07-25 11:15:22,634 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: status_report
2024-07-25 11:15:22,634 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:22,634 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 7
2024-07-25 11:15:22,634 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:22,634 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 7
2024-07-25 11:15:22,944 INFO    Thread-16 :30948 [dir_watcher.py:_on_file_created():271] file/dir created: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\wandb-summary.json
2024-07-25 11:15:23,585 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: poll_exit
2024-07-25 11:15:24,628 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 8
2024-07-25 11:15:24,628 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: poll_exit
2024-07-25 11:15:24,628 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:24,629 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 8
2024-07-25 11:15:24,629 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:24,629 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 8
2024-07-25 11:15:24,629 INFO    SenderThread:30948 [job_builder.py:build():298] Attempting to build job artifact
2024-07-25 11:15:24,629 INFO    SenderThread:30948 [job_builder.py:_get_source_type():439] no source found
2024-07-25 11:15:24,629 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 9
2024-07-25 11:15:24,629 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:24,629 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 9
2024-07-25 11:15:24,630 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:24,630 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 9
2024-07-25 11:15:24,630 INFO    SenderThread:30948 [dir_watcher.py:finish():358] shutting down directory watcher
2024-07-25 11:15:24,978 INFO    SenderThread:30948 [dir_watcher.py:_on_file_modified():288] file/dir modified: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:15:24,979 INFO    SenderThread:30948 [dir_watcher.py:finish():388] scan: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files
2024-07-25 11:15:24,979 INFO    SenderThread:30948 [dir_watcher.py:finish():402] scan save: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\conda-environment.yaml conda-environment.yaml
2024-07-25 11:15:24,980 INFO    SenderThread:30948 [dir_watcher.py:finish():402] scan save: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\config.yaml config.yaml
2024-07-25 11:15:24,983 INFO    SenderThread:30948 [dir_watcher.py:finish():402] scan save: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log output.log
2024-07-25 11:15:24,985 INFO    SenderThread:30948 [dir_watcher.py:finish():402] scan save: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\requirements.txt requirements.txt
2024-07-25 11:15:24,986 INFO    SenderThread:30948 [dir_watcher.py:finish():402] scan save: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\wandb-metadata.json wandb-metadata.json
2024-07-25 11:15:24,988 INFO    SenderThread:30948 [dir_watcher.py:finish():402] scan save: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\wandb-summary.json wandb-summary.json
2024-07-25 11:15:24,992 INFO    SenderThread:30948 [dir_watcher.py:finish():402] scan save: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==\error\error.log UnVuUXVldWVJdGVtOjU3OTk2NDMxOA==/error/error.log
2024-07-25 11:15:24,992 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 10
2024-07-25 11:15:24,993 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:24,993 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 10
2024-07-25 11:15:24,993 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:24,993 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 10
2024-07-25 11:15:24,993 INFO    SenderThread:30948 [file_pusher.py:finish():175] shutting down file pusher
2024-07-25 11:15:25,240 INFO    wandb-upload_1:30948 [upload_job.py:push():131] Uploaded file C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\config.yaml
2024-07-25 11:15:25,242 INFO    wandb-upload_0:30948 [upload_job.py:push():131] Uploaded file C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\conda-environment.yaml
2024-07-25 11:15:25,304 INFO    wandb-upload_3:30948 [upload_job.py:push():131] Uploaded file C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\requirements.txt
2024-07-25 11:15:25,305 INFO    wandb-upload_2:30948 [upload_job.py:push():131] Uploaded file C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\output.log
2024-07-25 11:15:25,320 INFO    wandb-upload_4:30948 [upload_job.py:push():131] Uploaded file C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\files\wandb-summary.json
2024-07-25 11:15:25,537 INFO    Thread-15 :30948 [sender.py:transition_state():617] send defer: 11
2024-07-25 11:15:25,538 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:25,538 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 11
2024-07-25 11:15:25,539 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:25,539 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 11
2024-07-25 11:15:25,539 INFO    SenderThread:30948 [file_pusher.py:join():181] waiting for file pusher
2024-07-25 11:15:25,539 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 12
2024-07-25 11:15:25,539 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:25,539 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 12
2024-07-25 11:15:25,540 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:25,540 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 12
2024-07-25 11:15:25,540 INFO    SenderThread:30948 [file_stream.py:finish():595] file stream finish called
2024-07-25 11:15:25,757 INFO    SenderThread:30948 [file_stream.py:finish():599] file stream finish is done
2024-07-25 11:15:25,757 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 13
2024-07-25 11:15:25,757 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:25,757 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 13
2024-07-25 11:15:25,758 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:25,758 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 13
2024-07-25 11:15:25,758 INFO    SenderThread:30948 [sender.py:transition_state():617] send defer: 14
2024-07-25 11:15:25,758 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: defer
2024-07-25 11:15:25,758 DEBUG   SenderThread:30948 [sender.py:send():382] send: final
2024-07-25 11:15:25,758 INFO    HandlerThread:30948 [handler.py:handle_request_defer():172] handle defer: 14
2024-07-25 11:15:25,758 DEBUG   SenderThread:30948 [sender.py:send():382] send: footer
2024-07-25 11:15:25,759 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: defer
2024-07-25 11:15:25,759 INFO    SenderThread:30948 [sender.py:send_request_defer():613] handle sender defer: 14
2024-07-25 11:15:25,759 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: poll_exit
2024-07-25 11:15:25,759 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: server_info
2024-07-25 11:15:25,759 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: get_summary
2024-07-25 11:15:25,759 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: poll_exit
2024-07-25 11:15:25,759 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: sampled_history
2024-07-25 11:15:25,759 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: server_info
2024-07-25 11:15:25,760 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: internal_messages
2024-07-25 11:15:25,761 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: job_info
2024-07-25 11:15:25,808 DEBUG   SenderThread:30948 [sender.py:send_request():409] send_request: job_info
2024-07-25 11:15:25,808 DEBUG   HandlerThread:30948 [handler.py:handle_request():146] handle_request: shutdown
2024-07-25 11:15:25,809 INFO    HandlerThread:30948 [handler.py:finish():866] shutting down handler
2024-07-25 11:15:26,772 INFO    WriterThread:30948 [datastore.py:close():294] close: C:\Users\user\Documents\test_launch\wandb\run-20240725_111153-4al61k84\run-4al61k84.wandb
2024-07-25 11:15:26,819 INFO    SenderThread:30948 [sender.py:finish():1548] shutting down sender
2024-07-25 11:15:26,819 INFO    SenderThread:30948 [file_pusher.py:finish():175] shutting down file pusher
2024-07-25 11:15:26,819 INFO    SenderThread:30948 [file_pusher.py:join():181] waiting for file pusher
9

Hi @19kdc3 Thank you for sharing those logs. I would like to refer you to this Docs page about Sweeps on Launch and please review the attached Colab notebook example in that page.

You will have to launch the sweep as:
! wandb launch-sweep sweep-config.yaml -e $ENTITY -p $PROJECT -q $QUEUE

Let us know if this helps!

Thanks,
Paulo

10

Hi @paulo-sabile, thank you for linking that Docs page. I think the last (bonus) example is what I’m looking for which is a to create the sweep and enqueue it all from a single python file. I’ll comment back here should that example not work as expected. Thanks!

11

Hi @19kdc3 , since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!