# What are the files under "artifact/" for each run? **URL:** \ **Category:** W&B Help\ **Tags:** artifacts\ **Created:** [May 22, 2023, 6:34am UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438 "2023-05-22T06:34:22Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![atinybrewery](https://avatars.discourse-cdn.com/v4/letter/a/4491bb/32.png) [@atinybrewery](https://community.wandb.ai/u/atinybrewery)\ **Post date:** [May 22, 2023, 6:34am UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/1 "2023-05-22T06:34:22Z")
In an effort to comply with the 100GB storage limits, I have been looking closely at the “usage” page (`https://wandb.ai/usage/your-username-here`), and indexing, then deleting files using the [export API](https://docs.wandb.ai/ref/python/public-api/). There is sometimes a significant discrepancy between the runs size reported by `https://wandb.ai/usage/your-username-here/your-project-here/runs` VS `https://wandb.ai/usage/your-username-here/your-project-here/runs/your-run-here`. There is a set of files that are returned when using [Run.files()](https://docs.wandb.ai/ref/python/public-api/run#files) call, but they are invisible when looking at the run on the web dashboard (I suspect they are the cause of that size report discrepancy). In the extreme case of some of my runs, they are json files, with paths starting with `artifact/`, and they number in the **tens of thousands** : e.g.: ```auto artifact/142190504/wandb_manifest.json artifact/142190516/wandb_manifest.json artifact/142190533/wandb_manifest.json artifact/142190533/wandb_manifest.json.deadlist artifact/142190544/wandb_manifest.json artifact/142190544/wandb_manifest.json.deadlist ``` These files obviously relate to artifacts, but the artifacts themselves are queried through [Run. logged\_artifacts()](https://docs.wandb.ai/ref/python/public-api/run#logged_artifacts). I have been deleting artifacts in my past runs, keeping only less than 400 per run (these are very small artifacts), and I have been expecting the count of these “manifest” files to go down, But it instead seemed to have created additional `.deadlist` files… My questions are: 1. What are these files? 2. Are they important? 3. What can I expect to happen if I manually delete them through the export API? 4. Are they counted towards the 100GB limit? ---
**Author:** ![raphael-sanandres](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@raphael-sanandres](https://community.wandb.ai/u/raphael-sanandres)\ **Post date:** [May 24, 2023, 9:06pm UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/2 "2023-05-24T21:06:05Z")
Hello! Firstly, could you describe the significant discrepancy between, preferably with screenshots? And to confirm some things so that I can reproduce this myself: 1. You are deleting the artifacts via `run.logged_artifacts()` then using `.delete()` these artifacts 2. These artifacts are of old runs and so all runs are finished when deleting these artifacts. As for the `wandb_manifest.json`, this is our file that we use to store data about the artifact. For example, if the same file is uploaded twice under different artifacts, then we will not have you upload it twice and have it reference the other file. This is done via the `wandb_manifest.json`. As for the `.deadlist` that is showing up, that should be a temporary file that is generated while the manifests are being deleted. As for the affect of deleting this file, it is important to keep these since we rely on this manifest when using Weave functions and when referencing the Artifact in other parts of the code. Since these files are generated per artifact, they are not normally a significant amount of data that is stored. However, if you have many runs that each create its own artifact, this manifest will be created within each one. I will have to check if the manifest gets included in this calculation. ---
**Author:** ![atinybrewery](https://avatars.discourse-cdn.com/v4/letter/a/4491bb/32.png) [@atinybrewery](https://community.wandb.ai/u/atinybrewery)\ **Post date:** [May 29, 2023, 2:47am UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/3 "2023-05-29T02:47:23Z")
Thanks for your attention to this issue! Here are the screenshots that show the discrepancy. As you can see, The overall run storage size is listed as 9.4GB, but when clicking into the run and seeing the breakdown, the overall size becomes 3.3GB. Note that those `artifacts/` files are not visible in the breakdown. ![Overall run storage size](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/2X/0/041055954cd4b6cd694e0a1db4123b0f6fb3f629.png) ![Breakdown of run storage size](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/2X/f/f0768115142f26a3fe4e3d860858399c631f8ada.png) Regarding what you wanted to confirm: > [@raphael-sanandres](#): > > - You are deleting the artifacts via `run.logged_artifacts()` then using `.delete()` these artifacts > - These artifacts are of old runs and so all runs are finished when deleting these artifacts. 1. Yes 2. Yes Thanks for the insight in the role of the files. If the `.deadlist` files are meant to be temporary, can I expect them to disappear on their own over time? Note that in the run I show in the screenshots, there are almost as many `.deadlist` files as there are `wandb_manifest.json`, at the count of around 30,000 each (working from memory for the count). ---
**Author:** ![raphael-sanandres](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@raphael-sanandres](https://community.wandb.ai/u/raphael-sanandres)\ **Post date:** [June 2, 2023, 6:02pm UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/4 "2023-06-02T18:02:01Z")
Hello! After looking around, there are two reasons that this could be happening: 1. If you are deleting many artifacts all at once, we could still be processing the deletion and the storage will be update after some time 2. There is a bug when deleting the last known artifact programmatically, the size of the artifact still remains as the last known file despite being deleted I have also been informed that anything uploaded as part of the Artifact will be counted in the storage however, deleting the manifest will likely render the artifact unusable. Could you send me a link to one of your workspaces/projects so I can dive into it a little more? ---
**Author:** ![atinybrewery](https://avatars.discourse-cdn.com/v4/letter/a/4491bb/32.png) [@atinybrewery](https://community.wandb.ai/u/atinybrewery)\ **Post date:** [June 5, 2023, 6:31am UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/5 "2023-06-05T06:31:36Z")
Sure! Please check out the following run as an example (I’m including both the link to the run workspace and the run as shown in Usage): > **[usage](https://wandb.ai/usage/atinybrewery/LipSync/runs/guillaume_2022-06-22_10-24-19)** > > Weights & Biases, developer tools for machine learning > **[atinybrewery](https://wandb.ai/atinybrewery/LipSync/runs/guillaume_2022-06-22_10-24-19/files?workspace=user-atinybrewery)** > > Weights & Biases, developer tools for machine learning ---
**Author:** ![raphael-sanandres](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@raphael-sanandres](https://community.wandb.ai/u/raphael-sanandres)\ **Post date:** [June 12, 2023, 7:52pm UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/6 "2023-06-12T19:52:03Z")
Hello! After a bit of time it looks like that your Usage has decreased, which looks like it could have maybe been us processing the deletion. As for the storage, I would say to look at the larger box which contains the storage as the true value of how much storage is in `wandb` (as shown with my storage below). ![image](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/2X/b/bb3706461853f7a55a4dae001556ec40b1bfc718.png) ---
**Author:** ![atinybrewery](https://avatars.discourse-cdn.com/v4/letter/a/4491bb/32.png) [@atinybrewery](https://community.wandb.ai/u/atinybrewery)\ **Post date:** [June 20, 2023, 2:36am UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/7 "2023-06-20T02:36:37Z")
Hi, I originally had some doubts on your statement since the size of my pruned runs were still bigger than I’d hoped, but after accounting for the various files remaining inside, it seems that the storage add up correctly now, and the contribution of the `.deadlist` files, if any, are negligible. Guess I’ll just have to prune my runs even harsher then. Thank you for your clarification! ---
**Author:** ![system](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/1X/366b649231631dbab896843020da0056074ac79d.png) [@system](https://community.wandb.ai/u/system)\ **Post date:** [August 19, 2023, 2:37am UTC](https://community.wandb.ai/t/what-are-the-files-under-artifact-for-each-run/4438/8 "2023-08-19T02:37:38Z")
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.