Create AYON project hierarchy via CSV

lucas_pz · 28 April 2025 01:04

Thank you for your suggestion.

We are still validating which workflow will make more sense for our VFX pipeline, since it requires a CSV-like list to create the project hierarchy in our project management tool. Because of that I was considering sending this file to CSV ingest as well to optimise, but indeed that might be more trouble than its worth it, so now we are leaning towards rendering individual clips as you suggested.

mustafa_jafar · 28 April 2025 09:16

Keep in mind that CSV used with ingestion is not the same as the CSV-like list to create the project hierarchy.

Here’s an example CSV
https://help.ayon.app/articles/5385780-working-with-ayon-tray-publisher#50w25d7zxr5

Yul · 30 April 2025 11:52

Hi Mustafa,

The link you provided (CSV ingest) allows to ingest files, but I think it cannot be used to only add folders (or tasks) to the logical project hierarchy (as you already said).

There is also that PR which will allow to create the starting logical hierarchy (EDIT : I was wrong, in fact it creates folders on disk) :

github.com/ynput/ayon-core

Add simple Create Project Structure web action

ynput:develop ← ynput:enhancement/web_action_action_to_create_folder_structure

opened 01:09PM - 13 Mar 25 UTC

MustafaJafar

+100 -1

## Changelog Description resolve #914 A simple Create Project Structure web ac…tion that creates the folder structure as defined in project settings: `ayon+settings://core/project_folder_structure` ![image](https://github.com/user-attachments/assets/87443fe2-14ed-47de-9a32-f2363649d1cf) ![image](https://github.com/ynput/ayon-core/assets/2439881/3031741d-a536-44ec-9a21-531fd2c31fe3) ## Testing notes: 1. Update core addon 2. Test CLI action via, it should create folders as per settings. ```shell ayon_console.exe createprojectstructure --project <project_name> ``` 3. Run the web action action, it's found on any folder in the project on the web UI, it should create folders as per settings.

.

But is there an already available way to add a list of assets (and ideally tasks) to the project hierarchy, without having to provide a file for each folder / task ?
It would be useful when producers say “ok, now we know the list of assets we will need to create for client, add their names to Ayon’s hierarchy”.

Airplane : modeling, animation, etc…
Train : modeling, animation, etc…
etc…

mustafa_jafar · 30 April 2025 16:55

From on top of my head, I can’t remember if there’s a publish process that can be used for creating folders and tasks solely as most of them are associated with editorial publishing.
However, Can a simple python code do this trick for you?
Here’s a snippet that creates project hierarchy, Maybe one can extend it on their end to parse a CSV

github.com/MustafaJafar/ayon-recipes

create_project_hierarchy_with_folders_tasks.py

8a277149b

""" Create Project Hierarchy with Folders and Tasks.

This example code creates a project hierarchy with a list of assets and tasks if they don't already exist.

Created hierarchy:
```
{project_name}
    └── My Assets
            ├── Asset 1 
            |     ├── Modeling
            |     └── Lookdev
            ├── .
            ├── .
            └── Asset_100
                ├── Modeling
                └── Lookdev
```

Note 1: You'll always have access to the IDs of the entities in the mentioned project structure. If an entity is queried and doesn't exist, it will be created.

This file has been truncated. show original

mustafa_jafar · 30 April 2025 17:00

As far as I know that PR creates additional work directires that maybe managed outside of AYON. e.g. a storage folder for any random files and artists may access such locations via environment variables.

Yul · 30 April 2025 17:32

You are right about that PR, I have edited my message above.

And thanks for the snippet that creates project hierarchy.
I wasn’t searching for a “publish” process to do it.
I somewhat recall someone speaking about a way to do this using the web GUI and some settings to create templates.
Found it, that’s scheduled for a future enhancement of the Overview :

github.com/ynput/ayon-core

AY-5076_Ayon: Folder creation

opened 03:12PM - 24 Sep 24 UTC

ynbot

duplicate sponsored

### Please describe the feature you have in mind and explain what the current sh…ortcomings are? we need the ability to create folders for production, similar we have for track if implemented as webaction should/could this be a separate addon? ### How would you imagine the implementation of the feature? _No response_ ### Describe alternatives you've considered: _No response_ ### Additional context: () _(might be a private channel)_ _This issue was automatically created from Clickup ticket [AY-5076](https://app.clickup.com/t/86bycu87z)_

mustafa_jafar · 2 May 2025 22:36

Some of the addons mentioned on the pricing page are in alpha phase (available on demand for subscribers).

Batch Publisher (Batch Ingest Tools): It allows multiple products publishing and it tries to guess final product type either by configured mapping for regular expression match in file path or extenstion.

Didn’t test it myself yet but I don’t think it requires any csv files.

Yul · 3 May 2025 12:31

Thanks Mustafa ! So it’s also a way to ingest products.

mustafa_jafar · 5 May 2025 09:44

As far as I know, It is built mainly for that purpose.

mustafa_jafar · 6 May 2025 08:07

For information, we have this request on feedback about allowing creating and exporting project hierarchies via CSV.
https://feedback.ayon.app/p/csv-roundtrip