TaskWeaver icon indicating copy to clipboard operation
TaskWeaver copied to clipboard

How to use Taskweaver online? re; project directory

Open antoineross opened this issue 1 year ago • 7 comments

I was wondering if it's possible to access the a cloud bucket storage instead of a local project directory is that possible?

Or is there another way to handle this?

Thank you in advance!

antoineross avatar Mar 07 '24 21:03 antoineross

Currently, we only support using the local file system. If the cloud storage could be mounted to the local file system, it would be no problem. Otherwise, we need to re-implement all the file i/o operations w.r.t a cloud storage, which need quite a lot of efforts.

liqul avatar Mar 08 '24 02:03 liqul

I believe this is exactly the reason why Taskweaver developers would expect MS could help to implement this. If they do it by themselves, it may take even longer time and each individual developer has to repeat the same thing. At the end of day, it's the end customer who would require the cloud storage and Taskweaver would be able to reach even more customers with this necessary feature. Hopefully this helps.

mirojs avatar Mar 12 '24 05:03 mirojs

I believe this is exactly the reason why Taskweaver developers would expect MS could help to implement this. If they do it by themselves, it may take even longer time and each individual developer has to repeat the same thing. At the end of day, it's the end customer who would require the cloud storage and Taskweaver would be able to reach even more customers with this necessary feature. Hopefully this helps.

You are right that we are trying to build the infrastructure to ease the development of agents. We shall put this in our backlog and would like to see more support on this. Given our resource constraint, we need to be very careful on what are we working on.

liqul avatar Mar 13 '24 02:03 liqul

Thanks.

mirojs avatar Mar 13 '24 11:03 mirojs

Hi I think I have a solution. Currently I am using a temp directory for the project directory, I just now need to make sure that every artifact generated or accessed by the LLM is through that temp directory.

I noticed that TaskWeaver stores file in quite specific areas. May I know where I can set these in the source code? I just need to be able to point them to the temp directory:

The values of variables of the above Python code after execution are:

time_series_map_20240306.png


The following artifacts were generated:
- type: image ; uri: file:///private/var/folders/jf/d3lxj_s12bv6xfgmxqxsjnd00000gn/T/tmpkfoo5mat/workspace/sessions/20240313-185034-99ad1708/cwd/post-20240313-185324-e8b62c34-display-1_image.png ; description: <Figure size 2400x1200 with 1 Axes>

antoineross avatar Mar 13 '24 19:03 antoineross

To anyone who wants to reproduce just use the Web UI and clone the project directory into a temp directory then pass that into the

app = TaskWeaverApp(app_dir=temp_project_path, use_local_uri=True)

antoineross avatar Mar 13 '24 19:03 antoineross

To anyone who wants to reproduce just use the Web UI and clone the project directory into a temp directory then pass that into the

app = TaskWeaverApp(app_dir=temp_project_path, use_local_uri=True)

You can place the project folder at any place assessable from the local file system.

liqul avatar Mar 14 '24 02:03 liqul