Skip to content
Back
Self Hosted

Understanding S3 setup with appwrite

Last activity
View on Discord

Votes

0

Replies

7

Participants

2

Messages

8

Ibaraki DoujiOriginal post

Rank 4: Virtual Machine

Hey, i'm planning to change the storage from local to S3, tho i have some questions to see before starting the migration.

  1. Does all the /storage/<storage_type> will be migrated to S3 ?
  2. How does the S3 path looks like ? is it like <bucket>/<storage_type>/<files> or something else ? (since the getDevice root is APP_STORAGE_UPLOADS = '/storage/uploads' could it be <bucket>/storage/<storage_type>/<files> ?)
  3. Do you use ACL requests ? since i'm planning to use garageHQ, they don't have ACL/Policies endpoints (see https://garagehq.deuxfleurs.fr/documentation/reference-manual/s3-compatibility/)
  4. Do you use public facing object ? or for public / get objects you use a presign ? as garage don't allow public access for now, but allow presign requests
Ibaraki Douji

Rank 4: Virtual Machine

also, i don't use minio because the opensource part is now deprecated, and they want us to use AlStor instead

Ibaraki Douji

Rank 4: Virtual Machine

Also looking at the executor i guess it's the same, just the envs are :

- OPR_EXECUTOR_STORAGE_DEVICE=$_APP_STORAGE_DEVICE - OPR_EXECUTOR_STORAGE_S3_ACCESS_KEY=$_APP_STORAGE_S3_ACCESS_KEY - OPR_EXECUTOR_STORAGE_S3_SECRET=$_APP_STORAGE_S3_SECRET - OPR_EXECUTOR_STORAGE_S3_REGION=$_APP_STORAGE_S3_REGION - OPR_EXECUTOR_STORAGE_S3_BUCKET=$_APP_STORAGE_S3_BUCKET - OPR_EXECUTOR_STORAGE_S3_ENDPOINT=$_APP_STORAGE_S3_ENDPOINT

and i also need to keep the /tmp volume for the runtimes to access the data from the executor if i'm not wrong

Ibaraki Douji

Rank 4: Virtual Machine

up

Ibaraki Douji

Rank 4: Virtual Machine

up ? it's basicly the last service to migrate on my cluster ...

D5
  1. If you mean that all the previous data will be moved from local to S3 automatically, nope
  2. Not sure, but it should be similar to the local volume.
  3. Afaik not, it just has full access.
  4. No, everything goes and is served through the Appwrite instance
Ibaraki Douji

Rank 4: Virtual Machine

thanks for your reply, for the first one i meant, does all the folders under the /storage path (basicly all shared volumes) need to be migrated to S3 ?

D5

If you have existing data yes.
Make sure to have a backup before proceeding

Join the discussion

Reply to this thread by joining our Discord.

Reply on Discord

Need support?_

Join DiscordGet premium support