snippetMinor
How can I use S3 as a filesystem
Viewed 0 times
filesystemcanusehow
Problem
I'm not sure if it's something I'm doing wrong, or if the S3 web interface is just trash. There are a ton of basic capabilities that work in pretty much any other file storage product (Windows Explorer, Google Drive, OneDrive etc.), which don't work in S3:
Again, I'm not sure if there's something I'm doing wrong but I've never been able to get the above issues to work. It just blows my mind because these all seem like very simple, basic functions.
- The search string must be 100% exact--case-sensitive (if I search "myfile" and the file happens to be "MyFile", it won't find it), no wildcards or searching multiple words (if my file is something like "puppy-picture-2340987254309874345.jpg", I can't just search for "puppy picture" or even "puppy-picture-*.jpg", I have to already know the exact filename I'm looking for), etc.
- I can only download 1 item at a time?? If I select 1 object, the Download button is available but if I select a second object it's not. I don't think I've ever seen any file store site/product that won't allow you to download multiple files, it's one of the most basic capabilities.
- Can't rename directories.
Again, I'm not sure if there's something I'm doing wrong but I've never been able to get the above issues to work. It just blows my mind because these all seem like very simple, basic functions.
Solution
This was going to be a comment, but I'll add it as an answer and take the consequences.
Yes, you are doing it wrong. S3 is an object store. The things you are looking for (search, directories, etc) are for filesystems. You are asking a fish to climb a tree
You can mount S3 onto a filesystem, but it is not a filesystem.
If you want an object storage to do filesystem things, then mount it into a filesystem. See:
https://github.com/awslabs/mountpoint-s3/
However if you actually want a filesystem, why not use a filesystem:
https://aws.amazon.com/efs/
Yes, you are doing it wrong. S3 is an object store. The things you are looking for (search, directories, etc) are for filesystems. You are asking a fish to climb a tree
You can mount S3 onto a filesystem, but it is not a filesystem.
If you want an object storage to do filesystem things, then mount it into a filesystem. See:
https://github.com/awslabs/mountpoint-s3/
However if you actually want a filesystem, why not use a filesystem:
https://aws.amazon.com/efs/
Context
StackExchange DevOps Q#18282, answer score: 3
Revisions (0)
No revisions yet.