File Management Patterns

File Management Patterns can range in scope and complexity. Here are some file management patterns:

1. Public-access Internal File Store via Direct Access
2. Public-access Internal File Store via Caches/Proxies
3. Public-access Internal File Store via Cloud File Store
4. Public-access Internal File Store via Content Distribution Networks
5. Private-access Internal File Store via Direct Access
6. Private-access Internal File Store via via Cloud File Store

File Management Issues

1. Security
   • securing access to files is a challenge.
2. Performance
   • Vertical Scaling by scaling up using RAID, NDS.
3. Distributed File System
   • Mongo FS
   • Hadoop HDFS
   • Microsoft Distributed File System
4. Limitations
   • Filename Length limitations
   • Directory performance with a large number of files
5. Distribution
   • A file might generate alot of traffic. To address this, Horizontal Scaling via CDNs may be employed.

Related

• Distributed File Systems
• Mongo FS

Links

• http://en.wikipedia.org/wiki/Google_File_System