Skip to content
This repository was archived by the owner on Jul 22, 2024. It is now read-only.

Commit 5af2a1a

Browse files
committed
updates to fuse
1 parent f635e96 commit 5af2a1a

File tree

5 files changed

+16
-7
lines changed

5 files changed

+16
-7
lines changed
90.4 KB
Loading

workshop/Lab5/README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -46,15 +46,15 @@ The IBM Cloud Object Storage (COS) offers a few features that help secure your d
4646
- General Data Protection Regulation (GDPR) ready,
4747
- Privacy shield certified.
4848

49-
At a high level, information on IBM Cloud Object Storage (COS) is encrypted, then dispersed across multiple geographic locations, and accessed over popular protocols like HTTP with a RESTful API.
49+
At a high level, information on `IBM Cloud Object Storage (COS)` is encrypted, then dispersed across multiple geographic locations, and accessed over popular protocols like HTTP with a RESTful API.
5050

51-
SecureSlice distributes the data in slices across geo locations so that no full copy of data exists on any individual storage node, and automatically encrypts each segment of data before it is erasure coded and dispersed.
51+
`SecureSlice` distributes the data in slices across geo locations so that no full copy of data exists on any individual storage node, and automatically encrypts each segment of data before it is erasure coded and dispersed.
5252

53-
The content can only be re-assembled through IBM Cloud’s `Accesser` technology at the client’s primary data center, where the data was originally received, and decrypted again by SecureSlice.
53+
The content can only be re-assembled through IBM Cloud’s `Accesser` technology at the client’s primary data center, where the data was originally received, and decrypted again by `SecureSlice`.
5454

5555
`Data-in-place` or `data-at-rest` security is ensured when you persist database contents in IBM Cloud Object Storage.
5656

57-
You also have a choice to use integration capabilities with IBM Cloud Key Management Services like IBM Key Protect (using FIPS 140-2 Level 3 certified hardware security modules (HSMs)) and Hyper Protect Crypto Services (built on FIPS 140-2 Level 4-certified hardware) for enhanced security features and compliance.
57+
You also have a choice to use integration capabilities with IBM Cloud Key Management Services like `IBM Key Protect` (using FIPS 140-2 Level 3 certified hardware security modules (HSMs)) and `Hyper Protect Crypto Services` (built on FIPS 140-2 Level 4-certified hardware) for enhanced security features and compliance.
5858

5959
## About IBM Cloud Object Storage Plugin
6060

workshop/Lab5/cos-with-s3fs/IBMC-S3FS.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,12 @@
11
# IBM Cloud Object Storage plugin
22

3-
[IBM Cloud Object Storage plug-in](https://github.com/IBM/ibmcloud-object-storage-plugin/blob/master/README.md) is a Kubernetes Volume plug-in that enables Kubernetes pods to access IBM Cloud Object Storage buckets. The plug-in has two components: a dynamic provisioner and a FlexVolume driver for mounting the buckets using `s3fs-fuse` on a worker node. You can read more about Filesystems for User Spaces (FUSE) and `s3fs-fuse` in the [s3fs-fuse lab](../fuse/README.md).
3+
[IBM Cloud Object Storage plug-in](https://github.com/IBM/ibmcloud-object-storage-plugin/blob/master/README.md) is a Kubernetes Volume plug-in that enables Kubernetes pods to access IBM Cloud Object Storage buckets.
4+
5+
The plug-in has two components:
6+
1. a dynamic provisioner (Object Storage Bucket Provisioner), and
7+
2. a FlexVolume driver (Kube FlexDriver) for mounting the buckets using `s3fs-fuse` on a worker node. You can read more about Filesystems for User Spaces (FUSE) and `s3fs-fuse` in the [s3fs-fuse lab](../fuse/README.md).
8+
9+
![IBM Cloud Object Storage plugin architecture](../../.gitbook/ibmcos-plugin-arch.png)
410

511
See: https://medium.com/ai-platforms-research/fundamentals-of-ibm-cloud-storage-solutions-8739f36f024e
612

workshop/fuse/README.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,11 +4,13 @@
44

55
[Filesystem in Userspace (FUSE)](https://en.wikipedia.org/wiki/Filesystem_in_Userspace) lets non-privileged users create a file system in their user space. The FUSE project consists of two components: a FUSE kernel module that is part of the Linux kernel since version 2.6.14, and the `libfuse` userspace library. The [`libfuse` library](https://github.com/libfuse/libfuse) provides a reference implementation for communication with the FUSE kernel module, providing client functions to mount the file system, unmount it, read requests from the kernel, and send responses back. FUSE is particularly useful for writing Virtual File Systems (VFS).
66

7+
![FUSE architecture](images/fuse-arch.png)
8+
79
### s3fs
810

9-
`s3fs` or `s3fs-fuse` is an Amazon S3 (Services Simple Storage) and S3-based object stores compatible FUSE filesystem disk management utility that supports a subset of [Single UNIX Specification (SUS)](https://en.wikipedia.org/wiki/Single_UNIX_Specification) or [POSIX](https://en.wikipedia.org/wiki/POSIX) including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes, while preserving the original file format, e.g. a plain text or MS Word document
11+
If you want to use Object Storage as the underlying storage for FUSE-based filesystem disk management, you can use [`s3fs` or `s3fs-fuse`](https://github.com/s3fs-fuse/s3fs-fuse). `s3fs` is an Amazon S3 (Services Simple Storage) and S3-based object stores compatible utility for FUSE-based filesystem disk management that supports a subset of [Single UNIX Specification (SUS)](https://en.wikipedia.org/wiki/Single_UNIX_Specification) or [POSIX](https://en.wikipedia.org/wiki/POSIX) including reading/writing files, directories, symlinks, mode, uid/gid, and extended attributes, while preserving the original file format, e.g. a plain text or MS Word document.
1012

11-
Applications that need to read and write to an NFS-style filesystem can use s3fs. It with easily integrates applications with S3 compatible storage like [IBM Cloud Object Storage](https://cloud.ibm.com/docs/cloud-object-storage). s3fs also allows you to interact with your cloud storage using familiar shell commands, like `ls` for listing or `cp` to copy files.
13+
Applications that need to read and write to an NFS-style filesystem can use s3fs, which integrates applications with S3 compatible storage like [IBM Cloud Object Storage](https://cloud.ibm.com/docs/cloud-object-storage). s3fs also allows you to interact with your cloud storage using familiar shell commands, like `ls` for listing or `cp` to copy files.
1214

1315
Performance is not equal to a true local filesystem, but you can use some advanced options to increase throughput. Object storage services have high-latency for time to first byte and lack `random write` access (requires rewriting the full object). Workloads that only read big files, like deep learning workloads, can achieve good throughput using s3fs.
1416

@@ -71,6 +73,7 @@ Successfully uploaded object 'helloworld.txt' to bucket 'e59a327194-cos-1-bucket
7173
### Install s3fs
7274

7375
Install `s3fs`,
76+
7477
```
7578
brew install s3fs
7679
```

workshop/fuse/images/fuse-arch.png

43.6 KB
Loading

0 commit comments

Comments
 (0)