sample stage writers and demo updates

Author: viragtripathi

README.md

@@ -3,7 +3,7 @@
 # Redis Connect (Continuous Replication and Initial Load to Redis Enterprise)
 
 - [Redis Connect Overview](#technical-overview)
-  * [Using redis-connect-cassandra](#connectors/cassandra#redis-connect-cassandra)
+  * [Using redis-connect-cassandra](connectors/cassandra#redis-connect-cassandra)
   * [Using redis-connect-db2](connectors/db2#redis-connect-db2)
   * [Using redis-connect-gemfire](connectors/gemfire#redis-connect-gemfire)
   * [Using redis-connect-mysql](connectors/mysql#redis-connect-mysql)

connectors/cassandra/README.md

@@ -106,6 +106,7 @@ Copy the _sample_ directory and it's contents i.e. _yml_ files, _mappers_ and te
 <p>
 
 #### logging configuration file.
+
 ### Sample logback.xml under redis-connect-gemfire/config folder
 ```xml
 <configuration debug="true" scan="true" scanPeriod="15 seconds">
@@ -276,7 +277,8 @@ metricsReporter:
 <details><summary>Configure JobConfig.yml</summary>
 <p>
 
-#### Job level details.
+#### Job level details. Please see [writers](../../docs/writers) for other write stage usages.
+
 ### Sample JobConfig.yml under redis-connect-gemfire/config/samples/gemfire2redis folder
 You can have one or more JobConfig.yml (or with any name e.g. JobConfig-<region_type>.yml) and specify them in the Setup.yml under jobConfig: tag. If specifying more than one table (as below) then make sure maxNumberOfJobs: tag under JobManager.yml is set accordingly e.g. if maxNumberOfJobs: tag is set to 2 then Redis Connect will start 2 cdc jobs under the same JVM instance. If the workload is more and you want to spread out (scale) the cdc jobs then create multiple JobConfig's and specify them in the Setup.yml under jobConfig: tag.
 ```yml

connectors/gemfire/README.md

@@ -292,7 +292,7 @@ metricsReporter:
 <details><summary>Configure JobConfig.yml</summary>
 <p>
 
-#### Job level details.
+#### Job level details. Please see [writers](../../docs/writers) for other write stage usages.
 
 ### Sample JobConfig.yml under redis-connect-sqlserver/config/samples/sqlserver folder
 

connectors/mssql/README.md

@@ -279,7 +279,7 @@ metricsReporter:
 <details><summary>Configure JobConfig.yml</summary>
 <p>
 
-#### Job level details.
+#### Job level details. Please see [writers](../../docs/writers) for other write stage usages.
 
 ### Sample JobConfig.yml under redis-connect-mysql/config/samples/mysql folder
 

connectors/mysql/README.md

@@ -289,7 +289,7 @@ metricsReporter:
 <details><summary>Configure JobConfig.yml</summary>
 <p>
 
-#### Job level details.
+#### Job level details. Please see [writers](../../docs/writers) for other write stage usages.
 
 ### Sample JobConfig.yml under redis-connect-oracle/config/samples/oracle folder
 

connectors/oracle/README.md

@@ -284,7 +284,7 @@ metricsReporter:
 <details><summary>Configure JobConfig.yml</summary>
 <p>
 
-#### Job level details.
+#### Job level details. Please see [writers](../../docs/writers) for other write stage usages.
 
 ### Sample JobConfig.yml under redis-connect-postgres/config/samples/postgres folder
 

connectors/postgres/README.md

@@ -0,0 +1,130 @@
+## Supported Redis data structures
+
+You can have one or more write stages in any Redis Connect job pipeline config. Here are the supported write stages, and it's usage examples within JobConfig.yml.
+
+<details><summary>StringWriteStage</summary>
+<p>
+
+```yml
+    StringWriteStage:
+      handlerId: REDIS_STRING_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      deleteOnKeyUpdate: true
+      async: true
+```
+
+</p>
+</details>
+
+<details><summary>HashWriteStage</summary>
+<p>
+
+```yml
+    HashWriteStage:
+      handlerId: REDIS_HASH_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      prependTableNameToKeys: true
+      deleteOnKeyUpdate: true
+      async: true
+```
+
+</p>
+</details>
+
+<details><summary>SetWriteStage</summary>
+<p>
+
+```yml
+    Set1WriteStage:
+      handlerId: REDIS_SET_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      deleteOnKeyUpdate: true
+      async: true
+      delimiter: "|"
+      keyPrefix: "empNumSet:"
+      keyColumns:
+        - empno
+      valueColumns:
+        - empno
+    Set2WriteStage:
+      handlerId: REDIS_SET_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      deleteOnKeyUpdate: true
+      async: true
+      delimiter: "|"
+      keyPrefix: "empNumSet:"
+      keyColumns:
+        - empno
+      valueColumns:
+        - fname
+    Set3WriteStage:
+      handlerId: REDIS_SET_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      deleteOnKeyUpdate: true
+      async: true
+      delimiter: "|"
+      keyPrefix: "empNumSet:"
+      keyColumns:
+        - empno
+      valueColumns:
+        - lname
+```
+
+</p>
+</details>
+
+<details><summary>SortedSetWriteStage</summary>
+<p>
+
+```yml
+    SortedSetWriteStage:
+      handlerId: REDIS_SORTEDSET_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      deleteOnKeyUpdate: true
+      async: true
+      keyPrefix: "Z:DataSet"
+      valueColumns:
+        - empno
+        - fname
+        - lname
+```
+
+</p>
+</details>
+
+<details><summary>StreamWriteStage</summary>
+<p>
+
+```yml
+    StreamWriteStage:
+      handlerId: REDIS_STREAM_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      deleteOnKeyUpdate: true
+      async: true
+```
+
+</p>
+</details>
+
+<details><summary>JSONWriteStage</summary>
+<p>
+
+```yml
+    JSONWriteStage:
+      handlerId: REDIS_JSON_WRITER
+      connectionId: targetConnection
+      metricsEnabled: false
+      prependTableNameToKeys: true
+      deleteOnKeyUpdate: true
+      async: true
+```
+
+</p>
+</details>