Merge pull request #16 from mohammadzainabbas/dev

Dev

Author: mohammadzainabbas

README.md

@@ -84,6 +84,9 @@ You will get the following output files:
 
 #### 2.4. 🎉 Results 🎉
 
-The following plot shows the training progress of the agent:
+The following plot shows the comparsion between training progress of `Proximal policy optimization (PPO)`, `Evolution Strategy (ES)` and `Augmented Random Search (ARS)` algorithms:
+
+<p align="center">
+  <img src="https://github.com/mohammadzainabbas/Reinforcement-Learning-CS/blob/main/results/output.jpeg?raw=true" width="500" height="300">
+</p>
 
-![Training progress plot](https://github.com/mohammadzainabbas/Reinforcement-Learning-CS/blob/main/results/output.jpeg?raw=true)

docs/SETUP_ENV.md

@@ -37,7 +37,7 @@ mamba env create -n reinforcement_learning -f docs/config/reinforcement_learning
 Before starting further, make sure that you have `conda` (Anaconda) installed (otherwise, create a new env via [virutalenv](#new-env-virtualenv)). We will create a new enviornment for the purpose of our labs:
 
 ```bash
-conda create -n reinforcement_learning python=3 -y 
+conda create -n reinforcement_learning python=3.10 -y 
 ```
 
 and activate it

docs/config/reinforcement_learning_env.yaml

@@ -3,7 +3,7 @@ channels:
   - apple
   - conda-forge
 dependencies:
-  - python=3  ## specify desired version
+  - python=3.10  ## specify desired version
   - pip
   - tensorflow-deps
   - ipykernel  ## for use with Jupyter
@@ -15,6 +15,6 @@ dependencies:
     - torch ## if you want to use pytorch as well
     - torchvision ## if you want to use pytorch as well
     - matplotlib ## if you want to plot your data
-    - plotly ## if you want to plot your data
-    - pandas
-    - numpy
+    - brax
+    - flax
+    - jax

results/data/final_600M.json

@@ -1,5 +1,4 @@
-from json import loads
-from typing import Union, Dict, Any
+from typing import Union
 from pathlib import Path
 from os.path import join
 
@@ -12,10 +11,18 @@
         margin: 0;
         padding: 0;
       }
-      #brax-viewer {
+
+      h3 {
+      display: flex;
+      justify-content: center;
+      padding-top: 18px;
+      }
+
+      [id^='brax-viewer-']  {
         margin: 0;
         padding: 0;
-        height: 100vh;
+        height: 50vh;
+		padding-bottom: 2.5%;
       }
     </style>
   </head>
@@ -69,9 +76,9 @@
 </html>
 """
 
-def read_json(path: Union[str, Path]) -> Dict[str, Any]:
+def read_json(path: Union[str, Path]) -> str:
 	with open(path, "r") as f:
-		return loads(f.read())
+		return f.read()
 
 def main() -> None:
 	# Read the JSON files