We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent a720931 commit f21b59fCopy full SHA for f21b59f
algorithms/machine_learning/Activation Functions/GELU.m
@@ -0,0 +1,7 @@
1
+%GELU function
2
+x = -10:0.01:10;
3
+y = (1/2*x).*(1+tanh(sqrt(2/pi)*(x+0.044715*power(x,3))));
4
+plot(x,y);
5
+xlabel('x');
6
+ylabel('y');
7
+grid on
0 commit comments