Skip to content

Commit f21b59f

Browse files
authored
Create GELU.m
1 parent a720931 commit f21b59f

File tree

1 file changed

+7
-0
lines changed
  • algorithms/machine_learning/Activation Functions

1 file changed

+7
-0
lines changed
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
%GELU function
2+
x = -10:0.01:10;
3+
y = (1/2*x).*(1+tanh(sqrt(2/pi)*(x+0.044715*power(x,3))));
4+
plot(x,y);
5+
xlabel('x');
6+
ylabel('y');
7+
grid on

0 commit comments

Comments
 (0)