Merge pull request #1 from SciSharp/master

Merging SciSharp/TensorFlow.NET master

Author: harishsk

README.md

@@ -16,7 +16,7 @@ TF.NET is a member project of [SciSharp STACK](https://github.com/SciSharp).
 
 ### Why TensorFlow.NET ?
 
-`SciSharp STASK`'s mission is to bring popular data science technology into the .NET world and to provide .NET developers with a powerful Machine Learning tool set without reinventing the wheel. Scince the APIs are kept as similar as possible you can immediately adapt any existing Tensorflow code in C# with a zero learning curve. Take a look at a comparison picture and see how comfortably a   Tensorflow/Python script translates into a C# program with TensorFlow.NET.
+`SciSharp STACK`'s mission is to bring popular data science technology into the .NET world and to provide .NET developers with a powerful Machine Learning tool set without reinventing the wheel. Scince the APIs are kept as similar as possible you can immediately adapt any existing Tensorflow code in C# with a zero learning curve. Take a look at a comparison picture and see how comfortably a   Tensorflow/Python script translates into a C# program with TensorFlow.NET.
 
 ![pythn vs csharp](docs/assets/syntax-comparision.png)
 
@@ -131,7 +131,7 @@ Read the docs & book [The Definitive Guide to Tensorflow.NET](https://tensorflow
 Run specific example in shell:
 
 ```cs
-dotnet TensorFlowNET.Examples.dll "Retrain Image Classifier"
+dotnet TensorFlowNET.Examples.dll "EXAMPLE NAME"
 ```
 
 Example runner will download all the required files like training data and model pb files.
@@ -142,13 +142,13 @@ Example runner will download all the required files like training data and model
 * [Logistic Regression](test/TensorFlowNET.Examples/BasicModels/LogisticRegression.cs)
 * [Nearest Neighbor](test/TensorFlowNET.Examples/BasicModels/NearestNeighbor.cs)
 * [Naive Bayes Classification](test/TensorFlowNET.Examples/BasicModels/NaiveBayesClassifier.cs)
+* [Full Connected Neural Network](test/TensorFlowNET.Examples/ImageProcess/DigitRecognitionNN.cs)
 * [Image Recognition](test/TensorFlowNET.Examples/ImageProcess)
 * [K-means Clustering](test/TensorFlowNET.Examples/BasicModels/KMeansClustering.cs)
 * [NN XOR](test/TensorFlowNET.Examples/BasicModels/NeuralNetXor.cs)
 * [Object Detection](test/TensorFlowNET.Examples/ImageProcess/ObjectDetection.cs)
 * [Text Classification](test/TensorFlowNET.Examples/TextProcess/BinaryTextClassification.cs)
 * [CNN Text Classification](test/TensorFlowNET.Examples/TextProcess/cnn_models/VdCnn.cs)
-
 * [Named Entity Recognition](test/TensorFlowNET.Examples/TextProcess/NER)
 * [Transfer Learning for Image Classification in InceptionV3](test/TensorFlowNET.Examples/ImageProcess/RetrainImageClassifier.cs)
 
@@ -186,7 +186,9 @@ git pull upstream master
 
 Feel free to star or raise issue on [Github](https://github.com/SciSharp/TensorFlow.NET).
 
-Join our chat on [Gitter](https://gitter.im/sci-sharp/community) or
+Follow us on [Medium](https://medium.com/scisharp).
+
+Join our chat on [Gitter](https://gitter.im/sci-sharp/community).
 
 Scan QR code to join Tencent TIM group:
 

TensorFlow.NET.sln

@@ -1,7 +1,7 @@
 
 Microsoft Visual Studio Solution File, Format Version 12.00
-# Visual Studio 15
-VisualStudioVersion = 15.0.28307.168
+# Visual Studio Version 16
+VisualStudioVersion = 16.0.29025.244
 MinimumVisualStudioVersion = 10.0.40219.1
 Project("{9A19103F-16F7-4668-BE54-9A1E7A4F7556}") = "TensorFlowNET.UnitTest", "test\TensorFlowNET.UnitTest\TensorFlowNET.UnitTest.csproj", "{029A8CF1-CF95-4DCB-98AA-9D3D96A83B3E}"
 EndProject

docs/assets/TensorBoard-nn.png

@@ -7,21 +7,12 @@ In TensorFlow, a constant is a special Tensor that cannot be modified while the
 * shape: dimensions;
 * name: constant's name;
 
-在TensorFlow中，常量是一种特殊的Tensor，它在计算图运行的时候，不能被修改。比如在线性模型里$\tilde{y_i}=\boldsymbol{w}x_i+b$, 常数$b$就可以用一个常量来表示。既然常量是一种Tensor，那么它也就具有Tensor的所有数据特性，它包括：
-
-* value: 符合TensorFlow中定义的数据类型的常数值或者常数列表;
-* dtype：数据类型;
-* shape：常量的形状;
-* name：常量的名字;
-
 
 
 ##### How to create a Constant
 
 TensorFlow provides a handy function to create a Constant. In TF.NET, you can use the same function name `tf.constant` to create it. TF.NET takes the same name as python binding to the API. Naming, although this will make developers who are used to C# naming habits feel uncomfortable, but after careful consideration, I decided to give up the C# convention naming method.
 
-TensorFlow提供了一个很方便的函数用来创建一个Constant, 在TF.NET，可以使用同样的函数名`tf.constant`来创建，TF.NET采取尽可能使用和python binding一样的命名方式来对API命名，虽然这样会让习惯C#命名习惯的开发者感到不舒服，但我经过深思熟虑之后还是决定放弃C#的约定命名方式。
-
 Initialize a scalar constant:
 
 ```csharp
@@ -45,9 +36,7 @@ var tensor = tf.constant(nd);
 
 ##### Dive in Constant
 
-Now let's explore how constant works.
-
-现在让我探究一下`tf.constant`是怎么工作的。
+Now let's explore how `constant` works.
 
 
 

docs/assets/mnist.png

@@ -2,16 +2,10 @@
 
 One of the most nerve-wracking periods when releasing the first version of an open source project occurs when the [gitter](https://gitter.im/sci-sharp/community) community is created. You are all alone, eagerly hoping and wishing for the first user to come along. I still vividly remember those days. 
 
-最让人紧张的时刻是当我为自己的开源项目发布第一个版本并在gitter里开放一个聊天社区，而里面只有你一个人，饥渴地等待第一个进入聊天室的用户，我仍然清楚地记得那个时期。
-
 
 
 TensorFlow.NET is my third open source project. BotSharp and NumSharp are the first two. The response is pretty good. I also got a lot of stars on github. Although the first two projects are very difficult, I can't admit that TensorFlow.NET is much more difficult than the previous two, and it is an area I have never been involved with. Mainly related to GPU parallel computing, distributed computing and neural network model. When I started writing this project, I was also sorting out the idea of the coding process. TensorFlow is a huge and complicated project, and it is easy to go beyond the scope of personal ability. Therefore, I want to record the thoughts at the time as much as possible. The process of recording and sorting clears the way of thinking.
 
-TensorFlow.NET是我写的第3个开源项目，BotSharp和NumSharp是前两个，反应都还不错，在github上也收获了不少星。虽然前两个项目的难度很大，但是我不得承认TensorFlow.NET的难度要比之前两个要大的多，是我从未涉入过的领域。主要涉及GPU并行计算，分布式计算和神经网络模型。当我开始写这个项目的时候，我同时也在整理编码过程时候的想法，TensorFlow是个巨大最复杂的工程，很容易超出个人能力范围，所以想尽可能地把当时的思路记录下来，也想趁着记录整理的过程把思路理清。
-
 
 
 All the examples in this book can be found in the github repository of TensorFlow.NET. When the source code and the code in the book are inconsistent, please refer to the source code. The sample code is typically located in the Example or UnitTest project.
-
-本书中的所有例子都可以在TensorFlow.NET的github仓库中找到，当源代码和书中的代码不一致时，请以源代码为准。示例代码一般都位于Example或者是UnitTest项目里。

docs/assets/nn-result.png

@@ -2,19 +2,17 @@
 
 I would describe TensorFlow as an open source machine learning framework developed by Google which can be used to build neural networks and perform a variety of machine learning tasks. it works on data flow graph where nodes are the mathematical operations and the edges are the data in the form of tensor, hence the name Tensor-Flow. 
 
-按照我的理解，TensorFlow是Google公司开发的一个开源机器学习框架，可以用来搭建神经网络模型和其它传统机器学习模型，它采用了图计算模型，图的节点和边分别代表了操作和数据输入或输出，数据在图的单个方向传递，因此这个过程形象地取名叫做TensorFlow。
 
-Let's run a classic HelloWorld program first and see if TensorFlow is running on .NET. I can't think of a simpler way to be a HelloWorld.
 
-让我们先运行一个经典的HelloWorld程序，看看TensorFlow在.NET上面运行的效果，我想不出有比做个HelloWorld更简单的方式了。
+Let's run a classic HelloWorld program first and see if TensorFlow is running on .NET. I can't think of a simpler way to be a HelloWorld.
 
 
 
 ### Install the TensorFlow.NET SDK
 
 TensorFlow.NET uses the .NET Standard 2.0 standard, so your new project Target Framework can be .NET Framework or .NET Core.  All the examples in this book are using .NET Core 2.2 and Microsoft Visual Studio Community 2017. To start building TensorFlow program you just need to download and install the .NET SDK (Software Development Kit). You have to download the latest .NET Core SDK from offical website: https://dotnet.microsoft.com/download.
 
-TensorFlow.NET采用.NET标准库2.0版本，因此你的新建工程可以是.NET Framework或者是基于.NET Core的。本文中的所有例子都是用的.NET Core 2.2的，IDE用的是Microsoft Visual Studio Community 2017。为了能编译和运行TensorFlow工程，你需要从这里下载最新的.NET Core SDK: https://dotnet.microsoft.com/download。
+
 
 1. New a project
 
@@ -34,7 +32,7 @@ PM> Install-Package TensorFlow.NET
 
 After installing the TensorFlow.NET package, you can use the `using Tensorflow` to introduce the TensorFlow library.
 
-安装完TensorFlow.NET包后，你就可以使用`using Tensorflow`来引入TensorFlow库了。
+
 
 ```csharp
 using System;
@@ -76,5 +74,3 @@ Press any key to continue . . .
 
 This sample code can be found at [here](https://github.com/SciSharp/TensorFlow.NET/blob/master/test/TensorFlowNET.Examples/HelloWorld.cs).
 
-此示例代码可以在[这里](https://github.com/SciSharp/TensorFlow.NET/blob/master/test/TensorFlowNET.Examples/HelloWorld.cs)找到。
-

docs/assets/nn.png

@@ -1,5 +1,7 @@
 # Chapter. Linear Regression
 
+
+
 ### What is linear regression?
 
 Linear regression is a linear approach to modelling the relationship between a scalar response (or dependent variable) and one or more explanatory variables (or independent variables). 
@@ -8,9 +10,7 @@ Consider the case of a single variable of interest y and a single predictor vari
 
 We have some data $D=\{x{\tiny i},y{\tiny i}\}$ and we assume a simple linear model of this dataset with Gaussian noise:
 
-线性回归是一种线性建模方法，这种方法用来描述自变量与一个或多个因变量的之间的关系。在只有一个因变量y和一个自变量的情况下。自变量还有以下几种叫法：
-协变量，输入，特征；因变量通常被叫做响应变量，输出，输出结果。
-假如我们有数据$D=\{x{\tiny i},y{\tiny i}\}$，并且假设这个数据集是满足高斯分布的线性模型：
+
 ```csharp
 // Prepare training Data
 var train_X = np.array(3.3f, 4.4f, 5.5f, 6.71f, 6.93f, 4.168f, 9.779f, 6.182f, 7.59f, 2.167f, 7.042f, 10.791f, 5.313f, 7.997f, 5.654f, 9.27f, 3.1f);
@@ -21,24 +21,21 @@ var n_samples = train_X.shape[0];
 
 Based on the given data points, we try to plot a line that models the points the best. The red line can be modelled based on the linear equation: $y = wx + b$. The motive of the linear regression algorithm is to find the best values for $w$ and $b$. Before moving on to the algorithm, le's have a look at two important concepts you must know to better understand linear regression.
 
-按照上图根据数据描述的数据点，在这些数据点之间画出一条线，这条线能达到最好模拟点的分布的效果。红色的线能够通过下面呢线性等式来描述：$y = wx + b$。
-线性回归算法的目标就是找到这条线对应的最好的参数$w$和$b$。在介绍线性回归算法之前，我们先看两个重要的概念，这两个概念有助于你理解线性回归算法。
+
 
 ### Cost Function
 
 The cost function helps us to figure out the best possible values for $w$ and $b$ which would provide the best fit line for the data points. Since we want the best values for $w$ and $b$, we convert this search problem into a minimization problem where we would like to minimize the error between the predicted value and the actual value.
 
-损失函数帮助我们估算出最优的参数$w$和$b$，这个最优的参数能够最好的拟合数据点的分布。由于我们想找到最优的参数$w$和$b$，因此我们把这个问题转化成求
-预测参数与实际参数之差的最小值问题。
+
 
 ![minimize-square-cost](_static/minimize-square-cost.png)
 
 We choose the above function to minimize. The difference between the predicted values and ground truth measures the error difference. We square the error difference and sum over all data points and divide that
 value by the total number of data points. This provides the average squared error over all the data points. Therefore, this cost function is also known as the Mean Squared Error(MSE) function. Now, using this MSE
 function we are going to change the values of $w$ and $b$ such that the MSE value settles at the minima.
 
-我们选择最小化上面的函数。预测值和真实值之间的差异的大小衡量了预测结果的偏差。我们用所有点的偏差的平方和除以所有点所有点的数量大小来表示说有点的平均
-的误差大小。因此，损失函数又叫均方误差（简称MSE）。到此，我们可以通过调整参数$w$和$b$来使MSE达到最小值。
+
 
 ```csharp
 // tf Graph Input
@@ -56,13 +53,13 @@ var pred = tf.add(tf.multiply(X, W), b);
 var cost = tf.reduce_sum(tf.pow(pred - Y, 2.0f)) / (2.0f * n_samples);
 ```
 
+
+
 ### Gradient Descent
-### 梯度下降法
 
 The another important concept needed to understand is gradient descent. Gradient descent is a method of updating $w$ and $b$ to minimize the cost function. The idea is that we start with some random values for $w$ and $b$ and then we change these values iteratively to reduce the cost. Gradient descent helps us on how to update the values or which direction we would go next. Gradient descent is also know as **steepest descent**.
 
-另一个需要理解的重要概念是梯度下降法。梯度下降法是通过更新参数$w$和$b$来最小化损失函数。梯度下降法的思想就是首先以任意的参数$w$和$b$开始计算损失
-函数，然后通过递归的方式不断地变化参数来减小损失。梯度下降法帮助我们如何更新参数，或者说告诉我们下一个参数该如何设置。梯度下降法也称为“最快下降法”。
+
 
 
 ![gradient-descent](_static/gradient-descent.png)
@@ -72,9 +69,7 @@ of steps to reach the bottom. If you decide to take one step at a time you would
 reach sooner but, there is a chance that you could overshoot the bottom of the pit and not exactly at the bottom. In the gradient descent algorithm, the number of steps you take is the learning rate. This 
 decides on how fast the algorithm converges to the minima.
 
-这里做一个类比，想象着你站在一个U形坑的最上面，你的目标是达到坑的最低端。有一个条件是，你不确定你走多少步能到达底端。如果你选择一步一步的走到坑的
-底端，这样可能需要的时间很长。如果你每次大步的往前走，你可能很快到达坑的底端，但是你有可能错过坑的最底端。在梯度下降算法中，你所采用的步数就是训练
-速率。训练速率决定了算法以多块的速度使得损失函数达到最小值。
+
 
 
 ```csharp