Deep Neural Network implemented in pure SQL over BigQuery

Deep Neural Network implemented in pure SQL over BigQuery

  • March 14, 2018
Table of Contents

Deep Neural Network implemented in pure SQL over BigQuery

In this post, we’ll implement a deep neural network with one hidden layer (and ReLu and softmax activation functions) purely in SQL. The end-to-end steps for neural network training including the forward pass and back-propagation will be implemented as a single SQL query on BigQuery. As it runs on Bigquery, in effect we are performing distributed neural network training on 100s to 1000s of servers.

Sounds cool! right?

Source: towardsdatascience.com

Tags :
Share :
comments powered by Disqus

Related Posts

Paper repro: “Self-Normalizing Neural Networks”

Paper repro: “Self-Normalizing Neural Networks”

SNNs are really cool: their goal is to create neural networks in which, if the input of any layer is normally distributed, the output will automatically also be normally distributed. This is amazing because normalizing the output of layers is known to be a very efficient way to improve the performance of neural networks, but the current ways to do it (eg BatchNorm) basically involve weird hacks, while in SNN the normalization is an intrinsic part of the mathematics of the neural net.

Read More