The Wayback Machine - https://web.archive.org/web/20200717231227/https://github.com/topics/tensorflow
Skip to content
#

Tensorflow

tensorflow logo

TensorFlow is an open source library that was created by Google. It is used to design, build, and train deep learning models.

Here are 17,702 public repositories matching this topic...

saeedalahmari3
saeedalahmari3 commented Apr 23, 2020

In Keras documentation, glorot_uniform says that the initializer is using Glorot Uniform from this paper. However, the Keras implementation is totally different from the equation on the paper. Also, there are some arguments such as mode ='fan_avg' is the default. It should be same as the referenced paper. 'fan_sum'. Golort uniform is shown

transformers
dhruvsakalley
dhruvsakalley commented Mar 2, 2020

When you look at the variables in the pretrained base uncased BERT the varibles look like list 1. When you do the training from scratch, 2 additional variables per layer are introduced, with suffixes adam_m and adam_v. It would be nice for someone to explain what these variables are? and what is their significance to the process of training?
If one were to manually initialize variables from a pri

pranavsharma
pranavsharma commented Feb 27, 2020

Several parts of the op sec like the main op description, attributes, input and output descriptions become part of the binary that consumes ONNX e.g. onnxruntime causing an increase in its size due to strings that take no part in the execution of the model or its verification.

Setting __ONNX_NO_DOC_STRINGS doesn't really help here since (1) it's not used in the SetDoc(string) overload (s

Created by Google Brain Team

Released November 9, 2015

Organization
tensorflow
Website
www.tensorflow.org
Wikipedia
Wikipedia
You can’t perform that action at this time.