Adding layernorm docs

definitelynotmcarilli · definitelynotmcarilli · commit 67ad3065b828 · 2018-11-28T11:27:26.000-08:00
diff --git a/docs/source/index.rst b/docs/source/index.rst
@@ -44,6 +44,12 @@ Installation requires CUDA 9 or later, PyTorch 0.4 or later, and Python 3. Insta
 
    optimizers
 
+.. toctree::
+   :maxdepth: 1
+   :caption: Fused Layer Norm
+
+   layernorm
+
 ..   reparameterization
 ..   RNN
    
diff --git a/docs/source/layernorm.rst b/docs/source/layernorm.rst
@@ -0,0 +1,14 @@
+.. role:: hidden
+    :class: hidden-section
+
+apex.normalization.fused_layer_norm
+===================================
+
+.. automodule:: apex.normalization.fused_layer_norm
+.. currentmodule:: apex.normalization.fused_layer_norm
+
+.. FusedAdam
+   ----------
+
+.. autoclass:: FusedLayerNorm
+    :members:
