set random offset

fix typos in softmax.h

write softmax results, needed for dgrad

fix typo

typos

typo

typo

set types

remove some includes

remove nullpyt, use reinterpret cast

data type instead of pointer for data_ptr template argument

fix pointer increments in vector copies

changes for recomputing softmax in dgrad

typo

fixes for recomputing softmax in dgrad

change backward function in fused dropout module

typo

change function name

typo

typo

typo

typo

don't return pad_mask in fprop function

add stream

fix softmax dgrad summation

save more memory by removing softmax output

remove softmax results from cpp file

typo

typo

debugging print

typo

remove debugging stuff

some vectorization optimizations

vectorize both fprop and bprop

typo

try no vectorization

remove float4 for dropout

Revert "remove float4 for dropout"

This reverts commit 59894b4.

Revert "try no vectorization"

This reverts commit b2ef02f.

cleanup

typo

typo

typo

typo

use null tensor for backward

typo

add specialization for vectorization

typo

typo

don't use hadd2 for additive mask

print args

typo

pull rand generation early, pipeline mask stores

use half2 for loads

remove prints

philox from pytorch upstream

actually ad philox file

cleanup

cleanup