Visualize bert word Embeddings, position embeddings and contextual embeddings using TensorBoard

Showcasing how to use native amp's autocast() and Gradscaler through simple example model.

Using Roberta last layer embedding and cosine similarity, NER can be performed in a zero shot manner. The model performance is very good without any training. This notebooks finds similar entities given an example entity.

Typing fast on phones are prone to error. Using masked language models, these errors can be detected and rectified

Using tensorboard client effeciently in azureml

Using tensorboard in pytorch. This example uses windoes for the system commands. Linux and Mac will need slight modification in the powershell commands

# https://www.tensorflow.org/install/pip # !pip install tensorboard # !pip install tensorflow-cpu # Load the TensorBoard notebook extension %load_ext tensorboard import tensorflow as tf import ...

Linux has a file called .bashrc which gets executed whenever a new terminal starts. This .bashrc file is generally used for Setting aliases Setting up environment variables Shortcut functio...

Resize image in python using pillow library pip install pillow Code import PIL from PIL import Image MAXWIDTH = 450 filename = '1.jpg' img = Image.open(filename) image_bytes = len(img.fp.rea...

Apex with gradient accumulation results in inaccurate gradients if reduction is disabled for steps where optimizer is not stepping.