adam-optimizer

ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance

machine-learning deep-learning optimizer mnist adam adam-optimizer artifical-neural-network

Updated Jan 19, 2021
C++

aditya9211 / SVHN-CNN

Star

Google Street View House Number(SVHN) Dataset, and classifying them through CNN

machine-learning computer-vision cnn dropout mnist svhn convolutional-neural-networks confusion-matrix google-street convolutional-neural-network tensorboard-visualizations tesnorflow svhn-classifier grayscale-images house-numbers adam-optimizer mini-batch-gradient-descent one-hot-encode

Updated Mar 4, 2018
Jupyter Notebook

nengwp / Lion-vs-Adam

Star

Lion and Adam optimization comparison

vis adam lion adam-optimizer lion-optimization

Updated Feb 23, 2023
Jupyter Notebook

v-iashin / CS231n

Star

PyTorch/Tensorflow solutions for Stanford's CS231n: "CNNs for Visual Recognition"

Updated Jan 27, 2021
Jupyter Notebook

yashkant / padam-tensorflow

Star

Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge

tensorflow optimization keras wide-residual-networks adam-optimizer tensorflow-eager amsgrad sgd-momentum padam

Updated Apr 13, 2019
Python

sagarvegad / Adam-optimizer

Star

Implemented Adam optimizer in python

gradient adam-optimizer

Updated Jun 8, 2017
Python

shreyansh26 / ML-Optimizers-JAX

Star

Toy implementations of some popular ML optimizers using Python/JAX

machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers

Updated Jun 20, 2021
Python

Arko98 / Gradient-Descent-Algorithms

Star

A collection of various gradient descent algorithms implemented in Python from scratch

machine-learning ai deep-learning machine-learning-algorithms ml deep-learning-algorithms gradient-descent adagrad rmsprop gradient-descent-algorithm adam-optimizer nesterov-accelerated-sgd nesterov-momentum nesterov momentum-optimization-algorithm

Updated Feb 28, 2023
Python

VivianoRiccardo / Learning-Lab-C-Library

Star

This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated

c library deep-learning neural-network opencl transformer lstm convolutional-layers deeplearning residual-layers residual-networks backpropagation optimization-algorithms softmax adam-optimizer avarage nesterov adam-algorithm dropout-layers

Updated Sep 29, 2023
C

rdspring1 / Count-Sketch-Optimizers

Star

A compressed adaptive optimizer for training large-scale deep learning models using PyTorch

hashing deep-learning neural-network pytorch transformer imagenet count-min-sketch language-model adagrad adam-optimizer sgd-optimizer count-sketch sgd-momentum

Updated Nov 26, 2019
Python

RudreshVeerkhare / CustomXGBoost

Star

Modified XGBoost implementation from scratch with Numpy using Adam and RSMProp optimizers.

numpy gradient-boosting-machine rmsprop adam-optimizer xgboost-algorithm implementation-of-algorithms

Updated Jul 24, 2020
Jupyter Notebook

yaricom / TimeSeriesLearning

Star

The project aimed to implement Deep NN / RNN based solution in order to develop flexible methods that are able to adaptively fillin, backfill, and predict time-series using a large number of heterogeneous training datasets.