Popular GitHub Repositories for Optimization Methods

This is the official repository for the book Transformers - The Definitive Guide

Official implementation of the paper "Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models"

Visit: https://aliasgharheidari.com/HGS.html. HGS optimizer is a population-based method with stochastic switching elements that enrich its main exploratory and exploitative behaviors and flexibility of HGS in dealing with challenging problem landscapes. The algorithm has been compared to LSHADE, SPS_L_SHADE_EIG, LSHADE_cnEpSi, SHADE, SADE, MPEDE, and JDE methods.

An implementation of adan optimizer for optax

Solving Traveling Salesman Problem (TSP) using Ant Colony Optimization (ACO).

Code for executing virtual experiments with intelligent bet-and-run strategies for optimization, which efficiently utilize a total computational budget for getting good results by first starting n runs and after some time pick one of them to continue for the remaining budget.

This repository contains comprehensive solutions and analyses for four key homework assignments in the realm of Statistical and Machine Learning. The repository is structured to include both the original PDFs of the homework assignments and Jupyter notebooks that provide detailed code solutions.