Implementation of linesearch Optimization Algorithms in Python

Last update: Dec 06, 2022

Overview

Nonlinear Optimization Algorithms

During my time as Scientific Assistant at the Karlsruhe Institute of Technology (Germany) I implemented various Optimization Algorithms solving unrestricted nonlinear Problems; Gradient-Descent-Method, Newton-Method, Conjugate-Gradient-Descent-Method, BFGS-Method and a Trust-Region-Method in Python.

In addition, I implemented an Armijo linesearch.

The code is implemented in an object-oriented manner, whereby each method is implemented in a class (bfgs.py, cg.py, gradv.py, newtonm.py and tr.py) and executed via the ros_test.py script. In the script ros_test.py the Rosenbrock function was implemented, which is minimized to a given starting point x_0 with each method.

Owner

Paul

M.Sc student at Columbia University and Karlsruhe Institute of Technology. Passionate about Mathematical Modeling, Statistics and Optimization.

GitHub Repository

A high performance and generic framework for distributed DNN training

BytePS BytePS is a high performance and general distributed training framework. It supports TensorFlow, Keras, PyTorch, and MXNet, and can run on eith

3.3k Dec 28, 2022

BioPy is a collection (in-progress) of biologically-inspired algorithms written in Python

BioPy is a collection (in-progress) of biologically-inspired algorithms written in Python. Some of the algorithms included are mor

40 Aug 26, 2022

AutoX是一个高效的自动化机器学习工具，它主要针对于表格类型的数据挖掘竞赛。它的特点包括: 效果出色、简单易用、通用、自动化、灵活。

English | 简体中文 AutoX是什么？ AutoX一个高效的自动化机器学习工具，它主要针对于表格类型的数据挖掘竞赛。它的特点包括: 效果出色: AutoX在多个kaggle数据集上，效果显著优于其他解决方案(见效果对比)。简单易用: AutoX的接口和sklearn类似，方便上手使用。

431 Dec 28, 2022

ThunderSVM: A Fast SVM Library on GPUs and CPUs

What's new We have recently released ThunderGBM, a fast GBDT and Random Forest library on GPUs. add scikit-learn interface, see here Overview The miss

1.4k Dec 22, 2022

EbookMLCB - ebook Machine Learning cơ bản

Mã nguồn cuốn ebook "Machine Learning cơ bản", Vũ Hữu Tiệp. ebook Machine Learning cơ bản pdf-black_white, pdf-color. Mọi hình thức sao chép, in ấn đề

943 Jan 02, 2023

Python module for machine learning time series:

seglearn Seglearn is a python package for machine learning time series or sequences. It provides an integrated pipeline for segmentation, feature extr

536 Dec 29, 2022

Simple data balancing baselines for worst-group-accuracy benchmarks.

BalancingGroups Code to replicate the experimental results from Simple data balancing baselines achieve competitive worst-group-accuracy. Replicating

29 Dec 02, 2022

ThunderGBM: Fast GBDTs and Random Forests on GPUs

Documentations | Installation | Parameters | Python (scikit-learn) interface What's new? ThunderGBM won 2019 Best Paper Award from IEEE Transactions o

648 Dec 16, 2022

Crypto-trading - ML techiques are used to forecast short term returns in 14 popular cryptocurrencies

Crypto-trading - ML techiques are used to forecast short term returns in 14 popular cryptocurrencies. We have amassed a dataset of millions of rows of high-frequency market data dating back to 2018 w

4 Sep 22, 2022

Practical Time-Series Analysis, published by Packt

Practical Time-Series Analysis This is the code repository for Practical Time-Series Analysis, published by Packt. It contains all the supporting proj

325 Dec 23, 2022

Pydantic based mock data generation

This library offers powerful mock data generation capabilities for pydantic based models. It can also be used with other libraries that use pydantic as a foundation, for example SQLModel, Beanie and

396 Dec 28, 2022

This jupyter notebook project was completed by me and my friend using the dataset from Kaggle

ARM This jupyter notebook project was completed by me and my friend using the dataset from Kaggle. The world Happiness 2017, which ranks 155 countries

1 Jan 23, 2022

A Python Module That Uses ANN To Predict A Stocks Price And Also Provides Accurate Technical Analysis With Many High Potential Implementations!

Stox A Module to predict the "close price" for the next day and give "technical analysis". It uses a Neural Network and the LSTM algorithm to predict

31 Dec 16, 2022

Flask app to predict daily radiation from the time series of Solcast from Islamabad, Pakistan

Solar-radiation-ISB-MLOps - Flask app to predict daily radiation from the time series of Solcast from Islamabad, Pakistan.

1 Dec 31, 2021

The MLOps is the process of continuous integration and continuous delivery of Machine Learning artifacts as a software product, keeping it inside a loop of Design, Model Development and Operations.

MLOps The MLOps is the process of continuous integration and continuous delivery of Machine Learning artifacts as a software product, keeping it insid

25 Nov 27, 2022

Implementation of linesearch Optimization Algorithms in Python

Related tags

Overview

Nonlinear Optimization Algorithms

Owner

Paul

A high performance and generic framework for distributed DNN training

BioPy is a collection (in-progress) of biologically-inspired algorithms written in Python

AutoX是一个高效的自动化机器学习工具，它主要针对于表格类型的数据挖掘竞赛。它的特点包括: 效果出色、简单易用、通用、自动化、灵活。

ThunderSVM: A Fast SVM Library on GPUs and CPUs

EbookMLCB - ebook Machine Learning cơ bản

Python module for machine learning time series:

Simple data balancing baselines for worst-group-accuracy benchmarks.

ThunderGBM: Fast GBDTs and Random Forests on GPUs

Crypto-trading - ML techiques are used to forecast short term returns in 14 popular cryptocurrencies

Practical Time-Series Analysis, published by Packt

Pydantic based mock data generation

This jupyter notebook project was completed by me and my friend using the dataset from Kaggle

A Python Module That Uses ANN To Predict A Stocks Price And Also Provides Accurate Technical Analysis With Many High Potential Implementations!

Flask app to predict daily radiation from the time series of Solcast from Islamabad, Pakistan

The MLOps is the process of continuous integration and continuous delivery of Machine Learning artifacts as a software product, keeping it inside a loop of Design, Model Development and Operations.

This repository contains full machine learning pipeline of the Zillow Houses competition on Kaggle platform.

(3D): LeGO-LOAM, LIO-SAM, and LVI-SAM installation and application

2021 Machine Learning Security Evasion Competition

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Crunchdao - Python API for the Crunchdao machine learning tournament

Implementation of linesearch Optimization Algorithms in Python

Related tags

Overview

Nonlinear Optimization Algorithms

Owner

Paul

A high performance and generic framework for distributed DNN training

BioPy is a collection (in-progress) of biologically-inspired algorithms written in Python

AutoX是一个高效的自动化机器学习工具，它主要针对于表格类型的数据挖掘竞赛。 它的特点包括: 效果出色、简单易用、通用、自动化、灵活。

ThunderSVM: A Fast SVM Library on GPUs and CPUs

EbookMLCB - ebook Machine Learning cơ bản

Python module for machine learning time series:

Simple data balancing baselines for worst-group-accuracy benchmarks.

ThunderGBM: Fast GBDTs and Random Forests on GPUs

Crypto-trading - ML techiques are used to forecast short term returns in 14 popular cryptocurrencies

Practical Time-Series Analysis, published by Packt

Pydantic based mock data generation

This jupyter notebook project was completed by me and my friend using the dataset from Kaggle

A Python Module That Uses ANN To Predict A Stocks Price And Also Provides Accurate Technical Analysis With Many High Potential Implementations!

Flask app to predict daily radiation from the time series of Solcast from Islamabad, Pakistan

The MLOps is the process of continuous integration and continuous delivery of Machine Learning artifacts as a software product, keeping it inside a loop of Design, Model Development and Operations.

This repository contains full machine learning pipeline of the Zillow Houses competition on Kaggle platform.

(3D): LeGO-LOAM, LIO-SAM, and LVI-SAM installation and application

2021 Machine Learning Security Evasion Competition

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Crunchdao - Python API for the Crunchdao machine learning tournament

AutoX是一个高效的自动化机器学习工具，它主要针对于表格类型的数据挖掘竞赛。它的特点包括: 效果出色、简单易用、通用、自动化、灵活。