Implementation of K-Nearest Neighbors Algorithm Using PySpark

Last update: Dec 30, 2022

Related tags

Overview

KNN With Spark

Implementation of KNN using PySpark. The KNN was used on two separate datasets (https://archive.ics.uci.edu/ml/datasets/iris and https://archive.ics.uci.edu/ml/datasets/Fertility). The data was first normalized, also using PySpark. Euclidean Distance was used as the similarity measure. The optimal k found for both datasets was 5. The iris dataset had a test accuracy of 97% and the fertility dataset had a test accuracy of 88%.

Owner

Zachary Petroff

Cognitive Science Major @ Indiana University.

GitHub Repository

Apache Liminal is an end-to-end platform for data engineers & scientists, allowing them to build, train and deploy machine learning models in a robust and agile way

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validat

121 Dec 28, 2022

cleanlab is the data-centric ML ops package for machine learning with noisy labels.

cleanlab is the data-centric ML ops package for machine learning with noisy labels. cleanlab cleans labels and supports finding, quantifying, and lear

51 Nov 28, 2022

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Petastorm Contents Petastorm Installation Generating a dataset Plain Python API Tensorflow API Pytorch API Spark Dataset Converter API Analyzing petas

1.6k Dec 31, 2022

QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

152 Jan 02, 2023

Pandas DataFrames and Series as Interactive Tables in Jupyter

Pandas DataFrames and Series as Interactive Tables in Jupyter Star Turn pandas DataFrames and Series into interactive datatables in both your notebook

364 Jan 04, 2023

Free MLOps course from DataTalks.Club

MLOps Zoomcamp Our MLOps Zoomcamp course Sign up here: https://airtable.com/shrCb8y6eTbPKwSTL (it's not automated, you will not receive an email immed

4.6k Dec 31, 2022

This is a Cricket Score Predictor that predicts the first innings score of a T20 Cricket match using Machine Learning

This is a Cricket Score Predictor that predicts the first innings score of a T20 Cricket match using Machine Learning. It is a Web Application.

3 Aug 04, 2022

Both social media sentiment and stock market data are crucial for stock price prediction

Relating-Social-Media-to-Stock-Movement-Public - We explore the application of Machine Learning for predicting the return of the stock by using the information of stock returns. A trading strategy ba

15 Oct 29, 2022

scikit-learn models hyperparameters tuning and feature selection, using evolutionary algorithms.

Sklearn-genetic-opt scikit-learn models hyperparameters tuning and feature selection, using evolutionary algorithms. This is meant to be an alternativ

180 Dec 20, 2022

This machine-learning algorithm takes in data from the last 60 days and tries to predict tomorrow's price of any crypto you ask it.

Crypto-Currency-Predictor This machine-learning algorithm takes in data from the last 60 days and tries to predict tomorrow's price of any crypto you

6 Dec 04, 2022

Sleep stages are classified with the help of ML. We have used 4 different ML algorithms (SVM, KNN, RF, NN) to demonstrate them

Sleep stages are classified with the help of ML. We have used 4 different ML algorithms (SVM, KNN, RF, NN) to demonstrate them.

3 Apr 03, 2022

Implementation of K-Nearest Neighbors Algorithm Using PySpark

Related tags

Overview

KNN With Spark

Owner

Zachary Petroff

Apache Liminal is an end-to-end platform for data engineers & scientists, allowing them to build, train and deploy machine learning models in a robust and agile way

cleanlab is the data-centric ML ops package for machine learning with noisy labels.

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

Pandas DataFrames and Series as Interactive Tables in Jupyter

Free MLOps course from DataTalks.Club

This is a Cricket Score Predictor that predicts the first innings score of a T20 Cricket match using Machine Learning

Both social media sentiment and stock market data are crucial for stock price prediction

scikit-learn models hyperparameters tuning and feature selection, using evolutionary algorithms.

This machine-learning algorithm takes in data from the last 60 days and tries to predict tomorrow's price of any crypto you ask it.

Banpei is a Python package of the anomaly detection.

MaD GUI is a basis for graphical annotation and computational analysis of time series data.

Python package for machine learning for healthcare using a OMOP common data model

Azure MLOps (v2) solution accelerators.

机器学习检测webshell

OptaPy is an AI constraint solver for Python to optimize planning and scheduling problems.

scikit-learn: machine learning in Python

Time series changepoint detection

Tools for Optuna, MLflow and the integration of both.

Sleep stages are classified with the help of ML. We have used 4 different ML algorithms (SVM, KNN, RF, NN) to demonstrate them