ML Training & Inference

A framework for efficient model inference with omni-modality models

Olares: An Open-Source Personal Cloud to Reclaim Your Data

In this repository, I will share some useful notes and references about deploying deep learning-based models in production.

ML-powered manga translator, written in Rust.

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

🔥🔥High-Performance Face Recognition Library on PaddlePaddle & PyTorch🔥🔥

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

OML 1.0 via Fingerprinting: Open, Monetizable, and Loyal AI

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

🦞 Just talk to your agent — it learns and EVOLVES 🧬.

OpenDeepWiki is the open-source version of the DeepWiki project, aiming to provide a powerful knowledge management and collaboration platform. The project is mainly developed using C# and TypeScript, supporting modular design, and is easy to expand and customize.

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

OneTrainer is a one-stop solution for all your Diffusion training needs.

LLM Finetuning with peft

A general fine-tuning kit geared toward image/video/audio diffusion models.

MulimgViewer is a multi-image viewer that can open multiple images in one interface, which is convenient for image comparison and image stitching.

Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™

Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.