linux nvidia cuda python
via PatrickJS/awesome-cursorrules
Linux CUDA/ROCm GPU pipeline for downloading, quantizing, and uploading models from Hugging Face.
What is linux nvidia cuda python?
A model quantization tool designed for Linux servers that downloads models from Hugging Face, applies quantization, and uploads results to compatible repositories. Supports both NVIDIA CUDA and AMD ROCm GPUs with emphasis on simplicity and minimal setup friction.
- Download models from Hugging Face Hub
- Quantize models with GPU acceleration (CUDA/ROCm)
- Upload quantized models to Hugging Face-compatible repositories
- Handle quantization failures with informative error messages and recovery suggestions
- Run via Python or Bash with minimal dependency installation
- Support both NVIDIA and AMD GPU hardware
Applies to
File patterns this rule matches.
Rule definition (reference)
Source of truth, from the repository.
- Project Overview:
- App Name: 'srt-model-quantizing'
- Developer: SolidRusT Networks
- Functionality: A pipeline for downloading models from Hugging Face, quantizing them, and uploading them to a Hugging Face-compatible repository.
- Design Philosophy: Focused on simplicity—users should be able to clone the repository, install dependencies, and run the app using Python or Bash with minimal effort.
- Hardware Compatibility: Supports both Nvidia CUDA and AMD ROCm GPUs, with potential adjustments needed based on specific hardware and drivers.
- Platform: Intended to run on Linux servers only.
- Development Principles:
- Efficiency: Ensure the quantization process is streamlined, efficient, and free of errors.
- Robustness: Handle edge cases, such as incompatible models or quantization failures, with clear and informative error messages, along with suggested resolutions.
- Documentation: Keep all documentation up to date, including the README.md and any necessary instructions or examples.
- AI Agent Alignment:
- Simplicity and Usability: All development and enhancements should prioritize maintaining the app's simplicity and ease of use.
- Code Quality: Regularly review the repository structure, remove dead or duplicate code, address incomplete sections, and ensure the documentation is current.
- Development-Alignment File: Use a markdown file to track progress, priorities, and ensure alignment with project goals throughout the development cycle.
- Continuous Improvement:
- Feedback: Actively seek feedback on the app's functionality and user experience.
- Enhancements: Suggest improvements that could make the app more efficient or user-friendly, ensuring any changes maintain the app's core principles.
- Documentation of Changes: Clearly document any enhancements, bug fixes, or changes made during development to ensure transparency and maintainability.
Related rules
Senior full-stack TypeScript, React, Node.js guidance with clean architecture, testing, and WHY-oriented reasoning.
Quantitative factor research skills for designing, evaluating, and mining alpha factors in equities markets.
Android development with Jetpack Compose, clean architecture, and Material Design 3.
Angular development with Novo Elements UI library using standalone components.
Expert Angular 18 + TypeScript development with Jest, emphasizing clean code and performance.
Manage Kubernetes clusters, add-ons, stacks, and credentials via the Ankra CLI platform.