Gigabyte has introduced AI TOP, a proprietary software utility designed to enable advanced AI model training for home users. Revealed at Computex, AI TOP empowers users to locally train and fine-tune AI models with a capacity of up to 236 billion parameters when paired with recommended hardware.
AI TOP serves as a holistic solution for local AI model refinement, prioritizing privacy, security, flexibility, and real-time adjustments. The utility boasts a user-friendly interface tailored to simplify navigation and setting comprehension for users of all levels. Moreover, AI TOP Tutor offers various solutions, setup guidance, and technical support for AI model operators.
The software currently supports over 70 open-source LLM models from Hugging Face, including popular options like Baichuan 2, Distill-GPT2, GLM4, Llama 2, and Llama 3. AI TOP’s selection is limited by desktop PC hardware memory constraints, despite Hugging Face hosting over 770,000 models.
Optimized for Gigabyte hardware, including motherboards, SSDs, graphics cards, and power supplies, the free software is compatible with various GPUs from Gigabyte, such as Nvidia GeForce RTX 40 series, AMD Radeon RX 7900 series, and Radeon Pro W7900 and W7800 series. To ensure peak performance, Gigabyte offers AI TOP-branded hardware on its dedicated website, featuring power supplies, motherboards, SSDs, and graphics cards.
Training AI models locally enhances privacy, security, cost efficiency, and processing speed, while providing customization, offline capabilities, and scalable hardware resource management. Users can enjoy immediate feedback, iteration, and full utilization of existing hardware for hands-on learning and experimentation.
You can download the AI TOP utility for free from Gigabyte’s official website. It is available to all users but only supported on Linux systems.