Granite models: local GPU compatibility (56 models)
← All models

Collection

Granite models

56 catalogued models. Coverage shows how far LocalAIReady can answer compatibility for each one.

Model Publisher Parameters Task Coverage
Granite Embedding 30M English IBM 30M Embeddings Full
Granite Docling 258M IBM 258M Multimodal Full
Granite Embedding 278M Multilingual IBM 278M Embeddings Full
Granite 4.0 H 350M IBM 340M Text generation Partial
granite 4.0 h 350M base IBM 340M Text generation Partial
Granite 4.0 350M IBM 352M Text generation Partial
granite 4.0 350M base IBM 352M Text generation Partial
Granite 3.0 1B-A400M Instruct IBM 1.3B Text generation Full
Granite 3.1 1B-A400M Instruct IBM 1.3B Text generation Full
Granite 4.0 H 1B IBM 1.5B Text generation Partial
granite 4.0 h 1B base IBM 1.5B Text generation Partial
Granite 4.0 1B IBM 1.6B Text generation Partial
granite 4.0 1B base IBM 1.6B Text generation Partial
granite 3.3 2B base IBM 2.5B Text generation Full
Granite 3.1 2B Instruct IBM 2.5B Text generation Full
Granite 3.2 2B Instruct IBM 2.5B Text generation Full
Granite Guardian 3.0 2B IBM 2.5B Other Full
Granite 3.3 2B Instruct IBM 2.5B Text generation Full
Granite 3.0 2B Instruct IBM 2.6B Text generation Full
Granite Vision 3.2 2B IBM 3B Multimodal Full
Granite Vision 3.3 2B IBM 3B Multimodal Full
Granite 4.0 H Micro IBM 3.2B Text generation Partial
granite 4.0 h micro base IBM 3.2B Text generation Partial
Granite 3.1 3B-A800M Instruct IBM 3.3B Text generation Full
Granite 3.0 3B-A800M Instruct IBM 3.4B Text generation Full
Granite 4.0 Micro IBM 3.4B Text generation Partial
granite 4.0 micro base IBM 3.4B Text generation Partial
Granite 4.1 3B IBM 3.4B Text generation Full
granite 3B code base 2k IBM 3.5B Coding Full
Granite 3B Code Instruct 128K IBM 3.5B Coding Full
Granite 3B Code Instruct 2K IBM 3.5B Coding Full
Granite 4.2 3B IBM 3.7B Text generation Full
Granite Vision 4.1 4B IBM 4B Multimodal Full
granite 4.0 tiny preview IBM 6.7B Text generation Partial
granite 4.0 tiny base preview IBM 6.7B Text generation Partial
Granite 4.0 H Tiny IBM 6.9B Text generation Partial
granite 4.0 h tiny base IBM 6.9B Text generation Partial
Merlinite 7B IBM 7.2B Text generation Full
granite 8B code base 4k IBM 8.1B Coding Full
Granite 8B Code Instruct 128K IBM 8.1B Coding Full
Granite 8B Code Instruct 4K IBM 8.1B Coding Full
granite 3.3 8B base IBM 8.2B Text generation Full
Granite 3.0 8B Instruct IBM 8.2B Text generation Full
Granite 3.1 8B Instruct IBM 8.2B Text generation Full
Granite 3.2 8B Instruct IBM 8.2B Text generation Full
Granite Guardian 3.0 8B IBM 8.2B Other Full
Granite 3.3 8B Instruct IBM 8.2B Text generation Full
Granite Guardian 3.3 8B IBM 8.2B Other Full
Granite Guardian 4.1 8B IBM 8.4B Other Full
Granite 4.1 8B IBM 8.8B Text generation Full
Granite 4.2 8B IBM 8.8B Text generation Full
Granite 20B Code Instruct 8K IBM 20.1B Coding Partial
Granite 4.1 30B IBM 28.9B Text generation Full
Granite 4.2 30B IBM 29.3B Text generation Full
Granite 4.0 H Small IBM 32.2B Text generation Partial
granite 4.0 h small base IBM 32.2B Text generation Partial

What else can your PC run?

Pick your GPU and system RAM to see every catalogued model that fits, with tested, estimated and potential answers kept apart.

Check my PC