Skip to main content
Parser for Granite 3.2 model output. Parser which receives Granite 3.2 model output and returns the constituents of the output. The input to the parser is assumed to be as follows: 
response_text

# Citations:
citations_text

# Hallucinations:
hallucinations_text
The output from the lowest level of the parser is a dictionary as follows:
  • “citations”: List of citations
  • “docs”: List of document references
  • “hallucinations”: List of hallucinations
  • “response”: Model response text without the above constituents
This dict is further refined into dataclasses before being returned as an extended AssistantMessage.

​
Classes

​
CLASS Granite32OutputProcessor

Output processor for version 3.2 of the main Granite models, all sizes.
Methods:

​
FUNC transform 

transform(self, model_output: str, chat_completion: ChatCompletion | None = None) -> AssistantMessage
Parse Granite 3.2 model output into a structured assistant message. Args:
  • model_output: Raw text output from the Granite 3.2 model.
  • chat_completion: The original chat completion request that produced model_output. Used to determine which output features (thinking, tools, citations, hallucinations) to parse. Defaults to None.
Returns:
  • A :class:Granite3AssistantMessage containing the parsed response text, optional tool calls, chain-of-thought reasoning, citations, documents, and hallucination annotations.
Raises:
  • ValueError: If parsing citations, documents, or hallucinations from the model output fails.