
Below is a figure summarizing the performance of each
model across the four evaluation metrics.
| Question | Category | RedactedTerminal | ASI | PaaLLM | ChainGPT |
|---|---|---|---|---|---|
| What is the current price of $ETH in USD? | Price | 3.0 (6.8s) | 2.0 (3.2s) | 4.2 (7.6s) | 4.1 (25.8s) |
| Whatβs the price of token 0xdAC17F958D2ee523a22... | Price | 3.2 (12.0s) | 2.8 (3.2s) | 4.2 (13.9s) | 3.7 (29.4s) |
| List the top 10 cryptocurrencies by market cap. | Price | 3.2 (11.6s) | 1.8 (5.3s) | 4.0 (11.7s) | 2.5 (65.1s) |
| Which coins had the biggest gains and losses in... | Price | 2.6 (10.9s) | 1.8 (4.0s) | 4.6 (15.7s) | 2.3 (23.6s) |
| Give me the market cap and volume history for $... | Price | 3.0 (11.0s) | 3.0 (4.4s) | 4.6 (13.9s) | 2.1 (30.6s) |
| Provide OHLC data for $SOL for the past 7 days ... | Price | 3.4 (18.0s) | 3.6 (4.2s) | 4.2 (14.5s) | 1.5 (28.7s) |
| Search for all coins with 'AI' in the name (Tod... | Discovery & Search | 2.6 (20.4s) | 2.6 (5.3s) | 2.8 (11.9s) | 3.7 (29.6s) |
| What coins are trending right now (Today is 07/... | Discovery & Search | 3.8 (18.9s) | 2.0 (7.1s) | 2.8 (12.7s) | 2.7 (30.9s) |
| Which coins were recently listed on the market ... | Discovery & Search | 2.0 (12.5s) | 2.6 (4.2s) | 3.2 (11.0s) | 0.9 (28.8s) |
| List all available CoinGecko categories. | Discovery & Search | 3.0 (19.4s) | 2.6 (6.8s) | 3.2 (5.6s) | 1.3 (25.4s) |
| Show me the 30-day market chart for the NFT col... | NFT | 3.6 (13.4s) | 2.2 (4.3s) | 4.8 (10.6s) | 3.3 (36.1s) |
| What are the top trending pools on the Ethereum... | Pools | 3.6 (12.6s) | 2.6 (5.3s) | 3.8 (11.5s) | 2.1 (14.7s) |
| What is the current price (USD) of the token at... | Live Data | 2.4 (10.4s) | 3.4 (3.1s) | 4.4 (10.6s) | - |
ID: 1
What is the current price of $ETH in USD?
ID: 2
Whatβs the price of token 0xdAC17F958D2ee523a2206206994597C13D831ec7 on Ethereum?
0xdAC17F958D2ee523a2206206994597C13D831ec7 is $1.00.ID: 3
List the top 10 cryptocurrencies by market cap.
ID: 4
Which coins had the biggest gains and losses in the last 24 hours?
ID: 5
Give me the market cap and volume history for $BTC between Jan 1 and Jan 7, 2025.
ID: 6
Provide OHLC data for $SOL for the past 7 days (Today is 07/21/2025).
ID: 7
Search for all coins with 'AI' in the name (Today is 07/21/2025).
ID: 8
What coins are trending right now (Today is 07/21/2025)?
ID: 9
Which coins were recently listed on the market (Today is 07/21/2025)?
ID: 10
List all available CoinGecko categories.
ID: 11
Show me the 30-day market chart for the NFT collection 'bored-ape-yacht-club'.
ID: 12
What are the top trending pools on the Ethereum network?