We are currently working on new rules for what content should and shouldn't be allowed on this website, and are looking for feedback! See Esolang:2026 topicality proposal to view and give feedback on the current draft.
User:Hakerh400/Question for AI models
Jump to navigation
Jump to search
We devised a simple question for testing AI models:
- Is there a combinator X in SKI calculus, such that XK reduces to S and XS reduces to K?
Answers to this question can be tested online.
The list of open source models that produced the correct answer to this question on the first try with temperature and top_p set to 0 (for deterministic output):
(empty)
The list of models that eventually produced the correct answer, but they are either proprietary or did not produce the correct answer on the first try:
| Model | Combinator |
|---|---|
| Kimi | S(S(S(S(S(SI(KK))(KK))(KK))(KI))(KS))(KK)
|
| DeepSeek | S(S(S(S(S(SI(KK))(KI))(KI))(K(K(KK))))(K(KS)))(KI)
|
| Gemini | S(S(S(S(S(SI(KK))(K(KS)))(KK))(K(KK)))(KS))(KK)
|