Workflows / ray-settlement-queries · Gold

Reference answers (gold set)

Done: v1 picked · 160 rows

Gold v1 proposed by Dvar · Review · 159 of 160 accepted · Dropped —

160 rows in gold v1 · 160 ready · 0 not ready

160

Rows

7

Topics

3

Languages

160 of 160

Verified

160 rows give a pass rate within ±7 points (95% confidence), with 10% spare.

Rows

A member can swap or drop a row.

Topics

Language

en 75
hi 25
Rows. One row per customer message in this version.
Customer messageTopicGroupScoreState
Tool results: find_payment: {"matches":[{"id":"pay_Q4SlqzSwEBM0RY","amount":"₹5,999.00","method":"upi","captured_at":"16 Oct 2026, 07:55 IST"},{"id":"pay_Hd8YasvdQZlrcK","amount":"₹5,999.00","method":"upi","captured_at":"16 Oct 2026, 11:02 IST"}],"note":"2 payments match; ask whiSettlement status—1.00Accepted Today's reply
Tool results: list_settlements: {"settlements":[{"id":"setl_GEOEEBx9ReoXXw","type":"standard","date":"22 Oct 2026","amount":"₹9,078.56","status":"processed","utr":"ZKCBR52026102250246846"}]} get_bank_account_status: {"bank":"Kaveri Commercial Bank","account":"XXXXXX2077","ifsc":"Settlement status—1.00Accepted Today's reply
Tool results: find_payment: {"matches":[{"id":"pay_SCZL1cIp7C33G2","amount":"₹2,499.00","method":"card","captured_at":"19 Oct 2026, 09:45 IST"},{"id":"pay_8KIZ0BBohdrIht","amount":"₹2,499.00","method":"upi","captured_at":"19 Oct 2026, 13:41 IST"},{"id":"pay_0pFh08lCtYTuPd","amounSettlement status—1.00Accepted Today's reply
Tool results: find_payment: {"id":"pay_rKhXvGWQYMJ28X","amount":"₹24,999.00","method":"upi","captured_at":"18 Oct 2026, 18:57 IST","fee":"₹499.98","gst_on_fee":"₹90.00","status":"captured","settlement":{"id":"setl_rPYJraD7uC4PLj","type":"standard","date":"21 Oct 2026","status":"pSettlement status—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-240070","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} list_settlements: {"settlements":[{"id":"setl_wYIaSwQFtbHQIC","type":"standard","date":"23 Oct 2026","amount":"₹53,548.70",Settlement status—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-376362","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"} get_holds: {"holds":[{"type":"dispute","since":"20 Sep 2026","detail":"Dispute disp_ZD6xpO7CV2BAYm (under_review)","amount"Settlement status—1.00Accepted Today's reply
Tool results: find_payment: {"error":"no payment found","searched_for":"pay_E32jW4wwf8pI27"}Settlement status—1.00Accepted Today's reply
Tool results: find_payment: {"matches":[{"id":"pay_nfn4IgHGPuJnTO","amount":"₹999.00","method":"upi","captured_at":"22 Oct 2026, 08:48 IST"},{"id":"pay_YjyK7O8clxZflC","amount":"₹999.00","method":"card","captured_at":"22 Oct 2026, 20:15 IST"}],"note":"2 payments match; ask which Settlement status—1.00Accepted Today's reply
Tool results: find_payment: {"matches":[{"id":"pay_mHkcziKmQ9fEcE","amount":"₹999.00","method":"upi","captured_at":"19 Oct 2026, 10:56 IST"},{"id":"pay_zOiq5nYK3htyAp","amount":"₹999.00","method":"upi","captured_at":"19 Oct 2026, 14:47 IST"},{"id":"pay_eAeahZ1CnnOrhq","amount":"₹Settlement status—1.00Accepted Today's reply
Tool results: find_payment: {"error":"no payment found","searched_for":"pay_R7dabveZtefhOs"}Settlement status—1.00Accepted Today's reply
Tool results: list_settlements: {"settlements":[{"id":"setl_GEOEEBx9ReoXXw","type":"standard","date":"22 Oct 2026","amount":"₹9,078.56","status":"processed","utr":"ZKCBR52026102250246846"}]} get_bank_account_status: {"bank":"Kaveri Commercial Bank","account":"XXXXXX2077","ifsc":"Settlement status—1.00Accepted Today's reply
Tool results: find_payment: {"matches":[{"id":"pay_lklDCjRaLgVYmT","amount":"₹1,299.00","method":"upi","captured_at":"22 Oct 2026, 08:30 IST"},{"id":"pay_uoW4vOqffRUSy3","amount":"₹1,299.00","method":"upi","captured_at":"22 Oct 2026, 12:21 IST"}],"note":"2 payments match; ask whiSettlement status—0.00Accepted Today's reply
Tool results: find_payment: {"matches":[{"id":"pay_DjfNUBqKysHz2F","amount":"₹2,499.00","method":"upi","captured_at":"22 Oct 2026, 11:28 IST"},{"id":"pay_C7x31jCdFFbqww","amount":"₹2,499.00","method":"card","captured_at":"22 Oct 2026, 22:28 IST"}],"note":"2 payments match; ask whSettlement status—1.00Accepted Today's reply
Tool results: find_payment: {"error":"no payment found","searched_for":"pay_2ugkimXeE3ugUM"}Settlement status—1.00Accepted Today's reply
Tool results: handoff_to_human: {"ticket":"HND-843213","queue":"merchant support","status":"created","reply_window":"the support team replies on this chat"}Settlement status—1.00Accepted Today's reply
Tool results: list_settlements: {"settlements":[{"id":"setl_ogz4m0YU6eOY8j","type":"standard","date":"22 Oct 2026","amount":"₹2,87,546.83","status":"processed","utr":"ZVCBR52026102236109469"}]} get_bank_account_status: {"bank":"Vindhya Cooperative Bank","account":"XXXXXX8425","ifSettlement status—1.00Accepted Today's reply
Tool results: find_payment: {"id":"pay_pigpEWLzbHASr2","amount":"₹39,169.50","method":"wallet","captured_at":"19 Oct 2026, 13:41 IST","fee":"₹783.39","gst_on_fee":"₹141.01","status":"captured","settlement":{"id":"setl_PsdLyhLWVUzBsF","type":"standard","date":"22 Oct 2026","statusSettlement status—1.00Accepted Today's reply
Tool results: find_payment: {"error":"no payment found","searched_for":"pay_7PlklarSbn7xie"}Settlement status—1.00Accepted Today's reply
Tool results: find_payment: {"id":"pay_SGahwCzf4ullXg","amount":"₹32,175.20","method":"card","captured_at":"12 Oct 2026, 21:31 IST","fee":"₹643.50","gst_on_fee":"₹115.83","status":"captured","after_cutoff":"captured after 21:00 IST, so it counts towards the next day's batch","setSettlement status—1.00Accepted Today's reply
Tool results: find_payment: {"matches":[{"id":"pay_Q4SlqzSwEBM0RY","amount":"₹5,999.00","method":"upi","captured_at":"16 Oct 2026, 07:55 IST"},{"id":"pay_Hd8YasvdQZlrcK","amount":"₹5,999.00","method":"upi","captured_at":"16 Oct 2026, 11:02 IST"}],"note":"2 payments match; ask whiSettlement status—1.00Accepted Today's reply
Rows by topic and language
Row counts. How many rows each topic has in each language.
Topicenhi-LatnhiAll
Settlement status2013538
Amount and deductions1415635
Delayed, on hold or failed1116431
UTR and proof117321
Payouts64515
Account and plan changes81211
Instant settlement5409
All756025160
Version history1 version
  • Gold v1 Proposed by Dvar · 20 Oct · Locked with rubric v1 · 160 of 160 verified
——