Repository navigation
Phase 3, part 2: put review answers on the form, and answer salary bands - #27
Merged
Merged
Conversation
…ry bands
While the browser is paused for review, an {type: "answers"} command runs a
short follow-up agent (like the submit one: password-scoped tools, never
sends the form) that puts the user's answers on the page, with fill_answer
for written ones. The run's record takes them as saved answers, the
required-field check runs again, and the review gets fresh questions and
notes; the first pass's summary, which still listed them as needing the
user, gives way to what this pass did.
A salary question with band options now gets the one band that holds the
salary expectation ("£31,500" in "£30,000-£35,000"). On a boundary, or a
range that straddles two bands, it's left for the user.
A live run of the real model on a local practice form: the review's two
answers (a convictions dropdown, an accuracy checkbox) went on the form. The
answers eval now requires the salary band; three runs kept every fact
within its labels and answered the band each time.
… panel Answers you save in the live review (a question left blank, or a draft you rewrote) wait in the questions panel with "Fill them in on the form", which sends them to the paused agent. The panel clears them once the agent reports back with the record updated. A smoke test drives a live review with the apply stream held open.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Phase 3, part 2: answers you give in the review go onto the form, and salary bands get answered.
Filling review answers in
Until now, an answer you saved in the review was kept for the next form, but you still had to type it into this one yourself. Now, while the agent's browser is paused, the questions panel collects the answers you save (a question left blank, or a draft you rewrote) and offers Fill them in on the form.
That sends an
answerscommand to the session. A short follow-up agent then puts the answers on the page: it chooses the option, types the text, or usesfill_answerfor a written answer.Salary bands
A salary question whose options are bands now gets the one band that holds your salary expectation (£31,500 → "£30,000-£35,000"). A figure on a boundary, or a range that spans two bands, is left for you. The reading prompt now tells the model to cite the salary fact for band questions, because in a full batch of questions it sometimes didn't.
Checked
convictions: No,accurate: true, and it was not submitted.Tests