Bs22 vertex ai - #346
Conversation
This provides the basic Hugo infrastructure updates to retrieve AI assisted search results and display them. In addition, the new directory search-function contains the code used to implement a cloud function that acts as an intermediary between Hugo and the Vertex AI search function. It acts as a gatekeeper allowing request only from specific websites and coordinates the structuring of the results with Hugo to allow display. This demonstrates end to end functionality. The results are somewhat rudimentary, the AI is only using the contents of the web page to address the query.
JS program to read contents of several Interlisp.org repos capturing information on markdown documents, PRs, issues and discussions. Contents are written as JSONL and can be imported into a storage bucket and imported into the search engine. Search results will include these elements. Update search results presentation to include github items, improve formatting of returned items. This aspect is still a work in progress.
Should capture the bulk of the exploration and setupp work done to get AI Search working.
|
Staging preview for this pull request is available at https://interlisp.github.io/Interlisp.staging/pr-346/ |
|
Consider the query is interlisp lexically scoped. Source 1 links to this file on GitHub https://github.com/Interlisp/Interlisp.github.io/blob/main/content/en/software/using-medley/cl-using.md instead of the corresponding page on the website: is this expected? |
No -- there is a considerable amount of work that still needs to be done. But this is good feedback. I need to work on precedence given to material - Interlisp.org over GitHub - if the material exists on the website. Definitely don't point to the website implementation for the answer. |
- index.js - revising query preamble (prompt) - vertex-ai-search-implementation.md - cleanup and integrating differences between the version on my old staging site and the interlisp.github.io repository These changes return better results(?) - more emphasis on the website, but signficant issues with indexed files and lacks GitHub info.
WIP -- Adding AI to Interlisp.org search.
Moving from old staging site to current.