Step by step guide summarizing how to best use Assessment Autofill to expedite completion of your assessment questionnaire.
Watch our on-demand Assessment Autofill webinar for NEW USERS.
Watch our on-demand Assessment Autofill webinar for RETURNING USERS.
Table of Contents:
What is Assessment Autofill?
Assessment Autofill is an AI-enabled feature that accelerates assessment cycles by reducing the time it takes a third-party analyst to review a third party's submitted evidence for control validation. This feature uses Natural Language Processing (NLP) and small language models to extract information from submitted evidence documents (security policies, completed questionnaires, etc.), then uses Generative AI to produce an AI response and final summarization of the results.
Assessment Autofill Overview:
Once a user uploads their documents and initiates Autofill, the Autofill pipeline will scan the documents for relevance to the assessment questions. Then, it will choose the most relevant pieces of information to generate an answer to the assessment question and provide the reasoning and references supporting that answer. Data is encrypted both in-transit and at rest to protect sensitive data in the evidence documents. Furthermore, after each use of Assessment Autofill, all data used in the processing pipeline is removed leaving no trace. The information upload continues to exist and maintain security outside of the pipeline like any other document uploaded to the Exchange.
In the provided results, there is a provided AI-derived answer and the AI analysis displayed alongside the existing confirmed response (if any). Assessment Autofill provides the identified relevant documents for the question, along with extracted rationale and references inside the source documents.
Refer to these articles for more information:
Using Assessment Autofill:
-
Upload Documents
At the top of the Questionnaire Dashboard and Documents tab there is helpful information regarding the feature and a quick button to easily upload docs.Select documents you would like to upload, multiple documents can be uploaded at once. Documents will appear in the document repository once uploaded. At this time, only PDF document types are supported for Autofill use.
After uploading documents through the autofill feature, you will see a list of all selected documents, which consists only of those PDF documents you just uploaded.
If you would like to include additional PDF documents that already exist in your repository, click cancel to view the Document Repository. From within the repository you may select any applicable existing documents through the "Use for Autofill" toggle associated with each. Select 'initiate autofill' once ready.
Helpful Tip: It is best to include as many documents as possible in an autofill run to ensure for the most comprehensive dataset to best evaluate and determine most appropriate AI answers. If autofill runs are performed singularly instead, although supported, it is possible the answers will differ per run since it is only taking into account the information provided in that single document.
-
Initiate Autofill
Once you have uploaded and selected all available documents for autofill, click the 'Initiate Autofill' button on the document repository to open the Autofill modal. Click 'Start Autofill' to begin processing the selected documents.-
In Progress State
After initiating autofill, you will see an in progress indicator at the top of the dashboard tabs. If an error occurs the banner will reflect this with a call to action to re-initiate autofill to try again. -
Completed State
Once it is complete, this banner will provide summary level information regarding the autofill run's results and quick access to review the answers in more detail.
It will show the total number of documents that were used in the latest run; the total number of AI answer suggestions that were generated out of the 209 total controls; and the total number of differences between a confirmed answer vs an AI derived answer.
-
In Progress State
-
Review and Accept AI Answers
You may either review and accept the AI answer suggestions comprehensively or you may choose to review and accept within each single control question page.-
Collective Review and Acceptance
Select 'Review AI Answers' to auto-scroll down to the Questions Review table found at the bottom of the Questionnaires tab to begin reviewing and accepting answers. This view supports comparative analysis of all existing confirmed answers vs AI answers. If more information is needed to best proceed with accepting an AI answer, open the drawer per control to review AI analysis and documents used to derive AI answers all in one view.
You can choose to select one control at a time and accept those selected AI answers, or you may choose to select and accept all. These methods are the most efficient way to accept AI answers across the entire assessment. Additionally, the associated documents used to derive the answer will be now auto-linked as an attachment. This ensures that for validation purposes and for internal contextualizing of how an answer was derived, the appropriate document validating the answer is maintained. -
Individual Review and Acceptance
Enter a customer's specific requested dataset through the Requests and Shares table or enter the entire questionnaire through the GRX Risk Controls card. When a control or metric question has an AI derived answer, the answer will have a sparkle icon indicating this. Additionally, the same AI analysis and documents that were used to derive the AI answer is shown.To accept an AI answer suggestion here, simply select the 'accept autofill answer' for the respective question. You may also choose to accept all available AI answers found on the page across the control and all 3 metrics by selecting Confirming an answer results in AI answer being confirmed by the accepting user. Additionally, the associated documents used to derive the answer will be now auto-linked as an attachment. This ensures that for validation purposes and for internal contextualizing of how an answer was derived, the appropriate document validating the answer is maintained. Document linkage only occurs at the control question level, therefore when accepting metric AI answers document linkage will not occur.
-
Collective Review and Acceptance
-
Review and Submit Questionnaire
After reviewing and accepting AI answer suggestions, you can submit the questionnaire at any time. Proceed as normal, using the current process to submit the questionnaire. -
Initiate Another Autofill Run
You may choose to initiate a new autofill run at any time with more documents.
All prior AI derived answers and AI analysis data will no longer be available however upon initiating a new run. Only the AI answers that were accepted, thus appearing as your confirmed answer, and the linked associated documents used to derive the answer will remain.