AI Evidence Matching

Purpose of the AI Evidence Matching Feature

The AI Evidence Matching feature is designed to analyze a file name and its contents, matching it to a request from the Information Request List (IRL) based on the request description and A-LIGN guidance. It offers a short summary of how the file meets the request and provides a confidence score indicating the accuracy of the match. 

Use Cases

1. Guiding clients on evidence reuse across the A-LIGN IRL for the same or multiple services.
2. Facilitating the transition of clients from other audit or readiness providers to A-LIGN.
3. Providing clients with insights on where their evidence meets or might fall short based on the request description and A-LIGN's Guidance. 

Enabling and Disabling AI Features 

By default, these AI features will be enabled for your engagement(s). If you would like to know more about the security of this feature, please refer to the A-SCEND AI Management and Security article.

If a client wishes to deactivate these features for their account, a Company Administrator or Engagement Administrator can do so using one of the two methods outlined below:

1. AI Feature Introduction Modal (shown to all users upon their first login after the feature release)

2. Profile/Engagement Settings

AI Evidence Matching Features

Leveraging AI for File Matching in Requests AI can enhance the process of matching files to requests in two ways:

1. Smart Recommendations: AI automatically suggests relevant files for requests that are in Open or In Progress status. These recommendations are based on files you have already attached to previously submitted requests.
2. AI Evidence Matching Page: This feature allows you to upload new files or select existing ones for analysis. AI then compares these files against all requests in the Information Request List (IRL) to identify potential matches.

Smart Recommendations

To review smart recommendations users should take the following steps:

1. Filter results to all requests with AI recommendations

2. Open the request card with recommendations and review the suggested files

3. Click to see the AI Analysis of why the files meets the request description

4. Approve or Human Validate the file to link it to the request or remove the file recommendation

• Note: Removing the file recommendation will remove it for all users and the file will not be recommended again for that request.

AI Evidence Matching Page

Accessing the Feature 

Navigate to the AI Matching page from the left navigation menu in A-SCEND from your selected engagement.

Note: Access to this page will be limited to the following users:

• Company Administrator
• Engagement Administrator
• Security Coordinators
• A-LIGN users with access to the engagement

Uploading Files and Supported File Types

Upload files you want to analyze by selecting the CTA shown below:

Analyzing Selected Files

Click on the ‘Link Files With AI’ button to start the analysis.

• Note that the analysis can only be ran once per file.

Analysis Process

Once started, the file(s) will be analyzed in the background and you can leave the page. You will receive a notification once the analysis is complete.

Reviewing AI Analysis and Confidence Score

To review the AI Analysis and Confidence Score, open the slider by selecting the row of the analyzed file.

• Confidence Score: Indicates the AI’s confidence level (High, Medium, or Low) in the file matching the request.
• AI Analysis: Provides an evaluation of how the file aligns with the request description and A-LIGN's Guidance.

Validating Results

Validate the result and link the file to the request by selecting the ‘Human Validated’ status or remove the file recommendation by selecting the 'X' CTA next to the request ID.

You can also remove all unvalidated or ‘AI Suggested’ files in bulk.

• Note: Once an AI suggestion has been removed, it cannot be suggested again.

v.4.13.26