Getting Started: AI Risk Analysis

Manifest can help you save time and find more results on your risk analysis of Open Weight AI models! Lets get you started with an analysis to understand what you can do.

For models that have been modified and tuned, please see AI Model Development Analysis

Get started with a Model

For an initial analysis, we will use a hugging face URL tied to a model that might be used in a piece of software.

DeBERTaV3: https://huggingface.co/microsoft/deberta-v3-base

You will notice on this page that there is no information about the datasets that were used to train this model, we can quickly find out that information, lets go to app.manifestcyber.com and open up the AI Explorer.


AI Model Analysis

Now that we are on the AI Explorer page, we can take the name of the model, or the hugging face URL and input it into the text box to search for the model

When you search with the model name, Manifest will show you recommendations for models that match up with that name. Select the most relevant name such as "microsoft/deberta-v3-base". Go ahead and click on the relevant model to kick off the analysis.

Once the analysis is complete, we can look at the results. We find that there are datasets with some licenses our risk policy forbids by default. We also see that there are many datasets listed, which are not present on the hugging face link to this page. In addition to that, the model is a bit outdated and we likely want to find a fresher model to ensure we are using a good model.


Additional Models:

Here are some additional models you might want to try analysis on:

  • Falcon 7B (Software Dependencies due to the AI Model)
  • Foundation Sec 8B Instruct (The parent model of the parent model is Llama 3.1)
  • Deepseek R1 (From a restricted country, ensure you set your Risk policies to restrict China first)

Additional Documentation: